2026-02-24T07:12:48.855 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T07:12:48.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:12:48.955 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577 branch: main description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} email: null first_in_suite: false flavor: debug job_id: '67577' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: crimson_allow_pg_split: false enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 thrashosds: min_in: 4 workunit: branch: wip-shraddhaag-enable-cephadm-tests env: CRIMSON_COMPAT: '1' sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 - node-exporter.a - - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5980 sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-shraddhaag-enable-cephadm-tests suite_path: /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa suite_relpath: qa suite_repo: https://github.com/shraddhaag/ceph.git suite_sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 targets: trial016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvZeeG88vWUIwpBaMsxlTQnIJ8qKVReX9S3p5x9VrIIvCVWMzVaeNwHIu+BbdVp9NZAhzg3lsfsIh48Zg3paIQ= trial043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg8IliAK5bZNKm1dK60whHoEjJyhpPduxeUVSWXoent0/QBkHCKaxgZIVZmCbYth6Br3blIP6gHudSCETpwVs0= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 debug osd: 10 osd_type: crimson - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_pgnum_grow: 2 chance_pgpnum_fix: 1 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 2 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_06:51:01 tube: trial user: shraddhaag verbose: false verify_ceph_hash: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T07:12:48.955 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa; will attempt to use it 2026-02-24T07:12:48.956 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa/tasks 2026-02-24T07:12:48.956 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T07:12:48.958 INFO:teuthology.task.internal:Saving configuration 2026-02-24T07:12:48.966 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T07:12:48.977 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T07:12:49.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial016.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:09:21.574506', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvZeeG88vWUIwpBaMsxlTQnIJ8qKVReX9S3p5x9VrIIvCVWMzVaeNwHIu+BbdVp9NZAhzg3lsfsIh48Zg3paIQ='} 2026-02-24T07:12:49.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial043.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:09:21.575220', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg8IliAK5bZNKm1dK60whHoEjJyhpPduxeUVSWXoent0/QBkHCKaxgZIVZmCbYth6Br3blIP6gHudSCETpwVs0='} 2026-02-24T07:12:49.090 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T07:12:49.101 INFO:teuthology.task.internal:roles: ubuntu@trial016.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-24T07:12:49.101 INFO:teuthology.task.internal:roles: ubuntu@trial043.front.sepia.ceph.com - ['osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-24T07:12:49.101 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T07:12:49.230 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7236bdc3e840>, signals=[15]) 2026-02-24T07:12:49.230 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T07:12:49.241 INFO:teuthology.task.internal:Opening connections... 2026-02-24T07:12:49.241 DEBUG:teuthology.task.internal:connecting to ubuntu@trial016.front.sepia.ceph.com 2026-02-24T07:12:49.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:12:49.305 DEBUG:teuthology.task.internal:connecting to ubuntu@trial043.front.sepia.ceph.com 2026-02-24T07:12:49.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:12:49.364 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T07:12:49.380 DEBUG:teuthology.orchestra.run.trial016:> uname -m 2026-02-24T07:12:49.396 INFO:teuthology.orchestra.run.trial016.stdout:x86_64 2026-02-24T07:12:49.396 DEBUG:teuthology.orchestra.run.trial016:> cat /etc/os-release 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:NAME="CentOS Stream" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:VERSION="9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:ID="centos" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:VERSION_ID="9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:ANSI_COLOR="0;31" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:12:49.452 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:12:49.453 INFO:teuthology.lock.ops:Updating trial016.front.sepia.ceph.com on lock server 2026-02-24T07:12:49.528 DEBUG:teuthology.orchestra.run.trial043:> uname -m 2026-02-24T07:12:49.543 INFO:teuthology.orchestra.run.trial043.stdout:x86_64 2026-02-24T07:12:49.543 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:12:49.602 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:12:49.603 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:12:49.603 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:12:49.603 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:12:49.603 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:12:49.603 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-24T07:12:49.687 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T07:12:49.705 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T07:12:49.729 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T07:12:49.729 DEBUG:teuthology.orchestra.run.trial016:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:12:49.730 DEBUG:teuthology.orchestra.run.trial043:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:12:49.745 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T07:12:49.757 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T07:12:49.757 DEBUG:teuthology.orchestra.run.trial016:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:12:49.786 DEBUG:teuthology.orchestra.run.trial043:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:12:49.802 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T07:12:49.978 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T07:12:49.997 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T07:12:49.997 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'osd.2': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T07:12:49.997 DEBUG:teuthology.orchestra.run.trial016:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:12:49.997 DEBUG:teuthology.orchestra.run.trial043:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:12:50.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:12:50.012 DEBUG:teuthology.orchestra.run.trial043:> uname -r 2026-02-24T07:12:50.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:12:50.012 DEBUG:teuthology.orchestra.run.trial016:> uname -r 2026-02-24T07:12:50.066 INFO:teuthology.orchestra.run.trial043.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:12:50.066 INFO:teuthology.task.kernel:Running kernel on trial043: 5.14.0-681.el9.x86_64 2026-02-24T07:12:50.066 DEBUG:teuthology.orchestra.run.trial043:> sudo yum install -y kernel 2026-02-24T07:12:50.067 INFO:teuthology.orchestra.run.trial016.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:12:50.068 INFO:teuthology.task.kernel:Running kernel on trial016: 5.14.0-681.el9.x86_64 2026-02-24T07:12:50.068 DEBUG:teuthology.orchestra.run.trial016:> sudo yum install -y kernel 2026-02-24T07:12:52.863 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.9 MB 00:02 2026-02-24T07:12:53.615 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.9 MB 00:03 2026-02-24T07:12:56.042 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-24T07:12:56.891 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-24T07:12:59.498 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 8.0 MB 00:01 2026-02-24T07:13:00.884 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 8.0 MB 00:01 2026-02-24T07:13:01.109 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T07:13:02.466 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-24T07:19:22.121 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 55 kB/s | 20 MB 06:20 2026-02-24T07:19:25.311 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 849 kB/s | 50 kB 00:00 2026-02-24T07:19:26.326 INFO:teuthology.orchestra.run.trial016.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T07:19:26.326 INFO:teuthology.orchestra.run.trial016.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T07:19:26.346 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:19:26.347 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:19:26.347 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T07:19:26.348 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:Install 4 Packages 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 89 M 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 135 M 2026-02-24T07:19:26.349 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:19:26.862 INFO:teuthology.orchestra.run.trial016.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 6.7 MB/s | 901 kB 00:00 2026-02-24T07:19:27.168 INFO:teuthology.orchestra.run.trial016.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 39 MB/s | 17 MB 00:00 2026-02-24T07:19:27.475 INFO:teuthology.orchestra.run.trial016.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 51 MB/s | 31 MB 00:00 2026-02-24T07:19:27.658 INFO:teuthology.orchestra.run.trial016.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 43 MB/s | 40 MB 00:00 2026-02-24T07:19:27.659 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:19:27.659 INFO:teuthology.orchestra.run.trial016.stdout:Total 68 MB/s | 89 MB 00:01 2026-02-24T07:19:27.849 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:19:28.050 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:19:28.050 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:19:28.433 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:19:28.434 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:19:29.540 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:19:29.828 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:19:29.849 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:19:32.396 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:19:32.429 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:19:35.464 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:19:35.471 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:38.520 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:55.926 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:55.947 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:56.135 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:56.135 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:19:56.136 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:19:56.136 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.193 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:56.194 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:19:56.255 DEBUG:teuthology.orchestra.run.trial016:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:19:56.285 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.285 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:19:56.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T07:19:56.286 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T07:19:56.286 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T07:19:56.286 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T07:19:56.286 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial016.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T07:19:56.286 DEBUG:teuthology.orchestra.run.trial016:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:19:56.352 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.352 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:19:56.352 DEBUG:teuthology.orchestra.run.trial016:> sudo rpm -qi grub2-tools 2026-02-24T07:19:56.420 INFO:teuthology.orchestra.run.trial016.stdout:Name : grub2-tools 2026-02-24T07:19:56.420 INFO:teuthology.orchestra.run.trial016.stdout:Epoch : 1 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Version : 2.06 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Release : 120.el9 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Architecture: x86_64 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Group : Unspecified 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Size : 9108611 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:License : GPLv3+ 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T07:19:56.421 INFO:teuthology.orchestra.run.trial016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:Packager : builder@centos.org 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:Vendor : CentOS 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:Summary : Support tools for GRUB. 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:Description : 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:hardware devices. 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:19:56.422 INFO:teuthology.orchestra.run.trial016.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T07:19:56.423 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T07:19:56.424 INFO:teuthology.task.kernel:Updating grub on trial016 to boot 5.14.0-686.el9.x86_64 2026-02-24T07:19:56.424 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T07:19:56.486 INFO:teuthology.orchestra.run.trial016.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T07:19:56.487 DEBUG:teuthology.orchestra.run.trial016:> sudo command -v grubby && echo yes || echo no 2026-02-24T07:19:56.550 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/grubby 2026-02-24T07:19:56.552 INFO:teuthology.orchestra.run.trial016.stdout:yes 2026-02-24T07:19:56.552 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T07:19:56.616 INFO:teuthology.orchestra.run.trial016.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T07:19:56.617 DEBUG:teuthology.orchestra.run.trial016:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.689 DEBUG:teuthology.orchestra.run.trial016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T07:19:56.895 INFO:teuthology.orchestra.run.trial016.stderr:Generating grub configuration file ... 2026-02-24T07:19:56.964 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T07:19:56.971 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T07:19:57.224 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T07:19:57.231 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T07:19:57.265 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T07:19:57.272 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T07:19:57.302 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T07:19:57.309 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T07:19:57.332 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T07:19:57.338 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T07:19:57.425 INFO:teuthology.orchestra.run.trial016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T07:19:57.434 INFO:teuthology.orchestra.run.trial016.stderr:done 2026-02-24T07:19:57.436 DEBUG:teuthology.orchestra.run.trial016:> test -d /sys/firmware/efi 2026-02-24T07:19:57.453 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T07:19:57.518 INFO:teuthology.orchestra.run.trial016.stdout:/boot/efi/EFI/BOOT 2026-02-24T07:19:57.518 INFO:teuthology.orchestra.run.trial016.stdout:/boot/efi/EFI/centos 2026-02-24T07:19:57.520 DEBUG:teuthology.orchestra.run.trial016:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T07:19:57.585 INFO:teuthology.orchestra.run.trial016.stdout:no 2026-02-24T07:19:57.585 DEBUG:teuthology.orchestra.run.trial016:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T07:19:57.649 INFO:teuthology.orchestra.run.trial016.stdout:yes 2026-02-24T07:19:57.650 DEBUG:teuthology.orchestra.run.trial016:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T07:19:57.714 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial016 2026-02-24T07:19:57.714 DEBUG:teuthology.orchestra.run.trial016:> sudo bash -c ' 2026-02-24T07:19:57.714 DEBUG:teuthology.orchestra.run.trial016:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T07:19:57.714 DEBUG:teuthology.orchestra.run.trial016:> ' 2026-02-24T07:20:27.757 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T07:20:27.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-24T07:20:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:20:42.048 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.16 2026-02-24T07:20:51.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-24T07:20:51.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:21:27.302 DEBUG:teuthology.orchestra.run.trial016:> true 2026-02-24T07:21:27.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-24T07:21:27.443 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T07:21:27.443 DEBUG:teuthology.orchestra.run.trial016:> uname -r 2026-02-24T07:21:27.499 INFO:teuthology.orchestra.run.trial016.stdout:5.14.0-686.el9.x86_64 2026-02-24T07:21:27.499 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T07:21:27.500 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T07:21:27.500 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T07:21:28.500 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T07:21:28.501 DEBUG:teuthology.orchestra.run.trial016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T07:21:28.530 INFO:teuthology.orchestra.run.trial016.stdout:ttyS1 2026-02-24T07:21:28.558 DEBUG:teuthology.parallel:result is None 2026-02-24T07:26:41.709 INFO:teuthology.orchestra.run.trial043.stdout:Extra Packages for Enterprise Linux 25 kB/s | 20 MB 13:39 2026-02-24T07:26:44.870 INFO:teuthology.orchestra.run.trial043.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T07:26:45.891 INFO:teuthology.orchestra.run.trial043.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T07:26:45.891 INFO:teuthology.orchestra.run.trial043.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T07:26:45.911 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:26:45.912 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:26:45.913 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout:Install 4 Packages 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 89 M 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 135 M 2026-02-24T07:26:45.914 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:26:46.399 INFO:teuthology.orchestra.run.trial043.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 3.9 MB/s | 901 kB 00:00 2026-02-24T07:26:46.562 INFO:teuthology.orchestra.run.trial043.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 44 MB/s | 17 MB 00:00 2026-02-24T07:26:46.732 INFO:teuthology.orchestra.run.trial043.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 93 MB/s | 31 MB 00:00 2026-02-24T07:26:46.787 INFO:teuthology.orchestra.run.trial043.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 65 MB/s | 40 MB 00:00 2026-02-24T07:26:46.788 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:26:46.788 INFO:teuthology.orchestra.run.trial043.stdout:Total 102 MB/s | 89 MB 00:00 2026-02-24T07:26:46.981 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:26:47.183 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:26:47.183 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:26:47.566 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:26:47.566 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:26:48.674 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:26:48.962 INFO:teuthology.orchestra.run.trial043.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:26:48.983 INFO:teuthology.orchestra.run.trial043.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:26:51.538 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:26:51.571 INFO:teuthology.orchestra.run.trial043.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:26:54.669 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:26:54.676 INFO:teuthology.orchestra.run.trial043.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:26:57.723 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:27:15.038 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:27:15.060 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:27:15.135 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:27:15.136 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:27:15.136 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:27:15.136 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:27:15.192 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:27:15.193 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:27:15.254 DEBUG:teuthology.orchestra.run.trial043:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:27:15.283 INFO:teuthology.orchestra.run.trial043.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:27:15.284 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T07:27:15.284 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T07:27:15.284 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T07:27:15.284 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2026-02-24T07:27:15.284 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial043.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T07:27:15.284 DEBUG:teuthology.orchestra.run.trial043:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:27:15.352 INFO:teuthology.orchestra.run.trial043.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.352 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:27:15.352 DEBUG:teuthology.orchestra.run.trial043:> sudo rpm -qi grub2-tools 2026-02-24T07:27:15.420 INFO:teuthology.orchestra.run.trial043.stdout:Name : grub2-tools 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Epoch : 1 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Version : 2.06 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Release : 120.el9 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Architecture: x86_64 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Group : Unspecified 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:Size : 9108611 2026-02-24T07:27:15.421 INFO:teuthology.orchestra.run.trial043.stdout:License : GPLv3+ 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Packager : builder@centos.org 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Vendor : CentOS 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Summary : Support tools for GRUB. 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout:Description : 2026-02-24T07:27:15.422 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout:hardware devices. 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:27:15.423 INFO:teuthology.orchestra.run.trial043.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T07:27:15.424 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T07:27:15.424 INFO:teuthology.task.kernel:Updating grub on trial043 to boot 5.14.0-686.el9.x86_64 2026-02-24T07:27:15.425 DEBUG:teuthology.orchestra.run.trial043:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T07:27:15.487 INFO:teuthology.orchestra.run.trial043.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T07:27:15.489 DEBUG:teuthology.orchestra.run.trial043:> sudo command -v grubby && echo yes || echo no 2026-02-24T07:27:15.555 INFO:teuthology.orchestra.run.trial043.stdout:/sbin/grubby 2026-02-24T07:27:15.556 INFO:teuthology.orchestra.run.trial043.stdout:yes 2026-02-24T07:27:15.557 DEBUG:teuthology.orchestra.run.trial043:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T07:27:15.620 INFO:teuthology.orchestra.run.trial043.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T07:27:15.622 DEBUG:teuthology.orchestra.run.trial043:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.696 DEBUG:teuthology.orchestra.run.trial043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T07:27:15.904 INFO:teuthology.orchestra.run.trial043.stderr:Generating grub configuration file ... 2026-02-24T07:27:15.971 INFO:teuthology.orchestra.run.trial043.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T07:27:15.978 INFO:teuthology.orchestra.run.trial043.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T07:27:16.231 INFO:teuthology.orchestra.run.trial043.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T07:27:16.237 INFO:teuthology.orchestra.run.trial043.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T07:27:16.271 INFO:teuthology.orchestra.run.trial043.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T07:27:16.278 INFO:teuthology.orchestra.run.trial043.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T07:27:16.309 INFO:teuthology.orchestra.run.trial043.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T07:27:16.316 INFO:teuthology.orchestra.run.trial043.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T07:27:16.340 INFO:teuthology.orchestra.run.trial043.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T07:27:16.347 INFO:teuthology.orchestra.run.trial043.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T07:27:16.434 INFO:teuthology.orchestra.run.trial043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T07:27:16.443 INFO:teuthology.orchestra.run.trial043.stderr:done 2026-02-24T07:27:16.445 DEBUG:teuthology.orchestra.run.trial043:> test -d /sys/firmware/efi 2026-02-24T07:27:16.461 DEBUG:teuthology.orchestra.run.trial043:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T07:27:16.526 INFO:teuthology.orchestra.run.trial043.stdout:/boot/efi/EFI/BOOT 2026-02-24T07:27:16.526 INFO:teuthology.orchestra.run.trial043.stdout:/boot/efi/EFI/centos 2026-02-24T07:27:16.528 DEBUG:teuthology.orchestra.run.trial043:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T07:27:16.596 INFO:teuthology.orchestra.run.trial043.stdout:no 2026-02-24T07:27:16.596 DEBUG:teuthology.orchestra.run.trial043:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T07:27:16.659 INFO:teuthology.orchestra.run.trial043.stdout:yes 2026-02-24T07:27:16.660 DEBUG:teuthology.orchestra.run.trial043:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T07:27:16.723 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial043 2026-02-24T07:27:16.724 DEBUG:teuthology.orchestra.run.trial043:> sudo bash -c ' 2026-02-24T07:27:16.724 DEBUG:teuthology.orchestra.run.trial043:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T07:27:16.724 DEBUG:teuthology.orchestra.run.trial043:> ' 2026-02-24T07:27:46.766 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2026-02-24T07:27:46.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-24T07:27:46.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:28:46.770 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T07:28:55.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-24T07:28:55.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:28:55.878 DEBUG:teuthology.orchestra.run.trial043:> true 2026-02-24T07:28:56.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-24T07:28:56.034 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-686.el9.x86_64"... 2026-02-24T07:28:56.034 DEBUG:teuthology.orchestra.run.trial043:> uname -r 2026-02-24T07:28:56.091 INFO:teuthology.orchestra.run.trial043.stdout:5.14.0-686.el9.x86_64 2026-02-24T07:28:56.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T07:28:56.092 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T07:28:56.092 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T07:28:57.093 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2026-02-24T07:28:57.094 DEBUG:teuthology.orchestra.run.trial043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T07:28:57.123 INFO:teuthology.orchestra.run.trial043.stdout:ttyS1 2026-02-24T07:28:57.152 DEBUG:teuthology.parallel:result is None 2026-02-24T07:28:57.153 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T07:28:57.165 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T07:28:57.166 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T07:28:57.177 DEBUG:teuthology.orchestra.run.trial043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T07:28:57.209 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T07:28:57.221 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T07:28:57.234 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T07:28:57.234 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T07:28:57.237 DEBUG:teuthology.orchestra.run.trial043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T07:28:57.274 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T07:28:57.286 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T07:28:57.286 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T07:28:57.294 DEBUG:teuthology.orchestra.run.trial043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T07:28:57.316 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:28:57.325 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:28:57.330 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:28:57.339 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:28:57.341 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T07:28:57.352 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T07:28:57.352 DEBUG:teuthology.orchestra.run.trial016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T07:28:57.368 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T07:28:57.405 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T07:28:57.421 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T07:28:57.422 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T07:28:57.432 DEBUG:teuthology.orchestra.run.trial043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T07:28:57.461 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:28:57.613 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:28:57.637 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:28:57.826 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:28:57.851 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:28:57.852 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T07:28:57.916 DEBUG:teuthology.orchestra.run.trial043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:28:58.000 DEBUG:teuthology.orchestra.run.trial043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:28:58.023 DEBUG:teuthology.orchestra.run.trial043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:28:58.324 DEBUG:teuthology.orchestra.run.trial043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:28:58.348 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:28:58.348 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T07:28:58.413 DEBUG:teuthology.orchestra.run.trial016:> sudo service rsyslog restart 2026-02-24T07:28:58.416 DEBUG:teuthology.orchestra.run.trial043:> sudo service rsyslog restart 2026-02-24T07:28:58.443 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:28:58.480 INFO:teuthology.orchestra.run.trial043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:28:58.850 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T07:28:58.861 INFO:teuthology.task.internal:Starting timer... 2026-02-24T07:28:58.861 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T07:28:58.884 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T07:28:58.903 DEBUG:teuthology.orchestra.run.trial016:> sudo service auditd rotate 2026-02-24T07:28:58.932 INFO:teuthology.orchestra.run.trial016.stdout:Rotating logs: 2026-02-24T07:28:58.934 DEBUG:teuthology.orchestra.run.trial043:> sudo service auditd rotate 2026-02-24T07:28:58.964 INFO:teuthology.orchestra.run.trial043.stdout:Rotating logs: 2026-02-24T07:28:58.966 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T07:28:58.966 DEBUG:teuthology.orchestra.run.trial016:> /usr/sbin/getenforce 2026-02-24T07:28:58.991 INFO:teuthology.orchestra.run.trial016.stdout:Permissive 2026-02-24T07:28:58.991 DEBUG:teuthology.orchestra.run.trial043:> /usr/sbin/getenforce 2026-02-24T07:28:59.022 INFO:teuthology.orchestra.run.trial043.stdout:Permissive 2026-02-24T07:28:59.022 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial016.front.sepia.ceph.com': 'permissive', 'ubuntu@trial043.front.sepia.ceph.com': 'permissive'} 2026-02-24T07:28:59.023 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:28:59.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:28:59.055 DEBUG:teuthology.orchestra.run.trial043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:28:59.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:28:59.087 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T07:28:59.088 DEBUG:teuthology.orchestra.run.trial016:> sudo /usr/sbin/setenforce permissive 2026-02-24T07:28:59.119 DEBUG:teuthology.orchestra.run.trial043:> sudo /usr/sbin/setenforce permissive 2026-02-24T07:28:59.151 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T07:28:59.166 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T07:28:59.176 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T07:28:59.178 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial016.front.sepia.ceph.com,trial043.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T07:31:55.522 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial016.front.sepia.ceph.com'), Remote(name='ubuntu@trial043.front.sepia.ceph.com')] 2026-02-24T07:31:55.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-24T07:31:55.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:31:55.678 DEBUG:teuthology.orchestra.run.trial016:> true 2026-02-24T07:31:55.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-24T07:31:55.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-24T07:31:55.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:31:55.863 DEBUG:teuthology.orchestra.run.trial043:> true 2026-02-24T07:31:55.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-24T07:31:55.940 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T07:31:55.953 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T07:31:55.954 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T07:31:55.954 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:31:55.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T07:31:55.956 DEBUG:teuthology.orchestra.run.trial043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:31:55.982 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T07:31:55.993 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T07:31:56.006 INFO:teuthology.orchestra.run.trial043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T07:31:56.013 INFO:teuthology.orchestra.run.trial016.stderr:sudo: ntpd: command not found 2026-02-24T07:31:56.017 INFO:teuthology.orchestra.run.trial043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T07:31:56.023 INFO:teuthology.orchestra.run.trial016.stdout:506 Cannot talk to daemon 2026-02-24T07:31:56.034 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T07:31:56.037 INFO:teuthology.orchestra.run.trial043.stderr:sudo: ntpd: command not found 2026-02-24T07:31:56.046 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T07:31:56.046 INFO:teuthology.orchestra.run.trial043.stdout:506 Cannot talk to daemon 2026-02-24T07:31:56.057 INFO:teuthology.orchestra.run.trial043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T07:31:56.069 INFO:teuthology.orchestra.run.trial043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T07:31:56.094 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:31:56.095 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:31:56.096 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-24T07:31:56.115 INFO:teuthology.orchestra.run.trial043.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:=============================================================================== 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:^? 104.233.211.205 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:^? ntp6.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:^? rn-02.koehn.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:31:56.134 INFO:teuthology.orchestra.run.trial043.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:31:56.135 INFO:teuthology.run_tasks:Running task install... 2026-02-24T07:31:56.148 DEBUG:teuthology.task.install:project ceph 2026-02-24T07:31:56.149 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}} 2026-02-24T07:31:56.149 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T07:31:56.149 INFO:teuthology.task.install:Using flavor: debug 2026-02-24T07:31:56.158 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T07:31:56.158 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-24T07:31:56.159 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T07:31:56.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:31:56.162 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T07:31:56.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:31:56.360 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T07:31:56.360 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T07:31:56.370 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T07:31:56.370 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T07:31:56.522 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T07:31:56.523 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:31:56.523 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T07:31:56.535 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T07:31:56.535 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:31:56.535 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T07:31:56.547 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T07:31:56.548 DEBUG:teuthology.orchestra.run.trial016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T07:31:56.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T07:31:56.561 DEBUG:teuthology.orchestra.run.trial043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T07:31:56.612 DEBUG:teuthology.orchestra.run.trial016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T07:31:56.625 DEBUG:teuthology.orchestra.run.trial043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T07:31:56.686 DEBUG:teuthology.orchestra.run.trial016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T07:31:56.697 DEBUG:teuthology.orchestra.run.trial043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T07:31:56.749 INFO:teuthology.orchestra.run.trial016.stdout:check_obsoletes = 1 2026-02-24T07:31:56.751 DEBUG:teuthology.orchestra.run.trial016:> sudo yum clean all 2026-02-24T07:31:56.761 INFO:teuthology.orchestra.run.trial043.stdout:check_obsoletes = 1 2026-02-24T07:31:56.763 DEBUG:teuthology.orchestra.run.trial043:> sudo yum clean all 2026-02-24T07:31:56.897 INFO:teuthology.orchestra.run.trial016.stdout:41 files removed 2026-02-24T07:31:56.909 INFO:teuthology.orchestra.run.trial043.stdout:41 files removed 2026-02-24T07:31:56.911 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-radosgw 2026-02-24T07:31:56.923 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-radosgw 2026-02-24T07:31:57.197 INFO:teuthology.orchestra.run.trial016.stdout:ceph packages for x86_64 682 kB/s | 94 kB 00:00 2026-02-24T07:31:57.201 INFO:teuthology.orchestra.run.trial043.stdout:ceph packages for x86_64 724 kB/s | 94 kB 00:00 2026-02-24T07:31:57.343 INFO:teuthology.orchestra.run.trial016.stdout:ceph noarch packages 210 kB/s | 25 kB 00:00 2026-02-24T07:31:57.346 INFO:teuthology.orchestra.run.trial043.stdout:ceph noarch packages 210 kB/s | 25 kB 00:00 2026-02-24T07:31:57.472 INFO:teuthology.orchestra.run.trial016.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T07:31:57.477 INFO:teuthology.orchestra.run.trial043.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T07:31:59.513 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.9 MB 00:02 2026-02-24T07:32:02.292 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-24T07:32:05.825 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 8.0 MB 00:01 2026-02-24T07:32:06.246 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-24T07:32:06.713 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 146 kB/s | 20 kB 00:00 2026-02-24T07:32:08.795 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T07:32:12.923 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 8.0 MB 00:01 2026-02-24T07:32:13.860 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 20 kB 00:00 2026-02-24T07:39:09.653 INFO:teuthology.orchestra.run.trial043.stdout:Extra Packages for Enterprise Linux 50 kB/s | 20 MB 06:55 2026-02-24T07:39:12.846 INFO:teuthology.orchestra.run.trial043.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-24T07:39:14.079 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout:Upgrading: 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T07:39:14.081 INFO:teuthology.orchestra.run.trial043.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:Installing weak dependencies: 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:Install 35 Packages 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:Upgrade 2 Packages 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:14.082 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 61 M 2026-02-24T07:39:14.083 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:39:16.262 INFO:teuthology.orchestra.run.trial043.stdout:(1/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x86 2.9 MB/s | 5.1 MB 00:01 2026-02-24T07:39:16.312 INFO:teuthology.orchestra.run.trial043.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 498 kB/s | 25 kB 00:00 2026-02-24T07:39:16.364 INFO:teuthology.orchestra.run.trial043.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 754 kB/s | 39 kB 00:00 2026-02-24T07:39:16.412 INFO:teuthology.orchestra.run.trial043.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 546 kB/s | 26 kB 00:00 2026-02-24T07:39:16.426 INFO:teuthology.orchestra.run.trial043.stdout:(5/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 5.8 MB/s | 11 MB 00:01 2026-02-24T07:39:16.477 INFO:teuthology.orchestra.run.trial043.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 5.0 MB/s | 263 kB 00:00 2026-02-24T07:39:16.564 INFO:teuthology.orchestra.run.trial043.stdout:(7/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 5.5 MB/s | 859 kB 00:00 2026-02-24T07:39:16.616 INFO:teuthology.orchestra.run.trial043.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 872 kB/s | 45 kB 00:00 2026-02-24T07:39:16.643 INFO:teuthology.orchestra.run.trial043.stdout:(9/37): python3-ceph-common-20.3.0-5440.gff63f3 6.9 MB/s | 186 kB 00:00 2026-02-24T07:39:16.668 INFO:teuthology.orchestra.run.trial043.stdout:(10/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 7.8 MB/s | 204 kB 00:00 2026-02-24T07:39:16.699 INFO:teuthology.orchestra.run.trial043.stdout:(11/37): python3-rados-20.3.0-5440.gff63f3d9.el 11 MB/s | 324 kB 00:00 2026-02-24T07:39:16.731 INFO:teuthology.orchestra.run.trial043.stdout:(12/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 9.2 MB/s | 306 kB 00:00 2026-02-24T07:39:16.747 INFO:teuthology.orchestra.run.trial043.stdout:(13/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_ 21 MB/s | 5.6 MB 00:00 2026-02-24T07:39:16.753 INFO:teuthology.orchestra.run.trial043.stdout:(14/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 4.5 MB/s | 100 kB 00:00 2026-02-24T07:39:16.969 INFO:teuthology.orchestra.run.trial043.stdout:(15/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 8.4 MB/s | 21 MB 00:02 2026-02-24T07:39:17.301 INFO:teuthology.orchestra.run.trial043.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-24T07:39:17.365 INFO:teuthology.orchestra.run.trial043.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-24T07:39:17.408 INFO:teuthology.orchestra.run.trial043.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-24T07:39:17.432 INFO:teuthology.orchestra.run.trial043.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.5 MB/s | 160 kB 00:00 2026-02-24T07:39:17.454 INFO:teuthology.orchestra.run.trial043.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-24T07:39:17.499 INFO:teuthology.orchestra.run.trial043.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 662 kB 00:00 2026-02-24T07:39:17.523 INFO:teuthology.orchestra.run.trial043.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-24T07:39:17.546 INFO:teuthology.orchestra.run.trial043.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-24T07:39:17.568 INFO:teuthology.orchestra.run.trial043.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-24T07:39:17.590 INFO:teuthology.orchestra.run.trial043.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.0 MB/s | 66 kB 00:00 2026-02-24T07:39:17.756 INFO:teuthology.orchestra.run.trial043.stdout:(26/37): pciutils-3.7.0-7.el9.x86_64.rpm 118 kB/s | 93 kB 00:00 2026-02-24T07:39:17.888 INFO:teuthology.orchestra.run.trial043.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-24T07:39:18.028 INFO:teuthology.orchestra.run.trial043.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 177 kB/s | 25 kB 00:00 2026-02-24T07:39:18.215 INFO:teuthology.orchestra.run.trial043.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 260 kB/s | 49 kB 00:00 2026-02-24T07:39:18.398 INFO:teuthology.orchestra.run.trial043.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 369 kB/s | 67 kB 00:00 2026-02-24T07:39:18.996 INFO:teuthology.orchestra.run.trial043.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.4 MB/s | 838 kB 00:00 2026-02-24T07:39:19.272 INFO:teuthology.orchestra.run.trial043.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 693 kB/s | 191 kB 00:00 2026-02-24T07:39:19.693 INFO:teuthology.orchestra.run.trial043.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2026-02-24T07:39:19.721 INFO:teuthology.orchestra.run.trial043.stdout:(34/37): nvme-cli-2.16-1.el9.x86_64.rpm 397 kB/s | 1.2 MB 00:02 2026-02-24T07:39:19.838 INFO:teuthology.orchestra.run.trial043.stdout:(35/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 23 MB/s | 2.7 MB 00:00 2026-02-24T07:39:19.866 INFO:teuthology.orchestra.run.trial043.stdout:(36/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 19 MB/s | 3.3 MB 00:00 2026-02-24T07:39:20.147 INFO:teuthology.orchestra.run.trial043.stdout:(37/37): thrift-0.15.0-4.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2026-02-24T07:39:20.152 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:39:20.152 INFO:teuthology.orchestra.run.trial043.stdout:Total 10 MB/s | 61 MB 00:06 2026-02-24T07:39:20.248 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:39:20.267 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:39:20.268 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:39:20.515 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:39:20.515 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:39:20.808 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:39:20.946 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T07:39:20.950 INFO:teuthology.orchestra.run.trial043.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:39:20.999 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:39:21.000 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:39:21.013 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:39:21.015 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T07:39:21.016 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:39:21.042 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:39:21.045 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T07:39:21.052 INFO:teuthology.orchestra.run.trial043.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T07:39:21.054 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T07:39:21.057 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T07:39:21.062 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T07:39:21.073 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T07:39:21.085 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:39:21.086 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:39:21.108 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:39:21.111 INFO:teuthology.orchestra.run.trial043.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T07:39:21.141 INFO:teuthology.orchestra.run.trial043.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T07:39:21.146 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T07:39:21.152 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T07:39:21.154 INFO:teuthology.orchestra.run.trial043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T07:39:21.158 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T07:39:21.274 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:39:21.275 INFO:teuthology.orchestra.run.trial043.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:39:21.303 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:39:21.306 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T07:39:21.313 INFO:teuthology.orchestra.run.trial043.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T07:39:21.562 INFO:teuthology.orchestra.run.trial043.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T07:39:21.563 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:39:21.578 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:39:21.584 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T07:39:21.590 INFO:teuthology.orchestra.run.trial043.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T07:39:21.593 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T07:39:21.593 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:39:21.611 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:39:21.725 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T07:39:21.727 INFO:teuthology.orchestra.run.trial043.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:39:22.009 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:39:22.009 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T07:39:22.009 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:22.052 INFO:teuthology.orchestra.run.trial043.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T07:39:22.054 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T07:39:22.998 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:39:23.001 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:39:23.261 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:39:23.265 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:39:23.306 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:39:23.306 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T07:39:23.306 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T07:39:23.306 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:23.309 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:39:27.822 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:39:27.822 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /sys 2026-02-24T07:39:27.822 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /proc 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /mnt 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /var/tmp 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /home 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /root 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /tmp 2026-02-24T07:39:27.823 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:28.317 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:39:28.340 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:28.341 INFO:teuthology.orchestra.run.trial043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:39:28.353 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:39:28.353 INFO:teuthology.orchestra.run.trial043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:39:28.409 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:39:28.409 INFO:teuthology.orchestra.run.trial043.stdout:Creating group 'qat' with GID 992. 2026-02-24T07:39:28.410 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:28.703 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T07:39:28.703 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:39:28.703 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:39:28.703 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T07:39:28.704 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T07:39:28.772 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout:Upgraded: 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T07:39:28.773 INFO:teuthology.orchestra.run.trial043.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T07:39:28.774 INFO:teuthology.orchestra.run.trial043.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T07:39:28.774 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:28.774 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:39:28.814 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-test 2026-02-24T07:39:29.134 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:17 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:39:29.219 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Install 12 Packages 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 131 M 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 977 M 2026-02-24T07:39:29.220 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:39:29.633 INFO:teuthology.orchestra.run.trial043.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 9.0 MB/s | 2.1 MB 00:00 2026-02-24T07:39:29.658 INFO:teuthology.orchestra.run.trial043.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 900 kB/s | 23 kB 00:00 2026-02-24T07:39:29.685 INFO:teuthology.orchestra.run.trial043.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.5 MB/s | 94 kB 00:00 2026-02-24T07:39:29.686 INFO:teuthology.orchestra.run.trial043.stdout:(4/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 535 kB/s | 153 kB 00:00 2026-02-24T07:39:30.336 INFO:teuthology.orchestra.run.trial043.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 271 kB/s | 176 kB 00:00 2026-02-24T07:39:30.658 INFO:teuthology.orchestra.run.trial043.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 726 kB/s | 233 kB 00:00 2026-02-24T07:39:30.722 INFO:teuthology.orchestra.run.trial043.stdout:(7/12): libasan8-15.2.1-7.el9.x86_64.rpm 506 kB/s | 525 kB 00:01 2026-02-24T07:39:31.119 INFO:teuthology.orchestra.run.trial043.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 764 kB/s | 303 kB 00:00 2026-02-24T07:39:31.203 INFO:teuthology.orchestra.run.trial043.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 765 kB/s | 64 kB 00:00 2026-02-24T07:39:31.243 INFO:teuthology.orchestra.run.trial043.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.0 MB/s | 122 kB 00:00 2026-02-24T07:39:31.850 INFO:teuthology.orchestra.run.trial043.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 863 kB/s | 1.0 MB 00:01 2026-02-24T07:39:34.751 INFO:teuthology.orchestra.run.trial043.stdout:(12/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x8 24 MB/s | 126 MB 00:05 2026-02-24T07:39:34.754 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:39:34.754 INFO:teuthology.orchestra.run.trial043.stdout:Total 24 MB/s | 131 MB 00:05 2026-02-24T07:39:34.836 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:39:34.848 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:39:34.848 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:39:35.274 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:39:35.274 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:39:35.727 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:39:35.735 INFO:teuthology.orchestra.run.trial043.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T07:39:35.744 INFO:teuthology.orchestra.run.trial043.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T07:39:35.749 INFO:teuthology.orchestra.run.trial043.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T07:39:35.753 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T07:39:35.756 INFO:teuthology.orchestra.run.trial043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T07:39:35.760 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T07:39:35.761 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:39:35.779 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:39:35.782 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T07:39:35.792 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T07:39:35.801 INFO:teuthology.orchestra.run.trial043.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T07:39:35.801 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:39:42.803 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:39:42.823 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:39:43.565 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T07:39:43.566 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:39:43.626 INFO:teuthology.orchestra.run.trial043.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:43.627 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:39:43.668 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph 2026-02-24T07:39:43.980 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:31 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:39:44.067 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:39:44.069 INFO:teuthology.orchestra.run.trial043.stdout:======================================================================================= 2026-02-24T07:39:44.069 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout:======================================================================================= 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T07:39:44.070 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T07:39:44.071 INFO:teuthology.orchestra.run.trial043.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T07:39:44.072 INFO:teuthology.orchestra.run.trial043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T07:39:44.073 INFO:teuthology.orchestra.run.trial043.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T07:39:44.074 INFO:teuthology.orchestra.run.trial043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T07:39:44.075 INFO:teuthology.orchestra.run.trial043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T07:39:44.076 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout:Installing weak dependencies: 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T07:39:44.077 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout:======================================================================================= 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout:Install 96 Packages 2026-02-24T07:39:44.078 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:39:44.079 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 225 M 2026-02-24T07:39:44.079 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 1.5 G 2026-02-24T07:39:44.079 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:39:44.619 INFO:teuthology.orchestra.run.trial043.stdout:(1/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 129 kB/s | 6.5 kB 00:00 2026-02-24T07:39:44.709 INFO:teuthology.orchestra.run.trial043.stdout:(2/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 6.5 MB/s | 937 kB 00:00 2026-02-24T07:39:44.730 INFO:teuthology.orchestra.run.trial043.stdout:(3/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 13 MB/s | 2.0 MB 00:00 2026-02-24T07:39:44.733 INFO:teuthology.orchestra.run.trial043.stdout:(4/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 6.7 MB/s | 163 kB 00:00 2026-02-24T07:39:44.878 INFO:teuthology.orchestra.run.trial043.stdout:(5/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 19 MB/s | 4.9 MB 00:00 2026-02-24T07:39:44.918 INFO:teuthology.orchestra.run.trial043.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5440.gff 1.4 MB/s | 57 kB 00:00 2026-02-24T07:39:44.963 INFO:teuthology.orchestra.run.trial043.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 4.0 MB/s | 184 kB 00:00 2026-02-24T07:39:45.390 INFO:teuthology.orchestra.run.trial043.stdout:(8/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 22 MB/s | 15 MB 00:00 2026-02-24T07:39:45.768 INFO:teuthology.orchestra.run.trial043.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 20 MB/s | 7.4 MB 00:00 2026-02-24T07:39:45.803 INFO:teuthology.orchestra.run.trial043.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 637 kB/s | 22 kB 00:00 2026-02-24T07:39:45.845 INFO:teuthology.orchestra.run.trial043.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 7.0 MB/s | 298 kB 00:00 2026-02-24T07:39:45.882 INFO:teuthology.orchestra.run.trial043.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 1.3 MB/s | 50 kB 00:00 2026-02-24T07:39:45.918 INFO:teuthology.orchestra.run.trial043.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 481 kB/s | 17 kB 00:00 2026-02-24T07:39:45.960 INFO:teuthology.orchestra.run.trial043.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 7.0 MB/s | 301 kB 00:00 2026-02-24T07:39:46.017 INFO:teuthology.orchestra.run.trial043.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 18 MB/s | 1.0 MB 00:00 2026-02-24T07:39:46.849 INFO:teuthology.orchestra.run.trial043.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 422 kB/s | 351 kB 00:00 2026-02-24T07:39:46.951 INFO:teuthology.orchestra.run.trial043.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 398 kB/s | 40 kB 00:00 2026-02-24T07:39:47.175 INFO:teuthology.orchestra.run.trial043.stdout:(18/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 23 MB/s | 51 MB 00:02 2026-02-24T07:39:47.176 INFO:teuthology.orchestra.run.trial043.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 319 kB/s | 72 kB 00:00 2026-02-24T07:39:47.733 INFO:teuthology.orchestra.run.trial043.stdout:(20/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 29 MB/s | 87 MB 00:02 2026-02-24T07:39:47.890 INFO:teuthology.orchestra.run.trial043.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 259 kB/s | 184 kB 00:00 2026-02-24T07:39:48.183 INFO:teuthology.orchestra.run.trial043.stdout:(22/96): libgfortran-11.5.0-14.el9.x86_64.rpm 788 kB/s | 794 kB 00:01 2026-02-24T07:39:48.362 INFO:teuthology.orchestra.run.trial043.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 597 kB/s | 106 kB 00:00 2026-02-24T07:39:48.470 INFO:teuthology.orchestra.run.trial043.stdout:(24/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 343 kB/s | 253 kB 00:00 2026-02-24T07:39:48.540 INFO:teuthology.orchestra.run.trial043.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 758 kB/s | 135 kB 00:00 2026-02-24T07:39:48.720 INFO:teuthology.orchestra.run.trial043.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 703 kB/s | 126 kB 00:00 2026-02-24T07:39:48.727 INFO:teuthology.orchestra.run.trial043.stdout:(27/96): python3-pyparsing-2.4.7-9.el9.noarch.r 585 kB/s | 150 kB 00:00 2026-02-24T07:39:48.985 INFO:teuthology.orchestra.run.trial043.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 707 kB/s | 182 kB 00:00 2026-02-24T07:39:49.055 INFO:teuthology.orchestra.run.trial043.stdout:(29/96): python3-urllib3-1.26.5-7.el9.noarch.rp 650 kB/s | 218 kB 00:00 2026-02-24T07:39:49.115 INFO:teuthology.orchestra.run.trial043.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 502 kB/s | 30 kB 00:00 2026-02-24T07:39:49.174 INFO:teuthology.orchestra.run.trial043.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 50 MB/s | 3.0 MB 00:00 2026-02-24T07:39:49.201 INFO:teuthology.orchestra.run.trial043.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 539 kB/s | 15 kB 00:00 2026-02-24T07:39:49.227 INFO:teuthology.orchestra.run.trial043.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 9.3 MB/s | 246 kB 00:00 2026-02-24T07:39:49.256 INFO:teuthology.orchestra.run.trial043.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 6.4 MB/s | 188 kB 00:00 2026-02-24T07:39:49.281 INFO:teuthology.orchestra.run.trial043.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 1.7 MB/s | 42 kB 00:00 2026-02-24T07:39:49.321 INFO:teuthology.orchestra.run.trial043.stdout:(36/96): zip-3.0-35.el9.x86_64.rpm 790 kB/s | 266 kB 00:00 2026-02-24T07:39:49.349 INFO:teuthology.orchestra.run.trial043.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 77 MB/s | 5.3 MB 00:00 2026-02-24T07:39:49.377 INFO:teuthology.orchestra.run.trial043.stdout:(38/96): python3-babel-2.9.1-2.el9.noarch.rpm 108 MB/s | 6.0 MB 00:00 2026-02-24T07:39:49.389 INFO:teuthology.orchestra.run.trial043.stdout:(39/96): python3-devel-3.9.25-3.el9.x86_64.rpm 6.1 MB/s | 244 kB 00:00 2026-02-24T07:39:49.401 INFO:teuthology.orchestra.run.trial043.stdout:(40/96): python3-cryptography-36.0.1-5.el9.x86_ 844 kB/s | 1.2 MB 00:01 2026-02-24T07:39:49.417 INFO:teuthology.orchestra.run.trial043.stdout:(41/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 6.0 MB/s | 249 kB 00:00 2026-02-24T07:39:49.418 INFO:teuthology.orchestra.run.trial043.stdout:(42/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.6 MB/s | 48 kB 00:00 2026-02-24T07:39:49.444 INFO:teuthology.orchestra.run.trial043.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-24T07:39:49.456 INFO:teuthology.orchestra.run.trial043.stdout:(44/96): python3-libstoragemgmt-1.10.1-1.el9.x8 3.2 MB/s | 177 kB 00:00 2026-02-24T07:39:49.471 INFO:teuthology.orchestra.run.trial043.stdout:(45/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 23 MB/s | 1.2 MB 00:00 2026-02-24T07:39:49.491 INFO:teuthology.orchestra.run.trial043.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 13 MB/s | 442 kB 00:00 2026-02-24T07:39:49.503 INFO:teuthology.orchestra.run.trial043.stdout:(47/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 105 MB/s | 6.1 MB 00:00 2026-02-24T07:39:49.527 INFO:teuthology.orchestra.run.trial043.stdout:(48/96): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2026-02-24T07:39:49.528 INFO:teuthology.orchestra.run.trial043.stdout:(49/96): python3-protobuf-3.14.0-17.el9.noarch. 7.2 MB/s | 267 kB 00:00 2026-02-24T07:39:49.528 INFO:teuthology.orchestra.run.trial043.stdout:(50/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 6.0 MB/s | 157 kB 00:00 2026-02-24T07:39:49.559 INFO:teuthology.orchestra.run.trial043.stdout:(51/96): python3-pyasn1-modules-0.4.8-7.el9.noa 8.5 MB/s | 277 kB 00:00 2026-02-24T07:39:49.559 INFO:teuthology.orchestra.run.trial043.stdout:(52/96): python3-requests-oauthlib-1.3.0-12.el9 1.7 MB/s | 54 kB 00:00 2026-02-24T07:39:49.588 INFO:teuthology.orchestra.run.trial043.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.5 MB/s | 189 kB 00:00 2026-02-24T07:39:49.589 INFO:teuthology.orchestra.run.trial043.stdout:(54/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.4 MB/s | 42 kB 00:00 2026-02-24T07:39:49.639 INFO:teuthology.orchestra.run.trial043.stdout:(55/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.8 MB/s | 90 kB 00:00 2026-02-24T07:39:49.668 INFO:teuthology.orchestra.run.trial043.stdout:(56/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 139 MB/s | 19 MB 00:00 2026-02-24T07:39:49.839 INFO:teuthology.orchestra.run.trial043.stdout:(57/96): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2026-02-24T07:39:50.281 INFO:teuthology.orchestra.run.trial043.stdout:(58/96): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-24T07:39:50.996 INFO:teuthology.orchestra.run.trial043.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 17 kB/s | 19 kB 00:01 2026-02-24T07:39:53.037 INFO:teuthology.orchestra.run.trial043.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 268 kB/s | 548 kB 00:02 2026-02-24T07:39:53.181 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:53.469 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:53.534 INFO:teuthology.orchestra.run.trial043.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 59 kB/s | 29 kB 00:00 2026-02-24T07:39:53.680 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-backports-tarfile-1.2.0-1.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-backports-tarfile-1.2.0-1.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:53.822 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-backports-tarfile-1.2.0-1.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-backports-tarfile-1.2.0-1.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:53.907 INFO:teuthology.orchestra.run.trial043.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 161 kB/s | 60 kB 00:00 2026-02-24T07:39:54.051 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-bcrypt-3.2.2-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-bcrypt-3.2.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:39:54.196 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-bcrypt-3.2.2-1.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-bcrypt-3.2.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:39:54.281 INFO:teuthology.orchestra.run.trial043.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 116 kB/s | 43 kB 00:00 2026-02-24T07:39:54.412 INFO:teuthology.orchestra.run.trial043.stdout:(64/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 116 kB/s | 551 kB 00:04 2026-02-24T07:39:55.288 INFO:teuthology.orchestra.run.trial043.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 32 kB/s | 32 kB 00:01 2026-02-24T07:39:55.915 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-certifi-2023.05.07-4.el9.noarch.rpm: Status code: 500 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-certifi-2023.05.07-4.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:55.960 INFO:teuthology.orchestra.run.trial043.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 9.1 kB/s | 14 kB 00:01 2026-02-24T07:39:56.570 INFO:teuthology.orchestra.run.trial043.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 136 kB/s | 173 kB 00:01 2026-02-24T07:39:56.722 INFO:teuthology.orchestra.run.trial043.stdout:[MIRROR] python3-google-auth-2.45.0-1.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-google-auth-2.45.0-1.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:39:56.848 INFO:teuthology.orchestra.run.trial043.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 922 kB/s | 254 kB 00:00 2026-02-24T07:39:57.044 INFO:teuthology.orchestra.run.trial043.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2026-02-24T07:39:57.165 INFO:teuthology.orchestra.run.trial043.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 1.2 MB/s | 144 kB 00:00 2026-02-24T07:39:57.281 INFO:teuthology.orchestra.run.trial043.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.2 MB/s | 139 kB 00:00 2026-02-24T07:39:57.367 INFO:teuthology.orchestra.run.trial043.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 655 kB/s | 56 kB 00:00 2026-02-24T07:39:57.416 INFO:teuthology.orchestra.run.trial043.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 216 kB/s | 11 kB 00:00 2026-02-24T07:39:57.482 INFO:teuthology.orchestra.run.trial043.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 267 kB/s | 18 kB 00:00 2026-02-24T07:39:57.547 INFO:teuthology.orchestra.run.trial043.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 361 kB/s | 23 kB 00:00 2026-02-24T07:39:57.612 INFO:teuthology.orchestra.run.trial043.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 304 kB/s | 20 kB 00:00 2026-02-24T07:39:57.677 INFO:teuthology.orchestra.run.trial043.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 299 kB/s | 19 kB 00:00 2026-02-24T07:39:57.742 INFO:teuthology.orchestra.run.trial043.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 404 kB/s | 26 kB 00:00 2026-02-24T07:39:57.913 INFO:teuthology.orchestra.run.trial043.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2026-02-24T07:39:57.998 INFO:teuthology.orchestra.run.trial043.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 926 kB/s | 79 kB 00:00 2026-02-24T07:39:58.085 INFO:teuthology.orchestra.run.trial043.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-24T07:39:58.169 INFO:teuthology.orchestra.run.trial043.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 683 kB/s | 58 kB 00:00 2026-02-24T07:39:58.235 INFO:teuthology.orchestra.run.trial043.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 250 kB/s | 16 kB 00:00 2026-02-24T07:39:58.320 INFO:teuthology.orchestra.run.trial043.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2026-02-24T07:39:58.385 INFO:teuthology.orchestra.run.trial043.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 475 kB/s | 31 kB 00:00 2026-02-24T07:39:58.492 INFO:teuthology.orchestra.run.trial043.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2026-02-24T07:39:58.578 INFO:teuthology.orchestra.run.trial043.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 688 kB/s | 59 kB 00:00 2026-02-24T07:39:58.683 INFO:teuthology.orchestra.run.trial043.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 1.2 MB/s | 125 kB 00:00 2026-02-24T07:39:58.748 INFO:teuthology.orchestra.run.trial043.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 552 kB/s | 36 kB 00:00 2026-02-24T07:39:58.833 INFO:teuthology.orchestra.run.trial043.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-24T07:39:58.921 INFO:teuthology.orchestra.run.trial043.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2026-02-24T07:39:59.005 INFO:teuthology.orchestra.run.trial043.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 574 kB/s | 48 kB 00:00 2026-02-24T07:39:59.074 INFO:teuthology.orchestra.run.trial043.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 321 kB/s | 22 kB 00:00 2026-02-24T07:39:59.139 INFO:teuthology.orchestra.run.trial043.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 308 kB/s | 20 kB 00:00 2026-02-24T07:39:59.244 INFO:teuthology.orchestra.run.trial043.stdout:(95/96): python3-cherrypy-18.6.1-2.el9.noarch.r 109 kB/s | 358 kB 00:03 2026-02-24T07:40:00.254 INFO:teuthology.orchestra.run.trial043.stdout:(96/96): luarocks-3.9.2-5.el9.noarch.rpm 15 kB/s | 151 kB 00:09 2026-02-24T07:40:00.258 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:00.258 INFO:teuthology.orchestra.run.trial043.stdout:Total 14 MB/s | 225 MB 00:16 2026-02-24T07:40:00.666 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:00.704 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:00.704 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:01.506 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:01.506 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:02.339 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:02.341 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T07:40:02.345 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T07:40:02.366 INFO:teuthology.orchestra.run.trial043.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T07:40:02.400 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T07:40:02.406 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T07:40:02.409 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T07:40:02.413 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T07:40:02.437 INFO:teuthology.orchestra.run.trial043.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T07:40:02.449 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T07:40:02.452 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T07:40:02.459 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T07:40:02.461 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T07:40:02.472 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T07:40:02.478 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T07:40:02.502 INFO:teuthology.orchestra.run.trial043.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T07:40:02.505 INFO:teuthology.orchestra.run.trial043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T07:40:02.556 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T07:40:02.569 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T07:40:02.571 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T07:40:02.576 INFO:teuthology.orchestra.run.trial043.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T07:40:02.581 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T07:40:02.586 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T07:40:02.589 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T07:40:02.604 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T07:40:02.608 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T07:40:02.613 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T07:40:02.625 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T07:40:02.634 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T07:40:02.640 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T07:40:02.660 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T07:40:02.671 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T07:40:02.687 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T07:40:02.692 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T07:40:02.700 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T07:40:02.740 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T07:40:03.070 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T07:40:03.080 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T07:40:03.084 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T07:40:03.089 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T07:40:03.091 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T07:40:03.119 INFO:teuthology.orchestra.run.trial043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T07:40:03.163 INFO:teuthology.orchestra.run.trial043.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T07:40:03.172 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T07:40:03.177 INFO:teuthology.orchestra.run.trial043.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T07:40:03.181 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T07:40:03.187 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T07:40:03.190 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T07:40:03.197 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T07:40:03.201 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T07:40:03.229 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T07:40:03.239 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T07:40:03.245 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T07:40:03.252 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T07:40:03.287 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T07:40:03.515 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T07:40:03.538 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T07:40:03.542 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T07:40:03.601 INFO:teuthology.orchestra.run.trial043.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T07:40:03.603 INFO:teuthology.orchestra.run.trial043.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T07:40:03.624 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T07:40:03.955 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T07:40:04.029 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T07:40:04.710 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T07:40:04.727 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T07:40:04.737 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T07:40:04.743 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T07:40:04.757 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T07:40:04.773 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T07:40:04.850 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T07:40:04.858 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T07:40:04.882 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T07:40:04.913 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T07:40:04.964 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T07:40:04.970 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T07:40:04.974 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T07:40:04.975 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T07:40:05.003 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:40:05.004 INFO:teuthology.orchestra.run.trial043.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T07:40:05.004 INFO:teuthology.orchestra.run.trial043.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T07:40:05.004 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:05.011 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:40:05.038 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:40:05.038 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T07:40:05.038 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:05.075 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T07:40:05.663 INFO:teuthology.orchestra.run.trial043.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T07:40:11.002 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T07:40:11.067 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T07:40:11.069 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:40:11.084 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:40:11.084 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:11.084 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T07:40:11.084 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:11.096 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:40:11.120 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:40:11.120 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:11.120 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T07:40:11.120 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:40:11.120 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:40:11.121 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:11.179 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:40:11.181 INFO:teuthology.orchestra.run.trial043.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:40:11.191 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T07:40:11.215 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T07:40:11.216 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:40:14.125 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:40:14.132 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:40:14.590 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:40:14.591 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:40:14.605 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:40:14.605 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:40:14.669 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:40:14.709 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T07:40:14.710 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:40:14.731 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:14.744 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:40:14.963 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:40:14.964 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:40:14.986 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:15.070 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:40:15.089 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:40:15.089 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:15.089 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T07:40:15.090 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:40:15.090 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:40:15.090 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:15.090 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:40:15.097 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:40:15.122 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T07:40:16.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T07:40:16.482 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T07:40:16.483 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T07:40:16.554 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.555 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T07:40:16.556 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T07:40:16.557 INFO:teuthology.orchestra.run.trial043.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T07:40:16.558 INFO:teuthology.orchestra.run.trial043.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T07:40:16.559 INFO:teuthology.orchestra.run.trial043.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T07:40:16.560 INFO:teuthology.orchestra.run.trial043.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T07:40:16.561 INFO:teuthology.orchestra.run.trial043.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: zip-3.0-35.el9.x86_64 2026-02-24T07:40:16.562 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:16.563 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:16.620 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-base 2026-02-24T07:40:16.935 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:04 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:17.000 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:17.018 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:17.019 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:17.019 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:17.041 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install cephadm 2026-02-24T07:40:17.353 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:05 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:17.419 INFO:teuthology.orchestra.run.trial043.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:17.437 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:17.438 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:17.438 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:17.459 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T07:40:17.775 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:05 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:17.859 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:17.860 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:17.861 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:17.862 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 149 k 2026-02-24T07:40:17.862 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 455 k 2026-02-24T07:40:17.862 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:17.946 INFO:teuthology.orchestra.run.trial043.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 1.7 MB/s | 149 kB 00:00 2026-02-24T07:40:17.946 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:17.946 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.7 MB/s | 149 kB 00:00 2026-02-24T07:40:17.947 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:17.951 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:17.951 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:17.981 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:17.982 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:18.037 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:18.039 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:40:18.061 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:40:18.061 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:18.061 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T07:40:18.061 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:18.373 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:18.401 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr 2026-02-24T07:40:18.716 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:06 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:18.782 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:18.801 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:18.801 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:18.801 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:18.823 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T07:40:19.136 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:07 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:19.201 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:19.220 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:19.220 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:19.220 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:19.242 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T07:40:19.559 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:07 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:19.623 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:19.642 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:19.643 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:19.643 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:19.664 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-rook 2026-02-24T07:40:19.982 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:07 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:20.047 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:20.066 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:20.067 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:20.067 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:20.089 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T07:40:20.408 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:08 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:20.474 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:20.492 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:20.493 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:20.493 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:20.514 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-osd 2026-02-24T07:40:20.832 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:08 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:20.898 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:20.917 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:20.918 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:20.918 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:20.939 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-osd-classic 2026-02-24T07:40:21.252 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:09 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:21.317 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:21.336 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:21.336 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:21.337 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:21.358 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-fuse 2026-02-24T07:40:21.676 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:09 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:21.762 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:21.762 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:21.762 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 914 k 2026-02-24T07:40:21.763 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 2.9 M 2026-02-24T07:40:21.764 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:22.274 INFO:teuthology.orchestra.run.trial043.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.7 MB/s | 914 kB 00:00 2026-02-24T07:40:22.274 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:22.274 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.7 MB/s | 914 kB 00:00 2026-02-24T07:40:22.274 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:22.279 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:22.279 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:22.312 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:22.312 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:22.403 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:22.421 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:22.670 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:22.733 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:22.733 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:22.733 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:22.734 INFO:teuthology.orchestra.run.trial043.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:22.734 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:22.734 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:22.762 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-volume 2026-02-24T07:40:23.081 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:11 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:23.145 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:40:23.164 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:23.165 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:23.165 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:23.187 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librados-devel 2026-02-24T07:40:23.507 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:11 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:23.593 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:23.594 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:23.594 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:23.594 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 124 k 2026-02-24T07:40:23.594 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 434 k 2026-02-24T07:40:23.594 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:23.933 INFO:teuthology.orchestra.run.trial043.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 364 kB/s | 124 kB 00:00 2026-02-24T07:40:23.933 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:23.933 INFO:teuthology.orchestra.run.trial043.stdout:Total 363 kB/s | 124 kB 00:00 2026-02-24T07:40:23.934 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:23.936 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:23.936 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:23.968 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:23.969 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:24.024 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:24.041 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:24.130 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:24.194 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:24.194 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:24.195 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:24.195 INFO:teuthology.orchestra.run.trial043.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:24.195 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:24.195 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:24.224 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install libcephfs2 2026-02-24T07:40:24.538 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:24.603 INFO:teuthology.orchestra.run.trial043.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:24.621 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:24.622 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:24.622 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:24.643 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install libcephfs-devel 2026-02-24T07:40:24.958 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:25.043 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 37 k 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 171 k 2026-02-24T07:40:25.044 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:25.202 INFO:teuthology.orchestra.run.trial043.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 234 kB/s | 37 kB 00:00 2026-02-24T07:40:25.204 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:25.204 INFO:teuthology.orchestra.run.trial043.stdout:Total 231 kB/s | 37 kB 00:00 2026-02-24T07:40:25.204 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:25.207 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:25.207 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:25.209 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:25.210 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:25.232 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:25.249 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:25.311 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:25.373 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:25.401 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librados2 2026-02-24T07:40:25.714 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:13 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:25.779 INFO:teuthology.orchestra.run.trial043.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:25.796 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:25.797 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:25.797 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:25.818 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librbd1 2026-02-24T07:40:26.141 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:14 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:26.207 INFO:teuthology.orchestra.run.trial043.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:26.225 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:26.225 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:26.226 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:26.247 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rados 2026-02-24T07:40:26.569 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:14 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:26.634 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:26.652 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:26.653 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:26.653 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:26.674 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rgw 2026-02-24T07:40:26.989 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:14 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:27.055 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:27.074 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:27.075 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:27.075 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:27.096 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-cephfs 2026-02-24T07:40:27.418 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:15 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:27.483 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:27.501 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:27.501 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:27.502 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:27.523 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rbd 2026-02-24T07:40:27.843 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:15 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:27.909 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:27.926 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:27.927 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:27.927 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:27.948 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-fuse 2026-02-24T07:40:28.263 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:16 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T07:40:28.349 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 86 k 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 236 k 2026-02-24T07:40:28.350 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:28.424 INFO:teuthology.orchestra.run.trial043.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2026-02-24T07:40:28.424 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:28.424 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.1 MB/s | 86 kB 00:00 2026-02-24T07:40:28.424 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:28.428 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:28.428 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:28.459 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:28.459 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:28.511 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:28.528 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:28.623 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:28.685 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:28.685 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:28.685 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:28.686 INFO:teuthology.orchestra.run.trial043.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:28.686 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:28.686 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:28.714 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-mirror 2026-02-24T07:40:29.036 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:17 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:29.121 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 2.6 M 2026-02-24T07:40:29.122 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 11 M 2026-02-24T07:40:29.122 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:29.265 INFO:teuthology.orchestra.run.trial043.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 18 MB/s | 2.6 MB 00:00 2026-02-24T07:40:29.265 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:29.265 INFO:teuthology.orchestra.run.trial043.stdout:Total 18 MB/s | 2.6 MB 00:00 2026-02-24T07:40:29.265 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:29.270 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:29.270 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:29.310 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:29.310 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:29.474 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:29.476 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:29.498 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:29.498 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:40:29.499 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T07:40:29.499 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:40:29.499 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:40:29.499 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:29.834 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:29.834 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:29.835 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:29.835 INFO:teuthology.orchestra.run.trial043.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:29.835 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:29.835 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:29.864 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-nbd 2026-02-24T07:40:30.181 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:18 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:30.265 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:30.266 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:30.266 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-24T07:40:30.266 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:30.266 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:30.266 INFO:teuthology.orchestra.run.trial043.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 166 k 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 496 k 2026-02-24T07:40:30.267 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:30.352 INFO:teuthology.orchestra.run.trial043.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.9 MB/s | 166 kB 00:00 2026-02-24T07:40:30.352 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:30.352 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.9 MB/s | 166 kB 00:00 2026-02-24T07:40:30.352 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:30.356 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:30.357 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:30.388 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:30.389 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:30.445 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:40:30.463 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:30.554 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:30.618 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:40:30.618 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:30.618 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:40:30.619 INFO:teuthology.orchestra.run.trial043.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:40:30.619 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:30.619 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:30.650 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-osd-crimson 2026-02-24T07:40:30.971 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:18 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:31.037 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:40:31.055 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:31.055 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-24T07:40:31.056 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:40:31.077 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T07:40:31.394 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:19 ago on Tue 24 Feb 2026 07:39:12 AM UTC. 2026-02-24T07:40:31.478 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-24T07:40:31.478 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:31.478 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-24T07:40:31.478 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout:Installing weak dependencies: 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-24T07:40:31.479 INFO:teuthology.orchestra.run.trial043.stdout:Install 2 Packages 2026-02-24T07:40:31.480 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:40:31.480 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 441 M 2026-02-24T07:40:31.480 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 2.7 G 2026-02-24T07:40:31.480 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-24T07:40:32.067 INFO:teuthology.orchestra.run.trial043.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 20 MB/s | 12 MB 00:00 2026-02-24T07:40:40.657 INFO:teuthology.orchestra.run.trial043.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 47 MB/s | 429 MB 00:09 2026-02-24T07:40:40.659 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:40:40.659 INFO:teuthology.orchestra.run.trial043.stdout:Total 48 MB/s | 441 MB 00:09 2026-02-24T07:40:40.659 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-24T07:40:40.664 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-24T07:40:40.664 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-24T07:40:42.024 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-24T07:40:42.024 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-24T07:40:45.615 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-24T07:41:07.762 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:41:07.781 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:41:09.802 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:41:09.803 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:41:09.867 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:41:09.867 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:41:09.867 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-24T07:41:09.867 INFO:teuthology.orchestra.run.trial043.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:09.867 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:09.868 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:41:09.868 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-24T07:41:09.940 DEBUG:teuthology.parallel:result is None 2026-02-24T07:41:22.532 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 37 kB/s | 20 MB 09:15 2026-02-24T07:41:25.694 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-24T07:41:26.915 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout:Upgrading: 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T07:41:26.917 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T07:41:26.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout:Install 35 Packages 2026-02-24T07:41:26.919 INFO:teuthology.orchestra.run.trial016.stdout:Upgrade 2 Packages 2026-02-24T07:41:26.920 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:26.920 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 61 M 2026-02-24T07:41:26.920 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:41:31.436 INFO:teuthology.orchestra.run.trial016.stdout:(1/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x86 1.2 MB/s | 5.1 MB 00:04 2026-02-24T07:41:31.486 INFO:teuthology.orchestra.run.trial016.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 500 kB/s | 25 kB 00:00 2026-02-24T07:41:31.536 INFO:teuthology.orchestra.run.trial016.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 768 kB/s | 39 kB 00:00 2026-02-24T07:41:31.588 INFO:teuthology.orchestra.run.trial016.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 506 kB/s | 26 kB 00:00 2026-02-24T07:41:32.058 INFO:teuthology.orchestra.run.trial016.stdout:(5/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 1.8 MB/s | 859 kB 00:00 2026-02-24T07:41:32.218 INFO:teuthology.orchestra.run.trial016.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 1.6 MB/s | 263 kB 00:00 2026-02-24T07:41:34.310 INFO:teuthology.orchestra.run.trial016.stdout:(7/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 1.6 MB/s | 11 MB 00:07 2026-02-24T07:41:34.360 INFO:teuthology.orchestra.run.trial016.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 917 kB/s | 45 kB 00:00 2026-02-24T07:41:34.456 INFO:teuthology.orchestra.run.trial016.stdout:(9/37): python3-ceph-common-20.3.0-5440.gff63f3 1.9 MB/s | 186 kB 00:00 2026-02-24T07:41:34.552 INFO:teuthology.orchestra.run.trial016.stdout:(10/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 2.1 MB/s | 204 kB 00:00 2026-02-24T07:41:34.704 INFO:teuthology.orchestra.run.trial016.stdout:(11/37): python3-rados-20.3.0-5440.gff63f3d9.el 2.1 MB/s | 324 kB 00:00 2026-02-24T07:41:34.763 INFO:teuthology.orchestra.run.trial016.stdout:(12/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_ 2.2 MB/s | 5.6 MB 00:02 2026-02-24T07:41:34.815 INFO:teuthology.orchestra.run.trial016.stdout:(13/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 1.9 MB/s | 100 kB 00:00 2026-02-24T07:41:34.851 INFO:teuthology.orchestra.run.trial016.stdout:(14/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 2.0 MB/s | 306 kB 00:00 2026-02-24T07:41:34.864 INFO:teuthology.orchestra.run.trial016.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 669 kB/s | 33 kB 00:00 2026-02-24T07:41:34.883 INFO:teuthology.orchestra.run.trial016.stdout:(16/37): nvme-cli-2.16-1.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-24T07:41:34.889 INFO:teuthology.orchestra.run.trial016.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 3.7 MB/s | 93 kB 00:00 2026-02-24T07:41:35.501 INFO:teuthology.orchestra.run.trial016.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 168 kB/s | 104 kB 00:00 2026-02-24T07:41:35.506 INFO:teuthology.orchestra.run.trial016.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 266 kB/s | 164 kB 00:00 2026-02-24T07:41:35.592 INFO:teuthology.orchestra.run.trial016.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 529 kB/s | 45 kB 00:00 2026-02-24T07:41:35.663 INFO:teuthology.orchestra.run.trial016.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 991 kB/s | 160 kB 00:00 2026-02-24T07:41:35.824 INFO:teuthology.orchestra.run.trial016.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2026-02-24T07:41:35.833 INFO:teuthology.orchestra.run.trial016.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2026-02-24T07:41:35.907 INFO:teuthology.orchestra.run.trial016.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-24T07:41:35.915 INFO:teuthology.orchestra.run.trial016.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 449 kB/s | 37 kB 00:00 2026-02-24T07:41:35.989 INFO:teuthology.orchestra.run.trial016.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 803 kB/s | 66 kB 00:00 2026-02-24T07:41:36.644 INFO:teuthology.orchestra.run.trial016.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 422 kB/s | 308 kB 00:00 2026-02-24T07:41:36.721 INFO:teuthology.orchestra.run.trial016.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 323 kB/s | 25 kB 00:00 2026-02-24T07:41:36.798 INFO:teuthology.orchestra.run.trial016.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 634 kB/s | 49 kB 00:00 2026-02-24T07:41:36.876 INFO:teuthology.orchestra.run.trial016.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 866 kB/s | 67 kB 00:00 2026-02-24T07:41:36.929 INFO:teuthology.orchestra.run.trial016.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2026-02-24T07:41:37.010 INFO:teuthology.orchestra.run.trial016.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 2.3 MB/s | 191 kB 00:00 2026-02-24T07:41:37.030 INFO:teuthology.orchestra.run.trial016.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.3 MB/s | 838 kB 00:00 2026-02-24T07:41:37.105 INFO:teuthology.orchestra.run.trial016.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2026-02-24T07:41:37.359 INFO:teuthology.orchestra.run.trial016.stdout:(35/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 2.0 MB/s | 21 MB 00:10 2026-02-24T07:41:38.407 INFO:teuthology.orchestra.run.trial016.stdout:(36/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 2.1 MB/s | 2.7 MB 00:01 2026-02-24T07:41:41.439 INFO:teuthology.orchestra.run.trial016.stdout:(37/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 763 kB/s | 3.3 MB 00:04 2026-02-24T07:41:41.444 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:41:41.445 INFO:teuthology.orchestra.run.trial016.stdout:Total 4.2 MB/s | 61 MB 00:14 2026-02-24T07:41:41.539 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:41:41.559 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:41:41.559 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:41:41.806 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:41:41.806 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:41:42.100 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:41:42.240 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T07:41:42.243 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:41:42.290 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:41:42.291 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:41:42.302 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:41:42.305 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T07:41:42.305 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:41:42.332 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:41:42.336 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T07:41:42.344 INFO:teuthology.orchestra.run.trial016.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T07:41:42.346 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T07:41:42.349 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T07:41:42.353 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T07:41:42.365 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T07:41:42.377 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:41:42.378 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:41:42.402 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:41:42.405 INFO:teuthology.orchestra.run.trial016.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T07:41:42.438 INFO:teuthology.orchestra.run.trial016.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T07:41:42.443 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T07:41:42.450 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T07:41:42.452 INFO:teuthology.orchestra.run.trial016.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T07:41:42.456 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T07:41:42.570 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:41:42.571 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:41:42.599 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:41:42.603 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T07:41:42.610 INFO:teuthology.orchestra.run.trial016.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T07:41:42.858 INFO:teuthology.orchestra.run.trial016.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T07:41:42.859 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:41:42.875 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:41:42.880 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T07:41:42.884 INFO:teuthology.orchestra.run.trial016.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T07:41:42.887 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T07:41:42.887 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:41:42.905 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:41:43.023 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T07:41:43.025 INFO:teuthology.orchestra.run.trial016.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:41:43.315 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:41:43.315 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T07:41:43.315 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:43.360 INFO:teuthology.orchestra.run.trial016.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T07:41:43.363 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T07:41:44.303 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:41:44.305 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:41:44.565 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:41:44.568 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:41:44.610 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:41:44.610 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T07:41:44.610 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T07:41:44.610 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:44.613 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:41:49.140 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /sys 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /proc 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /mnt 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /var/tmp 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /home 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /root 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /tmp 2026-02-24T07:41:49.141 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:49.632 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:41:49.654 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:41:49.655 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:41:49.655 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T07:41:49.655 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:41:49.655 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:41:49.655 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:49.656 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:41:49.669 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:41:49.669 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:41:49.724 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:41:49.725 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'qat' with GID 992. 2026-02-24T07:41:49.725 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:41:50.029 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T07:41:50.030 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T07:41:50.031 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T07:41:50.032 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T07:41:50.096 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:41:50.096 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:50.096 INFO:teuthology.orchestra.run.trial016.stdout:Upgraded: 2026-02-24T07:41:50.096 INFO:teuthology.orchestra.run.trial016.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T07:41:50.097 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.098 INFO:teuthology.orchestra.run.trial016.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:41:50.099 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:50.100 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:41:50.137 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-test 2026-02-24T07:41:50.454 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:25 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:41:50.541 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:41:50.542 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T07:41:50.543 INFO:teuthology.orchestra.run.trial016.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout:Install 12 Packages 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:41:50.544 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 131 M 2026-02-24T07:41:50.545 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 977 M 2026-02-24T07:41:50.545 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:41:51.146 INFO:teuthology.orchestra.run.trial016.stdout:(1/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 791 kB/s | 153 kB 00:00 2026-02-24T07:41:51.548 INFO:teuthology.orchestra.run.trial016.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 57 kB/s | 23 kB 00:00 2026-02-24T07:41:51.789 INFO:teuthology.orchestra.run.trial016.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 391 kB/s | 94 kB 00:00 2026-02-24T07:41:51.868 INFO:teuthology.orchestra.run.trial016.stdout:(4/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.3 MB/s | 2.1 MB 00:00 2026-02-24T07:41:51.981 INFO:teuthology.orchestra.run.trial016.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 2.7 MB/s | 525 kB 00:00 2026-02-24T07:41:52.012 INFO:teuthology.orchestra.run.trial016.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 7.3 MB/s | 233 kB 00:00 2026-02-24T07:41:52.012 INFO:teuthology.orchestra.run.trial016.stdout:(7/12): libubsan-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 176 kB 00:00 2026-02-24T07:41:52.070 INFO:teuthology.orchestra.run.trial016.stdout:(8/12): protobuf-3.14.0-17.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2026-02-24T07:41:52.072 INFO:teuthology.orchestra.run.trial016.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 5.0 MB/s | 303 kB 00:00 2026-02-24T07:41:52.095 INFO:teuthology.orchestra.run.trial016.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-24T07:41:55.247 INFO:teuthology.orchestra.run.trial016.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 38 kB/s | 122 kB 00:03 2026-02-24T07:41:55.700 INFO:teuthology.orchestra.run.trial016.stdout:(12/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x8 27 MB/s | 126 MB 00:04 2026-02-24T07:41:55.703 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:41:55.703 INFO:teuthology.orchestra.run.trial016.stdout:Total 25 MB/s | 131 MB 00:05 2026-02-24T07:41:55.788 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:41:55.800 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:41:55.800 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:41:56.224 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:41:56.224 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:41:56.676 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:41:56.685 INFO:teuthology.orchestra.run.trial016.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T07:41:56.693 INFO:teuthology.orchestra.run.trial016.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T07:41:56.698 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T07:41:56.704 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T07:41:56.706 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T07:41:56.711 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T07:41:56.711 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:41:56.729 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:41:56.732 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T07:41:56.742 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T07:41:56.750 INFO:teuthology.orchestra.run.trial016.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T07:41:56.751 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:42:03.665 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:42:03.684 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:42:04.480 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:42:04.480 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T07:42:04.480 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T07:42:04.480 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T07:42:04.480 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T07:42:04.481 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T07:42:04.540 INFO:teuthology.orchestra.run.trial016.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:42:04.541 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:42:04.587 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph 2026-02-24T07:42:04.903 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:39 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:42:04.993 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:42:04.996 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-24T07:42:04.996 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-24T07:42:04.996 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-24T07:42:04.996 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T07:42:04.997 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T07:42:04.998 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T07:42:04.999 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T07:42:05.000 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T07:42:05.001 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T07:42:05.002 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T07:42:05.003 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T07:42:05.004 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout:Install 96 Packages 2026-02-24T07:42:05.005 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:42:05.006 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 225 M 2026-02-24T07:42:05.006 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 1.5 G 2026-02-24T07:42:05.006 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:42:05.894 INFO:teuthology.orchestra.run.trial016.stdout:(1/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 101 kB/s | 6.5 kB 00:00 2026-02-24T07:42:05.977 INFO:teuthology.orchestra.run.trial016.stdout:(2/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 6.2 MB/s | 937 kB 00:00 2026-02-24T07:42:05.997 INFO:teuthology.orchestra.run.trial016.stdout:(3/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 12 MB/s | 2.0 MB 00:00 2026-02-24T07:42:06.001 INFO:teuthology.orchestra.run.trial016.stdout:(4/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 6.5 MB/s | 163 kB 00:00 2026-02-24T07:42:06.608 INFO:teuthology.orchestra.run.trial016.stdout:(5/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 6.8 MB/s | 4.9 MB 00:00 2026-02-24T07:42:06.653 INFO:teuthology.orchestra.run.trial016.stdout:(6/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 23 MB/s | 15 MB 00:00 2026-02-24T07:42:06.668 INFO:teuthology.orchestra.run.trial016.stdout:(7/96): ceph-grafana-dashboards-20.3.0-5440.gff 942 kB/s | 57 kB 00:00 2026-02-24T07:42:06.680 INFO:teuthology.orchestra.run.trial016.stdout:(8/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 6.6 MB/s | 184 kB 00:00 2026-02-24T07:42:07.042 INFO:teuthology.orchestra.run.trial016.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 20 MB/s | 7.4 MB 00:00 2026-02-24T07:42:07.072 INFO:teuthology.orchestra.run.trial016.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 739 kB/s | 22 kB 00:00 2026-02-24T07:42:07.113 INFO:teuthology.orchestra.run.trial016.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 7.1 MB/s | 298 kB 00:00 2026-02-24T07:42:07.149 INFO:teuthology.orchestra.run.trial016.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 1.4 MB/s | 50 kB 00:00 2026-02-24T07:42:07.186 INFO:teuthology.orchestra.run.trial016.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 480 kB/s | 17 kB 00:00 2026-02-24T07:42:07.226 INFO:teuthology.orchestra.run.trial016.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 7.3 MB/s | 301 kB 00:00 2026-02-24T07:42:07.280 INFO:teuthology.orchestra.run.trial016.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 19 MB/s | 1.0 MB 00:00 2026-02-24T07:42:08.091 INFO:teuthology.orchestra.run.trial016.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 433 kB/s | 351 kB 00:00 2026-02-24T07:42:08.666 INFO:teuthology.orchestra.run.trial016.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-24T07:42:09.320 INFO:teuthology.orchestra.run.trial016.stdout:(18/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 26 MB/s | 87 MB 00:03 2026-02-24T07:42:09.321 INFO:teuthology.orchestra.run.trial016.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 110 kB/s | 72 kB 00:00 2026-02-24T07:42:10.058 INFO:teuthology.orchestra.run.trial016.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 251 kB/s | 184 kB 00:00 2026-02-24T07:42:10.215 INFO:teuthology.orchestra.run.trial016.stdout:(21/96): libgfortran-11.5.0-14.el9.x86_64.rpm 888 kB/s | 794 kB 00:00 2026-02-24T07:42:10.378 INFO:teuthology.orchestra.run.trial016.stdout:(22/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 14 MB/s | 51 MB 00:03 2026-02-24T07:42:10.835 INFO:teuthology.orchestra.run.trial016.stdout:(23/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 326 kB/s | 253 kB 00:00 2026-02-24T07:42:11.054 INFO:teuthology.orchestra.run.trial016.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2026-02-24T07:42:11.184 INFO:teuthology.orchestra.run.trial016.stdout:(25/96): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-24T07:42:11.542 INFO:teuthology.orchestra.run.trial016.stdout:(26/96): python3-pycparser-2.20-6.el9.noarch.rp 191 kB/s | 135 kB 00:00 2026-02-24T07:42:11.771 INFO:teuthology.orchestra.run.trial016.stdout:(27/96): python3-pyparsing-2.4.7-9.el9.noarch.r 210 kB/s | 150 kB 00:00 2026-02-24T07:42:11.880 INFO:teuthology.orchestra.run.trial016.stdout:(28/96): python3-requests-2.25.1-10.el9.noarch. 182 kB/s | 126 kB 00:00 2026-02-24T07:42:12.300 INFO:teuthology.orchestra.run.trial016.stdout:(29/96): python3-urllib3-1.26.5-7.el9.noarch.rp 288 kB/s | 218 kB 00:00 2026-02-24T07:42:12.507 INFO:teuthology.orchestra.run.trial016.stdout:(30/96): unzip-6.0-59.el9.x86_64.rpm 247 kB/s | 182 kB 00:00 2026-02-24T07:42:12.652 INFO:teuthology.orchestra.run.trial016.stdout:(31/96): zip-3.0-35.el9.x86_64.rpm 344 kB/s | 266 kB 00:00 2026-02-24T07:42:12.745 INFO:teuthology.orchestra.run.trial016.stdout:(32/96): flexiblas-3.0.4-9.el9.x86_64.rpm 67 kB/s | 30 kB 00:00 2026-02-24T07:42:13.070 INFO:teuthology.orchestra.run.trial016.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-9.el9. 35 kB/s | 15 kB 00:00 2026-02-24T07:42:13.077 INFO:teuthology.orchestra.run.trial016.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 742 kB/s | 246 kB 00:00 2026-02-24T07:42:13.274 INFO:teuthology.orchestra.run.trial016.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 214 kB/s | 42 kB 00:00 2026-02-24T07:42:13.325 INFO:teuthology.orchestra.run.trial016.stdout:(36/96): lua-5.4.4-4.el9.x86_64.rpm 741 kB/s | 188 kB 00:00 2026-02-24T07:42:16.349 INFO:teuthology.orchestra.run.trial016.stdout:(37/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 797 kB/s | 3.0 MB 00:03 2026-02-24T07:42:16.683 INFO:teuthology.orchestra.run.trial016.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 733 kB/s | 244 kB 00:00 2026-02-24T07:42:17.016 INFO:teuthology.orchestra.run.trial016.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 747 kB/s | 249 kB 00:00 2026-02-24T07:42:17.115 INFO:teuthology.orchestra.run.trial016.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 479 kB/s | 48 kB 00:00 2026-02-24T07:42:17.370 INFO:teuthology.orchestra.run.trial016.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 694 kB/s | 177 kB 00:00 2026-02-24T07:42:18.793 INFO:teuthology.orchestra.run.trial016.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 880 kB/s | 1.2 MB 00:01 2026-02-24T07:42:18.892 INFO:teuthology.orchestra.run.trial016.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 351 kB/s | 35 kB 00:00 2026-02-24T07:42:19.414 INFO:teuthology.orchestra.run.trial016.stdout:(44/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 881 kB/s | 5.3 MB 00:06 2026-02-24T07:42:19.985 INFO:teuthology.orchestra.run.trial016.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 774 kB/s | 442 kB 00:00 2026-02-24T07:42:20.122 INFO:teuthology.orchestra.run.trial016.stdout:(46/96): python3-babel-2.9.1-2.el9.noarch.rpm 898 kB/s | 6.0 MB 00:06 2026-02-24T07:42:20.163 INFO:teuthology.orchestra.run.trial016.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 433 kB/s | 77 kB 00:00 2026-02-24T07:42:20.420 INFO:teuthology.orchestra.run.trial016.stdout:(48/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 613 kB/s | 157 kB 00:00 2026-02-24T07:42:20.454 INFO:teuthology.orchestra.run.trial016.stdout:(49/96): python3-protobuf-3.14.0-17.el9.noarch. 804 kB/s | 267 kB 00:00 2026-02-24T07:42:20.554 INFO:teuthology.orchestra.run.trial016.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 543 kB/s | 54 kB 00:00 2026-02-24T07:42:20.755 INFO:teuthology.orchestra.run.trial016.stdout:(51/96): python3-pyasn1-modules-0.4.8-7.el9.noa 826 kB/s | 277 kB 00:00 2026-02-24T07:42:20.855 INFO:teuthology.orchestra.run.trial016.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 418 kB/s | 42 kB 00:00 2026-02-24T07:42:21.111 INFO:teuthology.orchestra.run.trial016.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 737 kB/s | 189 kB 00:00 2026-02-24T07:42:21.289 INFO:teuthology.orchestra.run.trial016.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 509 kB/s | 90 kB 00:00 2026-02-24T07:42:21.388 INFO:teuthology.orchestra.run.trial016.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2026-02-24T07:42:22.430 INFO:teuthology.orchestra.run.trial016.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 828 kB/s | 862 kB 00:01 2026-02-24T07:42:25.149 INFO:teuthology.orchestra.run.trial016.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 203 kB/s | 551 kB 00:02 2026-02-24T07:42:25.477 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 500 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:42:25.921 INFO:teuthology.orchestra.run.trial016.stdout:(58/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 893 kB/s | 6.1 MB 00:07 2026-02-24T07:42:26.780 INFO:teuthology.orchestra.run.trial016.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 12 kB/s | 19 kB 00:01 2026-02-24T07:42:29.594 INFO:teuthology.orchestra.run.trial016.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 195 kB/s | 548 kB 00:02 2026-02-24T07:42:30.077 INFO:teuthology.orchestra.run.trial016.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 61 kB/s | 29 kB 00:00 2026-02-24T07:42:30.115 INFO:teuthology.orchestra.run.trial016.stdout:(62/96): luarocks-3.9.2-5.el9.noarch.rpm 36 kB/s | 151 kB 00:04 2026-02-24T07:42:30.587 INFO:teuthology.orchestra.run.trial016.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 118 kB/s | 60 kB 00:00 2026-02-24T07:42:30.740 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:42:31.024 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:42:31.214 INFO:teuthology.orchestra.run.trial016.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 51 kB/s | 32 kB 00:00 2026-02-24T07:42:31.292 INFO:teuthology.orchestra.run.trial016.stdout:(65/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 37 kB/s | 43 kB 00:01 2026-02-24T07:42:31.805 INFO:teuthology.orchestra.run.trial016.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 24 kB/s | 14 kB 00:00 2026-02-24T07:42:33.215 INFO:teuthology.orchestra.run.trial016.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 90 kB/s | 173 kB 00:01 2026-02-24T07:42:36.527 INFO:teuthology.orchestra.run.trial016.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 77 kB/s | 254 kB 00:03 2026-02-24T07:42:37.719 INFO:teuthology.orchestra.run.trial016.stdout:(69/96): python3-cherrypy-18.6.1-2.el9.noarch.r 61 kB/s | 358 kB 00:05 2026-02-24T07:42:42.442 INFO:teuthology.orchestra.run.trial016.stdout:(70/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 901 kB/s | 19 MB 00:21 2026-02-24T07:42:44.298 INFO:teuthology.orchestra.run.trial016.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 22 kB/s | 144 kB 00:06 2026-02-24T07:42:44.398 INFO:teuthology.orchestra.run.trial016.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 71 kB/s | 139 kB 00:01 2026-02-24T07:42:44.751 INFO:teuthology.orchestra.run.trial016.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 30 kB/s | 11 kB 00:00 2026-02-24T07:42:45.258 INFO:teuthology.orchestra.run.trial016.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 35 kB/s | 18 kB 00:00 2026-02-24T07:42:45.660 INFO:teuthology.orchestra.run.trial016.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 58 kB/s | 23 kB 00:00 2026-02-24T07:42:45.939 INFO:teuthology.orchestra.run.trial016.stdout:(76/96): python3-isodate-0.6.1-3.el9.noarch.rpm 34 kB/s | 56 kB 00:01 2026-02-24T07:42:46.297 INFO:teuthology.orchestra.run.trial016.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 31 kB/s | 20 kB 00:00 2026-02-24T07:42:46.676 INFO:teuthology.orchestra.run.trial016.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 26 kB/s | 19 kB 00:00 2026-02-24T07:42:46.910 INFO:teuthology.orchestra.run.trial016.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 43 kB/s | 26 kB 00:00 2026-02-24T07:42:48.137 INFO:teuthology.orchestra.run.trial016.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 64 kB/s | 79 kB 00:01 2026-02-24T07:42:49.514 INFO:teuthology.orchestra.run.trial016.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 63 kB/s | 86 kB 00:01 2026-02-24T07:42:50.461 INFO:teuthology.orchestra.run.trial016.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 61 kB/s | 58 kB 00:00 2026-02-24T07:42:50.946 INFO:teuthology.orchestra.run.trial016.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 34 kB/s | 16 kB 00:00 2026-02-24T07:42:52.340 INFO:teuthology.orchestra.run.trial016.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 65 kB/s | 90 kB 00:01 2026-02-24T07:42:52.481 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] python3-repoze-lru-0.7-16.el9.noarch.rpm: Status code: 500 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-repoze-lru-0.7-16.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:42:54.058 INFO:teuthology.orchestra.run.trial016.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 18 kB/s | 31 kB 00:01 2026-02-24T07:42:58.063 INFO:teuthology.orchestra.run.trial016.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 47 kB/s | 188 kB 00:04 2026-02-24T07:42:59.303 INFO:teuthology.orchestra.run.trial016.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 48 kB/s | 59 kB 00:01 2026-02-24T07:43:00.520 INFO:teuthology.orchestra.run.trial016.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 103 kB/s | 125 kB 00:01 2026-02-24T07:43:06.524 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] python3-tempora-5.0.0-2.el9.noarch.rpm: Status code: 500 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-tempora-5.0.0-2.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:43:07.654 INFO:teuthology.orchestra.run.trial016.stdout:[MIRROR] python3-tempora-5.0.0-2.el9.noarch.rpm: Status code: 500 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-tempora-5.0.0-2.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:43:07.836 INFO:teuthology.orchestra.run.trial016.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 4.9 kB/s | 36 kB 00:07 2026-02-24T07:43:10.185 INFO:teuthology.orchestra.run.trial016.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 37 kB/s | 86 kB 00:02 2026-02-24T07:43:11.335 INFO:teuthology.orchestra.run.trial016.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 78 kB/s | 90 kB 00:01 2026-02-24T07:43:11.974 INFO:teuthology.orchestra.run.trial016.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 76 kB/s | 48 kB 00:00 2026-02-24T07:43:12.762 INFO:teuthology.orchestra.run.trial016.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 28 kB/s | 22 kB 00:00 2026-02-24T07:43:13.184 INFO:teuthology.orchestra.run.trial016.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 47 kB/s | 20 kB 00:00 2026-02-24T07:43:14.627 INFO:teuthology.orchestra.run.trial016.stdout:(95/96): python3-kubernetes-26.1.0-3.el9.noarch 37 kB/s | 1.0 MB 00:27 2026-02-24T07:44:06.728 INFO:teuthology.orchestra.run.trial016.stdout:(96/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 23 kB/s | 2.0 MB 01:30 2026-02-24T07:44:06.732 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:06.733 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.8 MB/s | 225 MB 02:01 2026-02-24T07:44:07.113 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:07.155 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:07.155 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:07.955 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:07.955 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:08.781 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:08.783 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T07:44:08.787 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T07:44:08.808 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T07:44:08.842 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T07:44:08.849 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T07:44:08.851 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T07:44:08.855 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T07:44:08.879 INFO:teuthology.orchestra.run.trial016.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T07:44:08.892 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T07:44:08.895 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T07:44:08.901 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T07:44:08.902 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T07:44:08.914 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T07:44:08.920 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T07:44:08.944 INFO:teuthology.orchestra.run.trial016.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T07:44:08.947 INFO:teuthology.orchestra.run.trial016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T07:44:08.999 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T07:44:09.012 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T07:44:09.014 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T07:44:09.018 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T07:44:09.024 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T07:44:09.028 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T07:44:09.032 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T07:44:09.046 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T07:44:09.050 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T07:44:09.056 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T07:44:09.067 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T07:44:09.076 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T07:44:09.082 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T07:44:09.102 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T07:44:09.113 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T07:44:09.129 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T07:44:09.133 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T07:44:09.141 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T07:44:09.182 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T07:44:09.506 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T07:44:09.516 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T07:44:09.520 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T07:44:09.526 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T07:44:09.528 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T07:44:09.555 INFO:teuthology.orchestra.run.trial016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T07:44:09.600 INFO:teuthology.orchestra.run.trial016.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T07:44:09.608 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T07:44:09.614 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T07:44:09.617 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T07:44:09.623 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T07:44:09.627 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T07:44:09.633 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T07:44:09.637 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T07:44:09.665 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T07:44:09.675 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T07:44:09.681 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T07:44:09.688 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T07:44:09.722 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T07:44:09.947 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T07:44:09.971 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T07:44:09.975 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T07:44:10.033 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T07:44:10.035 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T07:44:10.057 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T07:44:10.385 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T07:44:10.459 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T07:44:11.130 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T07:44:11.147 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T07:44:11.158 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T07:44:11.164 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T07:44:11.178 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T07:44:11.194 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T07:44:11.270 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T07:44:11.278 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T07:44:11.301 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T07:44:11.331 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T07:44:11.382 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T07:44:11.388 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T07:44:11.393 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T07:44:11.395 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T07:44:11.413 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:44:11.414 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T07:44:11.414 INFO:teuthology.orchestra.run.trial016.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T07:44:11.414 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:11.420 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:44:11.446 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:44:11.446 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T07:44:11.446 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:11.483 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T07:44:12.083 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T07:44:17.513 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T07:44:17.578 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T07:44:17.580 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:44:17.595 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:44:17.595 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:17.595 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T07:44:17.595 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:17.607 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:44:17.630 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:44:17.631 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:17.631 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T07:44:17.631 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:44:17.631 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:44:17.631 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:17.688 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:44:17.690 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:44:17.699 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T07:44:17.723 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T07:44:17.724 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:44:20.667 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:44:20.674 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:44:21.133 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:44:21.133 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:44:21.145 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:44:21.145 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:44:21.206 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:44:21.247 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T07:44:21.248 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:44:21.269 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:21.282 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:44:21.500 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:44:21.501 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:44:21.521 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:44:21.521 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:21.521 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T07:44:21.521 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:44:21.522 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:44:21.522 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:21.605 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:44:21.625 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:21.626 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:44:21.632 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:44:21.656 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:44:23.072 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T07:44:23.073 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T07:44:23.074 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T07:44:23.075 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T07:44:23.076 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T07:44:23.077 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T07:44:23.078 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T07:44:23.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T07:44:23.080 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T07:44:23.081 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.142 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.143 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T07:44:23.144 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T07:44:23.145 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T07:44:23.146 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T07:44:23.147 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T07:44:23.148 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T07:44:23.149 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T07:44:23.150 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T07:44:23.151 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T07:44:23.152 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T07:44:23.153 INFO:teuthology.orchestra.run.trial016.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T07:44:23.154 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T07:44:23.154 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T07:44:23.154 INFO:teuthology.orchestra.run.trial016.stdout: zip-3.0-35.el9.x86_64 2026-02-24T07:44:23.154 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:23.154 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:23.210 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-base 2026-02-24T07:44:23.528 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:58 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:23.595 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:23.613 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:23.614 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:23.614 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:23.635 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install cephadm 2026-02-24T07:44:23.950 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:58 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:24.017 INFO:teuthology.orchestra.run.trial016.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:24.036 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:24.036 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:24.036 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:24.057 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T07:44:24.380 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:59 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:24.465 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:24.465 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:24.465 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:24.465 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 149 k 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 455 k 2026-02-24T07:44:24.466 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:24.853 INFO:teuthology.orchestra.run.trial016.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 386 kB/s | 149 kB 00:00 2026-02-24T07:44:24.853 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:24.853 INFO:teuthology.orchestra.run.trial016.stdout:Total 385 kB/s | 149 kB 00:00 2026-02-24T07:44:24.853 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:24.858 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:24.858 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:24.889 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:24.889 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:24.946 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:24.947 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:44:24.970 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:44:24.970 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:24.970 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T07:44:24.970 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:25.306 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:25.334 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr 2026-02-24T07:44:25.654 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:00 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:25.720 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:25.739 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:25.740 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:25.740 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:25.761 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T07:44:26.073 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:01 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:26.140 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:26.159 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:26.159 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:26.160 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:26.181 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T07:44:26.500 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:01 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:26.566 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:26.584 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:26.585 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:26.585 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:26.605 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-rook 2026-02-24T07:44:26.921 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:01 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:26.987 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:27.006 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:27.007 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:27.007 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:27.027 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T07:44:27.346 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:02 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:27.413 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:27.432 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:27.432 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:27.432 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:27.453 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd 2026-02-24T07:44:27.766 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:02 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:27.834 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:27.852 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:27.853 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:27.853 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:27.874 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-classic 2026-02-24T07:44:28.194 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:03 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:28.262 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:28.280 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:28.281 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:28.281 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:28.302 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-fuse 2026-02-24T07:44:28.622 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:03 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:28.709 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:28.709 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:28.709 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 914 k 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 2.9 M 2026-02-24T07:44:28.710 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:29.222 INFO:teuthology.orchestra.run.trial016.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.7 MB/s | 914 kB 00:00 2026-02-24T07:44:29.224 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:29.224 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.7 MB/s | 914 kB 00:00 2026-02-24T07:44:29.224 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:29.230 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:29.230 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:29.264 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:29.264 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:29.354 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:29.371 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:29.604 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:29.667 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:29.697 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-volume 2026-02-24T07:44:30.025 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:05 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:30.092 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:44:30.111 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:30.111 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:30.111 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:30.133 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados-devel 2026-02-24T07:44:30.452 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:05 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:30.538 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:30.538 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:30.539 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:30.539 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:30.539 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:30.539 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T07:44:30.539 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 124 k 2026-02-24T07:44:30.540 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 434 k 2026-02-24T07:44:30.541 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:30.624 INFO:teuthology.orchestra.run.trial016.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 1.4 MB/s | 124 kB 00:00 2026-02-24T07:44:30.625 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:30.625 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.4 MB/s | 124 kB 00:00 2026-02-24T07:44:30.625 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:30.627 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:30.627 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:30.659 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:30.659 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:30.714 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:30.731 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:30.819 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:30.883 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:30.883 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:30.883 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:30.884 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:30.884 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:30.884 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:30.912 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs2 2026-02-24T07:44:31.234 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:06 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:31.300 INFO:teuthology.orchestra.run.trial016.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:31.319 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:31.319 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:31.319 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:31.341 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs-devel 2026-02-24T07:44:31.662 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:06 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:31.749 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 37 k 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 171 k 2026-02-24T07:44:31.750 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:31.815 INFO:teuthology.orchestra.run.trial016.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 577 kB/s | 37 kB 00:00 2026-02-24T07:44:31.816 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:31.816 INFO:teuthology.orchestra.run.trial016.stdout:Total 571 kB/s | 37 kB 00:00 2026-02-24T07:44:31.816 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:31.817 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:31.817 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:31.820 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:31.820 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:31.842 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:31.860 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:31.919 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:31.982 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:32.011 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados2 2026-02-24T07:44:32.326 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:32.393 INFO:teuthology.orchestra.run.trial016.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:32.411 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:32.412 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:32.412 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:32.433 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librbd1 2026-02-24T07:44:32.748 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:32.815 INFO:teuthology.orchestra.run.trial016.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:32.833 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:32.833 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:32.834 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:32.855 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rados 2026-02-24T07:44:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:08 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:33.233 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:33.250 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:33.251 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:33.251 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:33.271 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rgw 2026-02-24T07:44:33.592 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:08 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:33.659 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:33.677 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:33.678 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:33.678 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:33.699 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-cephfs 2026-02-24T07:44:34.018 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:09 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:34.086 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:34.103 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:34.104 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:34.104 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:34.125 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rbd 2026-02-24T07:44:34.442 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:09 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:34.511 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:34.528 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:34.529 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:34.529 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:34.550 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-fuse 2026-02-24T07:44:34.865 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:09 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:34.950 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:34.951 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:34.952 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:34.952 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:34.952 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 86 k 2026-02-24T07:44:34.952 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 236 k 2026-02-24T07:44:34.952 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:35.059 INFO:teuthology.orchestra.run.trial016.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 800 kB/s | 86 kB 00:00 2026-02-24T07:44:35.059 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:35.060 INFO:teuthology.orchestra.run.trial016.stdout:Total 792 kB/s | 86 kB 00:00 2026-02-24T07:44:35.060 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:35.063 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:35.064 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:35.094 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:35.094 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:35.147 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:35.164 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:35.251 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:35.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:35.315 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:35.316 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:35.316 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:35.316 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:35.316 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:35.345 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-mirror 2026-02-24T07:44:35.669 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:10 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 2.6 M 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 11 M 2026-02-24T07:44:35.754 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:35.896 INFO:teuthology.orchestra.run.trial016.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 18 MB/s | 2.6 MB 00:00 2026-02-24T07:44:35.897 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:35.897 INFO:teuthology.orchestra.run.trial016.stdout:Total 18 MB/s | 2.6 MB 00:00 2026-02-24T07:44:35.897 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:35.902 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:35.902 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:35.941 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:35.942 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:36.105 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:36.107 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:36.131 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:36.131 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:44:36.132 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T07:44:36.132 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:44:36.132 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:44:36.132 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:36.471 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:36.498 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-nbd 2026-02-24T07:44:36.815 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:11 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:36.900 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:36.901 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-24T07:44:36.902 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:36.902 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 166 k 2026-02-24T07:44:36.902 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 496 k 2026-02-24T07:44:36.902 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:36.987 INFO:teuthology.orchestra.run.trial016.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.9 MB/s | 166 kB 00:00 2026-02-24T07:44:36.987 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:36.987 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.9 MB/s | 166 kB 00:00 2026-02-24T07:44:36.987 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:36.992 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:36.992 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:37.023 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:37.023 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:37.080 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:44:37.097 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:37.188 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:37.251 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:44:37.252 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:37.252 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:44:37.252 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:44:37.252 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:37.252 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:37.282 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-crimson 2026-02-24T07:44:37.605 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:12 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:37.671 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:44:37.689 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:37.690 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-24T07:44:37.690 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:44:37.711 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T07:44:38.035 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:03:13 ago on Tue 24 Feb 2026 07:41:25 AM UTC. 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-24T07:44:38.121 INFO:teuthology.orchestra.run.trial016.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:Install 2 Packages 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 441 M 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 2.7 G 2026-02-24T07:44:38.122 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-24T07:44:38.567 INFO:teuthology.orchestra.run.trial016.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 27 MB/s | 12 MB 00:00 2026-02-24T07:44:50.036 INFO:teuthology.orchestra.run.trial016.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 36 MB/s | 429 MB 00:11 2026-02-24T07:44:50.037 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:44:50.038 INFO:teuthology.orchestra.run.trial016.stdout:Total 37 MB/s | 441 MB 00:11 2026-02-24T07:44:50.038 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-24T07:44:50.043 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-24T07:44:50.043 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-24T07:44:51.408 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-24T07:44:51.408 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-24T07:44:55.005 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-24T07:45:17.143 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:45:17.162 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:45:19.180 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:45:19.180 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:45:19.244 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:45:19.244 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:19.245 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-24T07:45:19.245 INFO:teuthology.orchestra.run.trial016.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:45:19.245 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:45:19.245 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:19.245 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-24T07:45:19.317 DEBUG:teuthology.parallel:result is None 2026-02-24T07:45:19.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:19.478 DEBUG:teuthology.orchestra.run.trial016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T07:45:19.499 INFO:teuthology.orchestra.run.trial016.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T07:45:19.499 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T07:45:19.500 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T07:45:19.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:19.657 DEBUG:teuthology.orchestra.run.trial043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T07:45:19.690 INFO:teuthology.orchestra.run.trial043.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T07:45:19.690 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T07:45:19.690 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T07:45:19.694 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T07:45:19.694 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:19.695 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T07:45:19.721 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:19.721 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T07:45:19.756 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T07:45:19.756 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:19.757 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T07:45:19.786 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T07:45:19.850 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:19.851 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T07:45:19.877 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T07:45:19.941 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T07:45:19.941 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:19.941 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T07:45:19.967 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T07:45:20.031 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:20.031 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T07:45:20.056 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T07:45:20.120 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T07:45:20.120 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:20.120 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T07:45:20.145 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T07:45:20.209 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:20.210 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T07:45:20.234 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T07:45:20.297 INFO:teuthology.run_tasks:Running task pexec... 2026-02-24T07:45:20.312 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-24T07:45:20.312 DEBUG:teuthology.orchestra.run.trial016:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T07:45:20.313 DEBUG:teuthology.orchestra.run.trial043:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T07:45:20.316 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial016.front.sepia.ceph.com 2026-02-24T07:45:20.316 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T07:45:20.340 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial043.front.sepia.ceph.com 2026-02-24T07:45:20.340 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T07:45:20.366 DEBUG:teuthology.parallel:result is None 2026-02-24T07:45:20.390 DEBUG:teuthology.parallel:result is None 2026-02-24T07:45:20.390 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T07:45:20.517 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug osd': 10}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'osd_type': 'crimson', 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T07:45:20.517 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:20.519 INFO:tasks.cephadm:Cluster fsid is c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:20.519 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T07:45:20.519 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.16'} 2026-02-24T07:45:20.519 INFO:tasks.cephadm:First mon is mon.a on trial016 2026-02-24T07:45:20.519 INFO:tasks.cephadm:First mgr is x 2026-02-24T07:45:20.519 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T07:45:20.519 DEBUG:teuthology.orchestra.run.trial016:> sudo hostname $(hostname -s) 2026-02-24T07:45:20.544 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname $(hostname -s) 2026-02-24T07:45:20.569 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T07:45:20.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:20.706 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'ref': 'wip-shraddhaag-enable-cephadm-tests', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-24 05:52:36.050311', 'status': 'ready', 'flavor': 'debug', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.3.0-5440-gff63f3d9', 'package_manager_version': '20.3.0-5440.gff63f3d9', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3219/', 'root_build_cause': '', 'node_name': '10.20.192.97+toko07', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T07:45:20.841 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-shraddhaag-enable-cephadm-tests, sha1 ff63f3d997e38f69382fd23ac0206f07f7b05017 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=debug&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:20.842 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T07:45:20.843 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T07:45:20.843 DEBUG:teuthology.orchestra.run.trial016:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.156 INFO:teuthology.orchestra.run.trial016.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 07:45 /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.157 DEBUG:teuthology.orchestra.run.trial043:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.474 INFO:teuthology.orchestra.run.trial043.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 07:45 /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.474 DEBUG:teuthology.orchestra.run.trial016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.493 DEBUG:teuthology.orchestra.run.trial043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T07:45:21.528 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 on all hosts... 2026-02-24T07:45:21.529 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T07:45:21.536 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T07:45:21.674 INFO:teuthology.orchestra.run.trial016.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:45:21.689 INFO:teuthology.orchestra.run.trial043.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:45:31.450 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout: "repo_digests": [ 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-24T07:45:31.451 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout:{ 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout: "repo_digests": [ 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout: ] 2026-02-24T07:45:31.490 INFO:teuthology.orchestra.run.trial016.stdout:} 2026-02-24T07:45:31.506 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /etc/ceph 2026-02-24T07:45:31.570 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /etc/ceph 2026-02-24T07:45:31.599 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 777 /etc/ceph 2026-02-24T07:45:31.628 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 777 /etc/ceph 2026-02-24T07:45:31.663 INFO:tasks.cephadm:Writing seed config... 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [mgr] debug osd = 10 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2026-02-24T07:45:31.666 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] crimson_allow_pg_split = False 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] enable experimental unrecoverable data corrupting features = crimson 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms client mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms cluster mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms mon client mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms mon cluster mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms mon service mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] ms service mode = crc 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] osd_max_pg_log_entries = 2 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] osd_min_pg_log_entries = 1 2026-02-24T07:45:31.667 INFO:tasks.cephadm: override: [global] osd_pg_log_trim_min = 0 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 3 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] osd pool default crimson = True 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [osd] crimson cpu num = 4 2026-02-24T07:45:31.668 INFO:tasks.cephadm: override: [osd] crimson osd obc lru size = 10 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug ms = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore backref = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore cache = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore cleaner = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore device = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore epm = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore fixedkv tree = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore journal = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore lba = 20 2026-02-24T07:45:31.669 INFO:tasks.cephadm: override: [osd] debug seastore odata = 20 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] debug seastore omap = 20 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] debug seastore onode = 20 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] debug seastore t = 20 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] debug seastore tm = 20 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd blocked scrub grace period = 3600 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd max markdown count = 1000 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd objectstore = seastore 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2026-02-24T07:45:31.670 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-24T07:45:31.671 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2026-02-24T07:45:31.671 INFO:tasks.cephadm: override: [osd] seastore cachepin size pershard = 64M 2026-02-24T07:45:31.671 INFO:tasks.cephadm: override: [osd] seastore cachepin type = 2Q 2026-02-24T07:45:31.671 INFO:tasks.cephadm: override: [osd] seastore max concurrent transactions = 8 2026-02-24T07:45:31.672 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:31.672 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T07:45:31.689 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c4ff2ae8-1154-11f1-bd55-d404e6e7d460 crimson_allow_pg_split = False enable experimental unrecoverable data corrupting features = crimson ms client mode = crc ms cluster mode = crc ms mon client mode = crc ms mon cluster mode = crc ms mon service mode = crc ms service mode = crc osd_max_pg_log_entries = 2 osd_min_pg_log_entries = 1 osd_pg_log_trim_min = 0 osd_pool_default_min_size = 2 osd_pool_default_size = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true crimson cpu num = 4 crimson osd obc lru size = 10 debug ms = 20 debug osd = 20 debug seastore = 20 debug seastore backref = 20 debug seastore cache = 20 debug seastore cleaner = 20 debug seastore device = 20 debug seastore epm = 20 debug seastore fixedkv tree = 20 debug seastore journal = 20 debug seastore lba = 20 debug seastore odata = 20 debug seastore omap = 20 debug seastore onode = 20 debug seastore t = 20 debug seastore tm = 20 osd blocked scrub grace period = 3600 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd max markdown count = 1000 osd objectstore = seastore osd scrub min interval = 60 osd snap trim sleep = 2 seastore cachepin size pershard = 64M seastore cachepin type = 2Q seastore max concurrent transactions = 8 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 debug osd = 10 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 osd pool default crimson = True paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2026-02-24T07:45:31.689 DEBUG:teuthology.orchestra.run.trial016:mon.a> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service 2026-02-24T07:45:31.734 DEBUG:teuthology.orchestra.run.trial016:mgr.x> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x.service 2026-02-24T07:45:31.777 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T07:45:31.778 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 -v bootstrap --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:45:31.917 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:45:31.917 INFO:teuthology.orchestra.run.trial016.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017', '-v', 'bootstrap', '--fsid', 'c4ff2ae8-1154-11f1-bd55-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.16', '--skip-admin-label'] 2026-02-24T07:45:31.918 INFO:teuthology.orchestra.run.trial016.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T07:45:31.918 INFO:teuthology.orchestra.run.trial016.stdout:Verifying podman|docker is present... 2026-02-24T07:45:31.932 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout 5.8.0 2026-02-24T07:45:31.932 INFO:teuthology.orchestra.run.trial016.stdout:Verifying lvm2 is present... 2026-02-24T07:45:31.932 INFO:teuthology.orchestra.run.trial016.stdout:Verifying time synchronization is in place... 2026-02-24T07:45:31.938 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T07:45:31.938 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T07:45:31.944 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T07:45:31.944 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:31.950 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout enabled 2026-02-24T07:45:31.955 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout active 2026-02-24T07:45:31.955 INFO:teuthology.orchestra.run.trial016.stdout:Unit chronyd.service is enabled and running 2026-02-24T07:45:31.955 INFO:teuthology.orchestra.run.trial016.stdout:Repeating the final host check... 2026-02-24T07:45:31.970 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout 5.8.0 2026-02-24T07:45:31.970 INFO:teuthology.orchestra.run.trial016.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T07:45:31.970 INFO:teuthology.orchestra.run.trial016.stdout:systemctl is present 2026-02-24T07:45:31.970 INFO:teuthology.orchestra.run.trial016.stdout:lvcreate is present 2026-02-24T07:45:31.975 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T07:45:31.975 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T07:45:31.980 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T07:45:31.980 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:31.986 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout enabled 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout active 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Unit chronyd.service is enabled and running 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Host looks OK 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Cluster fsid: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Acquiring lock 139657686437264 on /run/cephadm/c4ff2ae8-1154-11f1-bd55-d404e6e7d460.lock 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Lock 139657686437264 acquired on /run/cephadm/c4ff2ae8-1154-11f1-bd55-d404e6e7d460.lock 2026-02-24T07:45:31.993 INFO:teuthology.orchestra.run.trial016.stdout:Verifying IP 10.20.193.16 port 3300 ... 2026-02-24T07:45:31.994 INFO:teuthology.orchestra.run.trial016.stdout:Verifying IP 10.20.193.16 port 6789 ... 2026-02-24T07:45:31.994 INFO:teuthology.orchestra.run.trial016.stdout:Base mon IP(s) is [10.20.193.16:3300, 10.20.193.16:6789], mon addrv is [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-24T07:45:31.996 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.16 metric 102 2026-02-24T07:45:31.996 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.16 metric 102 2026-02-24T07:45:31.996 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T07:45:31.999 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T07:45:31.999 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-24T07:45:31.999 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 fe80::96b4:5f34:6b8d:b6b0/64 scope link noprefixroute 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6004/64 scope link 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:45:32.003 INFO:teuthology.orchestra.run.trial016.stdout:Mon IP `10.20.193.16` is in CIDR network `10.20.192.0/20` 2026-02-24T07:45:32.004 INFO:teuthology.orchestra.run.trial016.stdout:Mon IP `10.20.193.16` is in CIDR network `10.20.192.0/20` 2026-02-24T07:45:32.004 INFO:teuthology.orchestra.run.trial016.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T07:45:32.004 INFO:teuthology.orchestra.run.trial016.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T07:45:32.004 INFO:teuthology.orchestra.run.trial016.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:45:32.270 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying blob sha256:34ff0ae581cc4b523b1cc31578790f86bdcdd88215c5534f4c04451410e82346 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying config sha256:3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T07:45:32.271 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T07:45:32.380 INFO:teuthology.orchestra.run.trial016.stdout:ceph: stdout ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T07:45:32.381 INFO:teuthology.orchestra.run.trial016.stdout:Ceph version: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T07:45:32.381 INFO:teuthology.orchestra.run.trial016.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T07:45:32.444 INFO:teuthology.orchestra.run.trial016.stdout:stat: stdout 167 167 2026-02-24T07:45:32.445 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial keys... 2026-02-24T07:45:32.574 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAcV51pK4p1IRAAM/tyflvmkS9vG6nSBi4llg== 2026-02-24T07:45:32.705 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAcV51pXpk9KRAAoRuKL9+O22cTFSlT5IADbw== 2026-02-24T07:45:32.834 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAcV51p85H8MBAAH4EQQwHnwXINDKUgUaep5Q== 2026-02-24T07:45:32.834 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial monmap... 2026-02-24T07:45:32.979 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T07:45:32.979 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-24T07:45:32.979 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool for a [v2:10.20.193.16:3300,v1:10.20.193.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:setting min_mon_release = tentacle 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: set fsid to c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:32.980 INFO:teuthology.orchestra.run.trial016.stdout:Creating mon... 2026-02-24T07:45:33.128 INFO:teuthology.orchestra.run.trial016.stdout:create mon.a on 2026-02-24T07:45:33.297 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T07:45:33.405 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T07:45:33.514 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target → /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target. 2026-02-24T07:45:33.514 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target → /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target. 2026-02-24T07:45:33.638 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a 2026-02-24T07:45:33.638 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service: Unit ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service not loaded. 2026-02-24T07:45:33.758 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target.wants/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@.service. 2026-02-24T07:45:33.902 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:45:33.903 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-24T07:45:33.903 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 systemd[1]: Started Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:45:33.909 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:45:33.909 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:33.910 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-24T07:45:33.910 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T07:45:33.910 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon to start... 2026-02-24T07:45:33.910 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon... 2026-02-24T07:45:34.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T07:45:34.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout id: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:34.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T07:45:34.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout services: 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.133036s) [leader: a] 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout data: 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T07:45:34.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.006+0000 7fc7fbb85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.010+0000 7fc7fbb85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:mon is available 2026-02-24T07:45:34.067 INFO:teuthology.orchestra.run.trial016.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T07:45:34.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39096]: 2026-02-24T07:45:33.901+0000 7f9bf82d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39096]: 2026-02-24T07:45:33.901+0000 7f9bf82d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39096]: 2026-02-24T07:45:33.901+0000 7f9bf82d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 ceph-mon[39100]: mkfs c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:34.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:33 trial016 ceph-mon[39100]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T07:45:34.231 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout fsid = c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T07:45:34.232 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T07:45:34.233 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T07:45:34.233 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.151+0000 7f7455298640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.233 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.154+0000 7f7455298640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.233 INFO:teuthology.orchestra.run.trial016.stdout:Generating new minimal ceph.conf... 2026-02-24T07:45:34.392 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.323+0000 7f6d4a8d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.392 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.326+0000 7f6d4a8d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.392 INFO:teuthology.orchestra.run.trial016.stdout:Restarting the monitor... 2026-02-24T07:45:34.719 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 systemd[1]: Stopping Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39096]: 2026-02-24T07:45:34.467+0000 7f9bf6948640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39096]: 2026-02-24T07:45:34.467+0000 7f9bf6948640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39391]: 2026-02-24 07:45:34.558937704 +0000 UTC m=+0.103454959 container died a0c76b425d93661ad2f42f373a309454371e9f02a8299e3a7f38d6b856155047 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39391]: 2026-02-24 07:45:34.566270223 +0000 UTC m=+0.110787488 container remove a0c76b425d93661ad2f42f373a309454371e9f02a8299e3a7f38d6b856155047 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 bash[39391]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T07:45:34.720 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 systemd[1]: Stopped Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:45:34.721 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 systemd[1]: Starting Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T07:45:34.751 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon to start after restart... 2026-02-24T07:45:34.751 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon... 2026-02-24T07:45:34.904 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout id: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout services: 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.11438s) [leader: a] 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout data: 2026-02-24T07:45:34.905 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.847+0000 7fea87972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.852+0000 7fea87972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:mon is available 2026-02-24T07:45:34.906 INFO:teuthology.orchestra.run.trial016.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39517]: 2026-02-24 07:45:34.718451192 +0000 UTC m=+0.015452941 container create fa83df801aba1f547f98c77def38c44c839a9b758d1708d52ec9a8a19bbb8547 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS) 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39517]: 2026-02-24 07:45:34.743675626 +0000 UTC m=+0.040677375 container init fa83df801aba1f547f98c77def38c44c839a9b758d1708d52ec9a8a19bbb8547 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.schema-version=1.0) 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39517]: 2026-02-24 07:45:34.746393016 +0000 UTC m=+0.043394755 container start fa83df801aba1f547f98c77def38c44c839a9b758d1708d52ec9a8a19bbb8547 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7) 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 bash[39517]: fa83df801aba1f547f98c77def38c44c839a9b758d1708d52ec9a8a19bbb8547 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 podman[39517]: 2026-02-24 07:45:34.711714788 +0000 UTC m=+0.008716537 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 systemd[1]: Started Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: pidfile_write: ignore empty --pid-file 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: load: jerasure load: lrc 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: RocksDB version: 7.9.2 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Git sha 0 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Compile date 2026-02-24 05:12:44 2026-02-24T07:45:34.996 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: DB SUMMARY 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: DB Session ID: MY962WA6H8I2U2Z9II70 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: CURRENT file: CURRENT 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100454 ; 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.error_if_exists: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.create_if_missing: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.paranoid_checks: 1 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.env: 0xed5d60 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.info_log: 0x1a66ec0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.statistics: (nil) 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.use_fsync: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_log_file_size: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_fallocate: 1 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.use_direct_reads: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T07:45:34.997 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.db_log_dir: 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.wal_dir: 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.write_buffer_manager: 0x1a62140 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.unordered_write: 0 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.row_cache: None 2026-02-24T07:45:34.998 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.wal_filter: None 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.two_write_queues: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.wal_compression: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.atomic_flush: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.log_readahead_size: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_background_jobs: 2 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_background_compactions: -1 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_subcompactions: 1 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_open_files: -1 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T07:45:34.999 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_background_flushes: -1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Compression algorithms supported: 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kZSTD supported: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kXpressCompression supported: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kBZip2Compression supported: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kLZ4Compression supported: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kZlibCompression supported: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: kSnappyCompression supported: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.merge_operator: 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_filter: None 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x1a67600) 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: cache_index_and_filter_blocks: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: pin_top_level_index_and_filter: 1 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: index_type: 0 2026-02-24T07:45:35.000 INFO:journalctl@ceph.mon.a.trial016.stdout: data_block_index_type: 0 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: index_shortening: 1 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: checksum: 4 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: no_block_cache: 0 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache: 0x1a35a50 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_name: BinnedLRUCache 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_options: 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: capacity : 536870912 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: num_shard_bits : 4 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: strict_capacity_limit : 0 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: high_pri_pool_ratio: 0.000 2026-02-24T07:45:35.001 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_compressed: (nil) 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: persistent_cache: (nil) 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: block_size: 4096 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: block_size_deviation: 10 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: block_restart_interval: 16 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: index_block_restart_interval: 1 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: metadata_block_size: 4096 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: partition_filters: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: use_delta_encoding: 1 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: filter_policy: bloomfilter 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: whole_key_filtering: 1 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: verify_compression: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: read_amp_bytes_per_bit: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: format_version: 5 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: enable_index_compression: 1 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: block_align: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: max_auto_readahead_size: 262144 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: prepopulate_block_cache: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: initial_auto_readahead_size: 8192 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression: NoCompression 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.num_levels: 7 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T07:45:35.002 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T07:45:35.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.inplace_update_support: 0 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T07:45:35.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.bloom_locality: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.max_successive_merges: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.ttl: 2592000 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enable_blob_files: false 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.min_blob_size: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 38ae4e22-a05d-418e-bfe0-27148044ecc4 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771919134764016, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771919134764821, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 327, "table_properties": {"data_size": 92849, "index_size": 240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 15824, "raw_average_key_size": 53, "raw_value_size": 84677, "raw_average_value_size": 284, "num_data_blocks": 9, "num_entries": 298, "num_filter_entries": 298, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771919134, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "38ae4e22-a05d-418e-bfe0-27148044ecc4", "db_session_id": "MY962WA6H8I2U2Z9II70", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771919134764875, "job": 1, "event": "recovery_finished"} 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T07:45:35.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x1a82e00 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: DB pointer 0x2874000 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: ** DB Stats ** 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: ** Compaction Stats [default] ** 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: L0 2/0 94.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Sum 2/0 94.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: ** Compaction Stats [default] ** 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 178.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T07:45:35.006 INFO:journalctl@ceph.mon.a.trial016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative compaction: 0.00 GB write, 33.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval compaction: 0.00 GB write, 33.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: Block cache BinnedLRUCache@0x1a35a50#2 capacity: 512.00 MB usage: 1.44 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: starting mon.a rank 0 at public addrs [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] at bind addrs [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???) e1 preinit fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).mds e1 new map 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).mds e1 print_map 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: e1 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: btime 2026-02-24T07:45:33:912318+0000 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: legacy client fscid: -1 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout: No filesystems configured 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: 2026-02-24T07:45:34.767+0000 7fe28d0d5c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T07:45:35.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: monmap epoch 1 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: last_changed 2026-02-24T07:45:32.954226+0000 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: created 2026-02-24T07:45:32.954226+0000 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: min_mon_release 20 (tentacle) 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: election_strategy: 1 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: 0: [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon.a 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: fsmap 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T07:45:35.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:34 trial016 ceph-mon[39544]: mgrmap e1: no daemons active 2026-02-24T07:45:35.047 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.990+0000 7faa1c859640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:35.047 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:34.995+0000 7faa1c859640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:35.047 INFO:teuthology.orchestra.run.trial016.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T07:45:35.047 INFO:teuthology.orchestra.run.trial016.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:45:35.048 INFO:teuthology.orchestra.run.trial016.stdout:Creating mgr... 2026-02-24T07:45:35.048 INFO:teuthology.orchestra.run.trial016.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T07:45:35.048 INFO:teuthology.orchestra.run.trial016.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T07:45:35.188 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x 2026-02-24T07:45:35.189 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x.service: Unit ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x.service not loaded. 2026-02-24T07:45:35.305 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460.target.wants/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@.service. 2026-02-24T07:45:35.450 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:45:35.450 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-24T07:45:35.455 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:45:35.455 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:35.455 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-24T07:45:35.456 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T07:45:35.462 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:45:35.462 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-24T07:45:35.468 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:45:35.468 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:35.468 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-24T07:45:35.469 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T07:45:35.469 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr to start... 2026-02-24T07:45:35.469 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr... 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "c4ff2ae8-1154-11f1-bd55-d404e6e7d460", 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:45:35.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:45:35.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:45:35.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:45:35.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:45:33:912318+0000", 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:45:35.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:45:33.912753+0000", 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:35.571+0000 7fedc7df3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:35.573+0000 7fedc7df3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:35.639 INFO:teuthology.orchestra.run.trial016.stdout:mgr not available, waiting (1/15)... 2026-02-24T07:45:36.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3829879019' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-24T07:45:36.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2511708308' entity='client.admin' 2026-02-24T07:45:36.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2412918192' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:45:36.816 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:36 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: from numpy import show_config as show_numpy_config 2026-02-24T07:45:37.786 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:37.786 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "c4ff2ae8-1154-11f1-bd55-d404e6e7d460", 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:37.787 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:45:33:912318+0000", 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:45:33.912753+0000", 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:37.730+0000 7f42c0ff7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:37.733+0000 7f42c0ff7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:37.788 INFO:teuthology.orchestra.run.trial016.stdout:mgr not available, waiting (2/15)... 2026-02-24T07:45:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2891559342' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:45:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: Activating manager daemon x 2026-02-24T07:45:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: mgrmap e2: x(active, starting, since 0.00278387s) 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: Manager daemon x is now available 2026-02-24T07:45:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:45:39.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' 2026-02-24T07:45:39.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:45:39.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' 2026-02-24T07:45:39.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:38 trial016 ceph-mon[39544]: from='mgr.14102 10.20.193.16:0/2362965984' entity='mgr.x' 2026-02-24T07:45:40.052 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "c4ff2ae8-1154-11f1-bd55-d404e6e7d460", 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:45:40.053 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:45:33:912318+0000", 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.054 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:45:33.912753+0000", 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:39.874+0000 7f84ad960640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:39.877+0000 7f84ad960640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:40.055 INFO:teuthology.orchestra.run.trial016.stdout:mgr is available 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout fsid = c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T07:45:40.277 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T07:45:40.278 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:40.141+0000 7f3241c2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:40.278 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:40.144+0000 7f3241c2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:40.278 INFO:teuthology.orchestra.run.trial016.stdout:Enabling cephadm module... 2026-02-24T07:45:40.315 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:40 trial016 ceph-mon[39544]: mgrmap e3: x(active, since 1.00456s) 2026-02-24T07:45:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2028822452' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:45:41.238 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:40.368+0000 7f2c70786640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.238 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:40.373+0000 7f2c70786640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.469 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:41 trial016 ceph-mon[39544]: mgrmap e4: x(active, since 2s) 2026-02-24T07:45:41.469 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4206089818' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-24T07:45:41.469 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2126787555' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-24T07:45:41.470 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setuser ceph since I am not root 2026-02-24T07:45:41.470 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setgroup ceph since I am not root 2026-02-24T07:45:41.470 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:41.255+0000 7ff42fb71fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.470 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:41.257+0000 7ff42fb71fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.470 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:41.258+0000 7ff42fb71fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.491 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:41.324+0000 7f9b99c41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:41.327+0000 7f9b99c41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for the mgr to restart... 2026-02-24T07:45:41.492 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr epoch 5... 2026-02-24T07:45:42.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2126787555' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T07:45:42.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:42 trial016 ceph-mon[39544]: mgrmap e5: x(active, since 3s) 2026-02-24T07:45:42.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1648666453' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T07:45:42.567 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:42 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:45:42.567 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:42 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:45:42.567 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:42 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: from numpy import show_config as show_numpy_config 2026-02-24T07:45:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: Active manager daemon x restarted 2026-02-24T07:45:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: Activating manager daemon x 2026-02-24T07:45:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T07:45:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: mgrmap e6: x(active, starting, since 0.0026668s) 2026-02-24T07:45:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:45:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:45:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:45:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:45:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:45:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:44 trial016 ceph-mon[39544]: Manager daemon x is now available 2026-02-24T07:45:45.028 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:45.028 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:41.588+0000 7fd44f0be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:41.591+0000 7fd44f0be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:mgr epoch 5 is available 2026-02-24T07:45:45.029 INFO:teuthology.orchestra.run.trial016.stdout:Verifying orchestrator module is enabled... 2026-02-24T07:45:45.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: Found migration_current of "None". Setting to last migration. 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:45.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: mgrmap e7: x(active, since 1.00362s) 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:45] ENGINE Bus STARTING 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:45] ENGINE Serving on http://10.20.193.16:8765 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2378255204' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-24T07:45:45.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:45 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:46.026 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:45.120+0000 7f3b3ee16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.026 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:45.124+0000 7f3b3ee16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.026 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-24T07:45:46.026 INFO:teuthology.orchestra.run.trial016.stdout:Setting orchestrator backend to cephadm... 2026-02-24T07:45:46.253 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.107+0000 7fb4fe527640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.254 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.111+0000 7fb4fe527640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.472 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T07:45:46.472 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.337+0000 7f0e51ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.473 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.340+0000 7f0e51ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.473 INFO:teuthology.orchestra.run.trial016.stdout:Generating ssh key... 2026-02-24T07:45:46.714 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.557+0000 7f8e9e42b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.714 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.561+0000 7f8e9e42b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.762 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Generating public/private ed25519 key pair. 2026-02-24T07:45:46.762 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Your identification has been saved in /tmp/tmpaa9dmijh/key 2026-02-24T07:45:46.762 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Your public key has been saved in /tmp/tmpaa9dmijh/key.pub 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: The key fingerprint is: 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: SHA256:G7/shM88l9tO6D/qy/MpGNlR7RH8X16QNjBRJeaJM1I ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: The key's randomart image is: 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: +--[ED25519 256]--+ 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | E+==o| 2026-02-24T07:45:46.763 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | . =*=.| 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | . +oo+o| 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | ..o =| 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | S o . .+| 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | =o .. o| 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | o oo... | 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | *o+=o.. | 2026-02-24T07:45:46.764 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: | .B+BX*. | 2026-02-24T07:45:46.765 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:46 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: +----[SHA256]-----+ 2026-02-24T07:45:46.933 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDDQHiZFnQYYPtot7VWIXrL2BsyzCB27XGKY0ddc4T0w ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:46.934 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.800+0000 7f9b59c1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.934 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:46.802+0000 7f9b59c1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:46.934 INFO:teuthology.orchestra.run.trial016.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T07:45:46.934 INFO:teuthology.orchestra.run.trial016.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T07:45:46.935 INFO:teuthology.orchestra.run.trial016.stdout:Adding host trial016... 2026-02-24T07:45:47.037 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:45] ENGINE Serving on https://10.20.193.16:7150 2026-02-24T07:45:47.037 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:45] ENGINE Bus STARTED 2026-02-24T07:45:47.037 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:45] ENGINE Client ('10.20.193.16', 51192) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2378255204' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: mgrmap e8: x(active, since 2s) 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:47.038 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:47 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:48 trial016 ceph-mon[39544]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:48 trial016 ceph-mon[39544]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:48 trial016 ceph-mon[39544]: Generating ssh key... 2026-02-24T07:45:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:48 trial016 ceph-mon[39544]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:48 trial016 ceph-mon[39544]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial016", "addr": "10.20.193.16", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:48.722 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Added host 'trial016' with addr '10.20.193.16' 2026-02-24T07:45:48.722 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:47.031+0000 7fb45926d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:48.722 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:47.035+0000 7fb45926d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:48.722 INFO:teuthology.orchestra.run.trial016.stdout:Deploying unmanaged mon service... 2026-02-24T07:45:48.970 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T07:45:48.970 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:48.823+0000 7fb007a87640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:48.970 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:48.827+0000 7fb007a87640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:48.970 INFO:teuthology.orchestra.run.trial016.stdout:Deploying unmanaged mgr service... 2026-02-24T07:45:49.200 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:49 trial016 ceph-mon[39544]: Deploying cephadm binary to trial016 2026-02-24T07:45:49.201 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:49 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:49.201 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:49 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:49.201 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:49 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:49.207 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T07:45:49.207 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.056+0000 7fba80622640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.207 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.060+0000 7fba80622640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.457 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.311+0000 7fb01faf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.457 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.317+0000 7fb01faf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.551+0000 7f610151c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.556+0000 7f610151c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:49.694 INFO:teuthology.orchestra.run.trial016.stdout:Enabling the dashboard module... 2026-02-24T07:45:50.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: Added host trial016 2026-02-24T07:45:50.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:50.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: Saving service mon spec with placement count:5 2026-02-24T07:45:50.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:50.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: Saving service mgr spec with placement count:2 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3887385372' entity='client.admin' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3287243263' entity='client.admin' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3626196714' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-24T07:45:50.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:50 trial016 ceph-mon[39544]: from='mgr.14120 10.20.193.16:0/2747362517' entity='mgr.x' 2026-02-24T07:45:50.746 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.790+0000 7fdf61262640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:50.746 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:49.794+0000 7fdf61262640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:50.992 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:50 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setuser ceph since I am not root 2026-02-24T07:45:50.992 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:50 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setgroup ceph since I am not root 2026-02-24T07:45:50.992 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:50 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:50.765+0000 7f5aa542afc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:50.992 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:50 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:50.767+0000 7f5aa542afc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:50.992 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:50 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:45:50.767+0000 7f5aa542afc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:50.840+0000 7fe8ca00e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:50.843+0000 7fe8ca00e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for the mgr to restart... 2026-02-24T07:45:51.015 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr epoch 9... 2026-02-24T07:45:52.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3626196714' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T07:45:52.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:51 trial016 ceph-mon[39544]: mgrmap e9: x(active, since 6s) 2026-02-24T07:45:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/175285581' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T07:45:52.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:51 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:45:52.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:51 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:45:52.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:45:51 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: from numpy import show_config as show_numpy_config 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: Active manager daemon x restarted 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: Activating manager daemon x 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: mgrmap e10: x(active, starting, since 0.00277137s) 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:45:54.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:45:54.016 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:45:54.016 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:45:54.016 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:53 trial016 ceph-mon[39544]: Manager daemon x is now available 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:51.110+0000 7f2f64c77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:54.550 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:51.114+0000 7f2f64c77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:54.551 INFO:teuthology.orchestra.run.trial016.stdout:mgr epoch 9 is available 2026-02-24T07:45:54.551 INFO:teuthology.orchestra.run.trial016.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:54.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:54 trial016 ceph-mon[39544]: mgrmap e11: x(active, since 1.00417s) 2026-02-24T07:45:55.092 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHzCCAwegAwIBAgIUYfTDF9KrGGIn10Fu5rbh9EeFkwUwDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LWM0ZmYyYWU4LTExNTQtMTFmMS1i\nZDU1LWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjQwNzQ1NTVaFw0yOTAyMjMwNzQ1NTVa\nMBcxFTATBgNVBAMMDDEwLjIwLjE5My4xNjCCAiIwDQYJKoZIhvcNAQEBBQADggIP\nADCCAgoCggIBAK+9z9sJEDh30zE3Mx7QLSQTdn+fbeeFKwth1WvPUJk5Pnw+bX8I\n9bb2KK69D4VdCmY/gsMdFpOzeTgrjXMolibp2Q+Spt1s1ddr8H+0jimeDykCl7iq\nkLg+/7Zgy1goJLRCZm/z/2AET/uFxOuWx8IvtBDhOLnwy7MUpMrih3arIBLFEmW9\nOx8fBuOXKQ7QYRYo8FtH+Dggf99+/BEEYV+MHGqJximO7hMN5W32C6xkicfHCEAl\nZ0MDr7AtgQw+KcbQU96CGXlMzl0n/6DxwSLD9LW8+9BhZZxoCExyMf0XJ8D9Fy+U\nNpcPduu14SguPM1KjPbWCFNoBpGFA8o7InJFiKPVOks8SsiDRntxLWMu7Hdd5UsH\nnWYmBh5qDh5xqZoOVZwjO1VgletzqsB72F3kI9P+lUVbVUPgZi/5V4DDuC3XgwBY\nDyv7cPKKkOpdEo4I3RW/U20NRH/9GoRZNMoSVQsSeMmddIbk0efYGCU2nHx6q0gI\nbc6CrQaDH/G9yLWU2lciyk+sBHLGEGF7CnMD5amVEJVSCXI4oF1aluXVzrNa6qrO\nVYcgU3N6halJXxJLhFUwJXlK1M5p3GTJfydd/iZKQz4fpaV8OuGgprSVlchhjyB6\nXDemzls6nyODckynXg4h+hMRpCP+V6FzoS4Vx3via5mDtCvJHMdRHrtRAgMBAAGj\nPjA8MCwGA1UdEQQlMCOCCHRyaWFsMDE2ghFkYXNoYm9hcmRfc2VydmVyc4cEChTB\nEDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBQpQlbxj4aS2X+hMEp\nDEtmWIfDpi5WvcIvoVcdQSrBFIjeJdOV6MXU3G4bjFwt5m8yZLL8opTFybYT6u+y\nENGj4Nx6vM1wYTBeJmJDCT+uj2GwiTmSoRu+rN1gyO+2M1nFfzjfJc49+6yn9Sh4\nrdb2shlge/w9Vu7NUUyLtpkzvAfivN2Lm8VMOx7CtghRXLgkzeMJolSJmzIdxxHy\nrq4NEeM1Keer+qOTBpSZ4bUy6LCbfEr0WW9hzGJXT4/BplOYdvwQwLy7hOVh9CIv\nSbjw/gQoyJfoRODise4xV/Hr/XBucKKHq1pknYQToSiFvosyDDecH3vnjvpSrGRf\nlvcQofcINP1oGoKnE8ah9pOgwcWWSsEYypA3/wjqFMvymU1FTOaDv4tGY32WXxJC\n/NVFaXPcYguR/4YAJ5oibTnJQJw46Y5JkSvSAMFfzSFLz3n1/w6iN7xNupmBV/7r\n802DUlAJA3G7mokbJU8MxL3PNF7yYnZFqQzp7vcqtrKFW6lu8quy5exGeQ4BcTWH\nm6rT4hdw9cR4Bt0GLKp3OsxnqctCzAMYnbh9sYqMsClY52kgoYQHoUzHzHP4YU8x\n9FGPRfLW6PCSQtTvcx6AzB+x15XNRR6hl52d4qQ/RIEAwJ1qs8c0evsGmAHmvAsq\nrTJ+QpyEfySzb0MsIhvmtcMBDQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAr73P2wkQOHfTMTczHtAtJBN2f59t54UrC2HVa89QmTk+fD5t\nfwj1tvYorr0PhV0KZj+Cwx0Wk7N5OCuNcyiWJunZD5Km3WzV12vwf7SOKZ4PKQKX\nuKqQuD7/tmDLWCgktEJmb/P/YARP+4XE65bHwi+0EOE4ufDLsxSkyuKHdqsgEsUS\nZb07Hx8G45cpDtBhFijwW0f4OCB/3378EQRhX4wcaonGKY7uEw3lbfYLrGSJx8cI\nQCVnQwOvsC2BDD4pxtBT3oIZeUzOXSf/oPHBIsP0tbz70GFlnGgITHIx/RcnwP0X\nL5Q2lw9267XhKC48zUqM9tYIU2gGkYUDyjsickWIo9U6SzxKyINGe3EtYy7sd13l\nSwedZiYGHmoOHnGpmg5VnCM7VWCV63OqwHvYXeQj0/6VRVtVQ+BmL/lXgMO4LdeD\nAFgPK/tw8oqQ6l0SjgjdFb9TbQ1Ef/0ahFk0yhJVCxJ4yZ10huTR59gYJTacfHqr\nSAhtzoKtBoMf8b3ItZTaVyLKT6wEcsYQYXsKcwPlqZUQlVIJcjigXVqW5dXOs1rq\nqs5VhyBTc3qFqUlfEkuEVTAleUrUzmncZMl/J13+JkpDPh+lpXw64aCmtJWVyGGP\nIHpcN6bOWzqfI4NyTKdeDiH6ExGkI/5XoXOhLhXHe+JrmYO0K8kcx1Eeu1ECAwEA\nAQKCAgAqYJu83mJgL3rIeR5VXY8pDh1quGvU4n6G89w2L0to604XQSl/ss4nhJO6\nUSIrP0yI6+Mw//RoAOTn586n2H9emlCqaetdZQdqtx9K+CO4wuG2eqbR06VqnFxm\notAd7a4uHn3bnKt1wIx14yOhSJ5aQ80IrfqTEc7Y289CEh5mveyRwh5F1LvrLPzp\nCBQRO6vRn2UYKdJf3GxhXRpU0yjU1LEsepUDg/ECPL1YhvZ5J1Q3DZY+e5Z7KSom\nEk72QA4sYCN9OgOBBcWUXpcMfQdcxgJeCZhyPu406TwpDPdjZ4BBT/ZVlYiVZBgB\nzj2hRgcI3OOBiQqAbEr7L6dCjoBnRRDRMcqxe5BOuYiFeGMVQA4Rs8O7n6TzITXV\ngtCzKIYqfaVAYUU38Gf4cYD/3Kiu9ozynhYr1v4Pu3nDF9mWHgw5LSRBJMXjLSns\ntKpDXa8Gj/hAw1GqEQdaMZ5C4G5IRSK7jc4R9VcGklky2rQVcCz5y18t5/A7eS0L\nqyvyBc4lAQ97xjnahWQZWZWmewlYRGI3Ch9FRgd2yeHcm6u4SF0NaVCLFwiR4laT\nNEQ6ELzHoBemmDttFm2BWiAIsfhmO0qtFpKj99Tkf3f6Kpz+uB9g7LweVxwxEUUS\njcGRhbjn0NUJyEXxkaJv3qNVXS99wEZgQqZRnnCwonQSS+ecDQKCAQEA8fXavl+j\n5572aSkB+1dZFCxlih0tji39AAhvVChm1bf6b0eZv/RnCfCUkCm5vrwGxllIMazj\nvx1er1fMa6MnzzPdni+wPtHtOKWpgjmu0zN/04girhR4NP5fApQEjE2wuZRJkcKS\nO6NQ+pFZCNpzLDd98k8KtRQlgRiXBghmMEUEmC2/6W4+6BfggIeGn8dM1SE+pmOZ\np63iPaHd92vImpVyIIA4syHXvT0CJTVVaeNWu1fBB6aQkNfZpy6qXy0LZzJpoKX8\nbjRBYtpKhoGafo/e72eWKavBVInfL62xCXhjAnpc1FIZ7BwjBWJr1BLqh7UvTvRT\nUfyQ0lAoIHHP9QKCAQEAufBS1VaY7O1CxBbfi4rKvj5d2D7hoehfspetk5uZJJdK\n4NTqMq+cY4SAhFnQdOj+taG80pv2d1BpxfvPs52lE7oo8WwgHLBtJHcsTUXcy1qy\nKh/+nLfZTp5WhHdirNiSu5BgwKC1J3W6IHmAut8bJiILID6TBoob/2efeKCTNwpW\nkFWJ9SOAgeskVjpVEHSIEyXdf+/gE9GWtKJwDecVFPCEFJRKMLAC4RTnMW8FDWPs\nDKkXQpzQ07Ps8j/aF8B7tuQ5WADIqUjrifEgGvsKEzsb+0WZyjHnL5QmqNfGaGzx\nTGVDmvzKbk9kPngo4ub1pxrz9kJunoGLGDkXeDZwbQKCAQBX8kIBAmhkDx6HmLU0\ns0oYkA6URgjB7itQsMAuecTvF8E6Y28aG268aSrGv7PZBST9QYSBMdNSKw24dBRE\nZ3hX0wVRswm/u7Qa6/QR9n96GvTyYUAhwCT1NiQ4nq6MhMygl6qqBWv7q2AKw3v2\nQNiuELmBsoM00E7VfqeeNL1X/C4wVii0YzMQT2V1sk0XlGxz53KLLhayoPxj5Ir2\nnMG8lmd2MsTpL3roON2nwpv6MfzbeYkbC8ruKtbc8pRQpeHIL8W+87YuJGZD1Q5T\nl5YdPJQOtrsZCGnsHXT3Mo3v4Ec0pl9JeVIcxRlhoqWI3xtKGmxIqXwDh+bn2uTK\n7jNlAoIBAH77jkZeFqAvxJoQGOi+h4l3JDXrc8JT5Q8doRAegm7H1/5Fyg+FeONJ\n+U7p24AMIu8+HqsikiaXxzTLrOQ4tCUNzKpbsm6FWnQ94wZ+wLQsI2K7aPH0aLbV\nUbazpbLvUP5BMqI63pytPMiy0eRNO8hGFZ0WvugHZ+l8Bh+mYgODzuxRTp8YeMnB\nIZa1zaQoQUn6YRPfaQN/7lE8YhRMjUw4matIPoaTndPDp8RN0oB7jhhzXgxC9iau\nSRKD4ti3voV/xV3BY0ihISKahteGPDI3+vsWZFn+zKjkn6ZNfhWQ2RXYTlxJaaH+\nHDLBcwLKwlc2BAhZBBzB0ZFgZBPX8d0CggEBALBIVWv43hfCjVzlri6OCeB9/rHm\nzGpqwmiLwntG8PcZTrUfF4+e7yI6dCkx7zab9AMR+4zcEXUvy6aSLwCJI1QINq7f\nHIRAF+b+S30b8biunwra78tAk2I4PecuVghURbZgI01eEgaAOUjZiKVw5A49jhNz\nGy2+Zkx7iuZjBy7MWf7Awbpp0eVH0d08QoqKUtSyNssR+oIlh2v2X1clBVkhyxl+\nXS6NCOA7zeMbsEyh1FrWmnzKMr1bO6zjjAAoRavs6FsX98zfI9d7vAJV+84Yv0LK\neoAbIr2R4aF7jaBoq7WJ/q4Q8jRqZsUNMg88CIadw8uNGjOVyK1kH6yY9dQ=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-24T07:45:55.092 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:54.643+0000 7ffae02d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.092 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:54.647+0000 7ffae02d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-24T07:45:55.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.180+0000 7f2912360640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.182+0000 7f2912360640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.560 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-24T07:45:55.560 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.415+0000 7f0e976a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.561 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.418+0000 7f0e976a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.561 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial admin user... 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:53] ENGINE Bus STARTING 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:53] ENGINE Serving on http://10.20.193.16:8765 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:54] ENGINE Serving on https://10.20.193.16:7150 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:54] ENGINE Bus STARTED 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: [24/Feb/2026:07:45:54] ENGINE Client ('10.20.193.16', 48722) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:55.582 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:55.583 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:55 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:55.998 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$I/Dr1pboRwSczA0L8gvtjur613X6crWSqxUUSRDTNgm4ea8iKJzq.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771919155, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T07:45:55.998 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.650+0000 7f3d5a1ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.998 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:55.655+0000 7f3d5a1ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:55.999 INFO:teuthology.orchestra.run.trial016.stdout:Fetching dashboard port number... 2026-02-24T07:45:56.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T07:45:56.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:56.084+0000 7f779985b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:56.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:56.088+0000 7f779985b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:56.227 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:45:56.227 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-24T07:45:56.233 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:45:56.233 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:56.233 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-24T07:45:56.233 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout:Ceph Dashboard is now available at: 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout: URL: https://trial016:8443/ 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout: User: admin 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout: Password: 0u30jlokul 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.235 INFO:teuthology.orchestra.run.trial016.stdout:Saving cluster configuration to /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config directory 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:56.327+0000 7fbde22de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-24T07:45:56.331+0000 7fbde22de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.514 INFO:teuthology.orchestra.run.trial016.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: ceph telemetry on 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout:For more information see: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:45:56.515 INFO:teuthology.orchestra.run.trial016.stdout:Bootstrap complete. 2026-02-24T07:45:56.521 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout static 2026-02-24T07:45:56.527 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-24T07:45:56.527 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-24T07:45:56.527 INFO:teuthology.orchestra.run.trial016.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-24T07:45:56.683 INFO:tasks.cephadm:Fetching config... 2026-02-24T07:45:56.684 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:56.684 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T07:45:56.701 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T07:45:56.701 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:56.701 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T07:45:56.757 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T07:45:56.757 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:56.757 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T07:45:56.801 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:56.801 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:56.801 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:56.801 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3961325325' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-24T07:45:56.802 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: mgrmap e12: x(active, since 2s) 2026-02-24T07:45:56.802 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1560146216' entity='client.admin' 2026-02-24T07:45:56.822 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T07:45:56.823 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:45:56.823 DEBUG:teuthology.orchestra.run.trial016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T07:45:56.879 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T07:45:56.879 DEBUG:teuthology.orchestra.run.trial016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDDQHiZFnQYYPtot7VWIXrL2BsyzCB27XGKY0ddc4T0w ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T07:45:56.951 INFO:teuthology.orchestra.run.trial016.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDDQHiZFnQYYPtot7VWIXrL2BsyzCB27XGKY0ddc4T0w ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:56.962 DEBUG:teuthology.orchestra.run.trial043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDDQHiZFnQYYPtot7VWIXrL2BsyzCB27XGKY0ddc4T0w ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T07:45:56.997 INFO:teuthology.orchestra.run.trial043.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDDQHiZFnQYYPtot7VWIXrL2BsyzCB27XGKY0ddc4T0w ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:45:57.007 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T07:45:57.122 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:45:57.226 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:57.224+0000 7f6509bbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:57.226 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:57.224+0000 7f6509bbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:57.377 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T07:45:57.378 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T07:45:57.497 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:45:57.604 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:57.602+0000 7f959a31f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:57.604 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:57.602+0000 7f959a31f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:57.652 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:57.652 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4016352746' entity='client.admin' 2026-02-24T07:45:57.653 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:57.653 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:57.653 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial016", "name": "osd_memory_target"} : dispatch 2026-02-24T07:45:57.653 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:57 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:57.760 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial043 2026-02-24T07:45:57.760 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:57.760 DEBUG:teuthology.orchestra.run.trial043:> dd of=/etc/ceph/ceph.conf 2026-02-24T07:45:57.781 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:45:57.781 DEBUG:teuthology.orchestra.run.trial043:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:45:57.838 INFO:tasks.cephadm:Adding host trial043 to orchestrator... 2026-02-24T07:45:57.838 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch host add trial043 2026-02-24T07:45:57.957 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:45:58.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:58.070+0000 7f11baf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:58.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:45:58.070+0000 7f11baf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: Certificate for "cephadm-signed_agent_cert (trial016)" is still valid for 1824 days. 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: Updating trial016:/etc/ceph/ceph.conf 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:58.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:58 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:45:59.916 INFO:teuthology.orchestra.run.trial016.stdout:Added host 'trial043' with addr '10.20.193.43' 2026-02-24T07:45:59.977 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:59 trial016 ceph-mon[39544]: Updating trial016:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:45:59.977 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:59 trial016 ceph-mon[39544]: Updating trial016:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:45:59.977 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:59 trial016 ceph-mon[39544]: Updating trial016:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:45:59.977 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:59 trial016 ceph-mon[39544]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial043", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:45:59.977 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:45:59 trial016 ceph-mon[39544]: Deploying cephadm binary to trial043 2026-02-24T07:45:59.979 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T07:46:00.095 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:00.199 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:00.197+0000 7fa0919a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:00.199 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:00.197+0000 7fa0919a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:00.311 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:00.311 INFO:teuthology.orchestra.run.trial016.stdout:[{"addr": "10.20.193.16", "hostname": "trial016", "labels": [], "status": ""}, {"addr": "10.20.193.43", "hostname": "trial043", "labels": [], "status": ""}] 2026-02-24T07:46:00.348 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T07:46:00.349 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T07:46:00.466 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:00.575 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:00.573+0000 7fc512504640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:00.575 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:00.573+0000 7fc512504640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: mgrmap e13: x(active, since 6s) 2026-02-24T07:46:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:01.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:01.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1550857038' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-24T07:46:01.216 INFO:teuthology.orchestra.run.trial016.stderr:adjusted tunables profile to default 2026-02-24T07:46:01.259 INFO:tasks.cephadm:Adding mon.a on trial016 2026-02-24T07:46:01.259 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch apply mon '1;trial016:10.20.193.16=a' 2026-02-24T07:46:01.389 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:46:01.389 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:46:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:01.497+0000 7f9b79625640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:01.497+0000 7f9b79625640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:01.623 INFO:teuthology.orchestra.run.trial043.stdout:Scheduled mon update... 2026-02-24T07:46:01.659 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-24T07:46:01.660 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T07:46:01.777 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:46:01.777 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:46:01.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:01.885+0000 7fa07fbf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:01.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:01.886+0000 7fa07fbf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:02.039 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:46:02.039 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":1,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","modified":"2026-02-24T07:45:32.954226Z","created":"2026-02-24T07:45:32.954226Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:3300","nonce":0},{"type":"v1","addr":"10.20.193.16:6789","nonce":0}]},"addr":"10.20.193.16:6789/0","public_addr":"10.20.193.16:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T07:45:32:954240+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T07:46:02.039 INFO:teuthology.orchestra.run.trial043.stderr:dumped monmap epoch 1 2026-02-24T07:46:02.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: Added host trial043 2026-02-24T07:46:02.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:02.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1550857038' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T07:46:02.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T07:46:02.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:01 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.077 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T07:46:02.077 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T07:46:02.193 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:02.298 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:02.296+0000 7f2e9af30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:02.299 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:02.297+0000 7f2e9af30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:02.408 INFO:teuthology.orchestra.run.trial016.stdout:# minimal ceph.conf for c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:46:02.408 INFO:teuthology.orchestra.run.trial016.stdout:[global] 2026-02-24T07:46:02.408 INFO:teuthology.orchestra.run.trial016.stdout: fsid = c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:46:02.408 INFO:teuthology.orchestra.run.trial016.stdout: mon_host = [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] 2026-02-24T07:46:02.458 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T07:46:02.458 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:46:02.458 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T07:46:02.484 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:46:02.485 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:46:02.550 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:46:02.550 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T07:46:02.576 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:46:02.576 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:46:02.640 INFO:tasks.cephadm:Adding mgr.x on trial016 2026-02-24T07:46:02.640 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch apply mgr '1;trial016=x' 2026-02-24T07:46:02.794 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:02.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:02.905+0000 7f63159b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:02.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:02.905+0000 7f63159b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:02.989 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial016:10.20.193.16=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:02.989 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: Saving service mon spec with placement trial016:10.20.193.16=a;count:1 2026-02-24T07:46:02.989 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/4111638337' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial043", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:02.990 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/478426884' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:03.026 INFO:teuthology.orchestra.run.trial043.stdout:Scheduled mgr update... 2026-02-24T07:46:03.063 DEBUG:tasks.cephadm:set 0 configs 2026-02-24T07:46:03.063 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config dump 2026-02-24T07:46:03.178 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:03.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:03.284+0000 7f028acd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:03.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:03.284+0000 7f028acd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global dev auth_debug true 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 * 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global advanced crimson_allow_pg_split false 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global dev debug_asserts_on_shutdown true 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global advanced enable_experimental_unrecoverable_data_corrupting_features crimson 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global basic log_to_file true 2026-02-24T07:46:03.401 INFO:teuthology.orchestra.run.trial016.stdout:global basic log_to_journald false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global basic log_to_stderr false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_allow_pool_delete true 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_cluster_log_to_file true 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_client_mode crc * 2026-02-24T07:46:03.402 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_cluster_mode crc * 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global dev ms_die_on_bug true 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global dev ms_die_on_old_message true 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_mon_client_mode crc * 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_mon_cluster_mode crc * 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_mon_service_mode crc * 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global basic ms_service_mode crc * 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global dev osd_max_pg_log_entries 2 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global dev osd_min_pg_log_entries 1 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global dev osd_pg_log_trim_min 0 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global advanced osd_pool_default_min_size 2 2026-02-24T07:46:03.403 INFO:teuthology.orchestra.run.trial016.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:global advanced osd_pool_default_size 3 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced debug_mon 20/20 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced debug_ms 1/1 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced debug_paxos 20/20 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_data_avail_warn 5 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_min_osdmap_epochs 50 2026-02-24T07:46:03.404 INFO:teuthology.orchestra.run.trial016.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_osdmap_full_prune_interval 2 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_osdmap_full_prune_min 15 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_osdmap_full_prune_txsize 2 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced osd_pool_default_crimson true 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mon advanced paxos_service_trim_min 10 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced debug_mgr 20/20 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced debug_ms 1/1 2026-02-24T07:46:03.405 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced debug_osd 10/10 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd dev bdev_debug_aio true 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced crimson_cpu_num 4 * 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced crimson_osd_obc_lru_size 10 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_ms 20/20 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_osd 20/20 2026-02-24T07:46:03.406 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_backref 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_cache 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_cleaner 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_device 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_epm 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_fixedkv_tree 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_journal 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_lba 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_odata 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_omap 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_onode 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_t 20/20 2026-02-24T07:46:03.407 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced debug_seastore_tm 20/20 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_blocked_scrub_grace_period 3600 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_misdirected_ops true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_op_order true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_reject_backfill_probability 0.300000 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_shutdown true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_delete_sleep 1.000000 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_max_backfills 3 2026-02-24T07:46:03.408 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_max_markdown_count 1000 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_memory_target_autotune true 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_objectstore seastore * 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_op_queue debug_random * 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_recover_clone_overlap true 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-24T07:46:03.409 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_scrub_max_interval 120.000000 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_scrub_min_interval 60.000000 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced osd_snap_trim_sleep 2.000000 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced seastore_cachepin_size_pershard 67108864 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd dev seastore_cachepin_type 2Q * 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:osd advanced seastore_max_concurrent_transactions 8 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:client.0 advanced debug_ms 1/1 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:client.0 advanced debug_objecter 20/20 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:client.0 advanced debug_rados 20/20 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-24T07:46:03.410 INFO:teuthology.orchestra.run.trial016.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-24T07:46:03.411 INFO:teuthology.orchestra.run.trial016.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-24T07:46:03.436 INFO:tasks.cephadm:Enabling crimson flags... 2026-02-24T07:46:03.436 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-24T07:46:03.551 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:03.651 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:03.650+0000 7efe79604640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:03.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:03.650+0000 7efe79604640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: Updating trial043:/etc/ceph/ceph.conf 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: Updating trial043:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: Updating trial043:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: Updating trial043:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/310758830' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: 2026-02-24T07:46:03.765+0000 7fe285f42640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: Please be aware that this feature is experimental, untested, 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: unsupported, and may result in data corruption, data loss, 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: and/or irreparable damage to your cluster. Do not use 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: feature with important data. 2026-02-24T07:46:04.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:03 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: 2026-02-24T07:46:04.987 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T07:46:04.987 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: Reconfiguring daemon mon.a on trial016 2026-02-24T07:46:04.988 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial016=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:04.988 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: Saving service mgr spec with placement trial016=x;count:1 2026-02-24T07:46:04.988 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T07:46:04.988 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: Reconfiguring daemon mgr.x on trial016 2026-02-24T07:46:04.988 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/56449281' entity='client.admin' cmd={"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:46:05.158 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T07:46:05.159 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:46:05.159 DEBUG:teuthology.orchestra.run.trial016:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T07:46:05.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T07:46:05.176 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_1 2026-02-24T07:46:05.233 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-24 07:45:58.222714036 +0000 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.234 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.235 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T07:46:05.298 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-24T07:46:05.299 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-24T07:46:05.299 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000155157 s, 3.3 MB/s 2026-02-24T07:46:05.300 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T07:46:05.357 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_2 2026-02-24T07:46:05.414 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T07:46:05.414 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:05.414 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-24 07:45:58.254713458 +0000 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.415 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.415 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T07:46:05.478 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-24T07:46:05.478 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-24T07:46:05.478 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000150799 s, 3.4 MB/s 2026-02-24T07:46:05.480 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T07:46:05.537 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_3 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:05.592 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-24 07:45:58.289712827 +0000 2026-02-24T07:46:05.593 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.593 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.593 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.593 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T07:46:05.654 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-24T07:46:05.655 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-24T07:46:05.655 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000151831 s, 3.4 MB/s 2026-02-24T07:46:05.656 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T07:46:05.712 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_4 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-24 07:45:58.323712213 +0000 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.769 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.770 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-24 07:41:43.350336277 +0000 2026-02-24T07:46:05.770 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T07:46:05.832 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-24T07:46:05.832 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-24T07:46:05.832 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000135952 s, 3.8 MB/s 2026-02-24T07:46:05.833 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T07:46:05.890 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:46:05.891 DEBUG:teuthology.orchestra.run.trial043:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T07:46:05.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T07:46:05.908 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_1 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-24 07:46:02.022530009 +0000 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:05.965 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:05.966 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:05.966 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T07:46:06.029 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-24T07:46:06.029 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-24T07:46:06.029 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000153664 s, 3.3 MB/s 2026-02-24T07:46:06.030 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T07:46:06.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/56449281' entity='client.admin' cmd='[{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:46:06.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:05 trial016 ceph-mon[39544]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T07:46:06.088 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_2 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:06.144 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-24 07:46:02.058529152 +0000 2026-02-24T07:46:06.145 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.145 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.145 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.145 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T07:46:06.207 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-24T07:46:06.207 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-24T07:46:06.207 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000162872 s, 3.1 MB/s 2026-02-24T07:46:06.208 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T07:46:06.264 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_3 2026-02-24T07:46:06.320 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-24 07:46:02.094528295 +0000 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.321 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-24 07:39:22.034934185 +0000 2026-02-24T07:46:06.322 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T07:46:06.383 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-24T07:46:06.384 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-24T07:46:06.384 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000146091 s, 3.5 MB/s 2026-02-24T07:46:06.385 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T07:46:06.442 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_4 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:46:06.498 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-24 07:46:02.127527509 +0000 2026-02-24T07:46:06.499 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:06.499 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:06.499 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-24 07:39:22.033934209 +0000 2026-02-24T07:46:06.499 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T07:46:06.560 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-24T07:46:06.560 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-24T07:46:06.560 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000142103 s, 3.6 MB/s 2026-02-24T07:46:06.561 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T07:46:06.617 INFO:tasks.cephadm:Deploying osd.0 on trial016 with /dev/vg_nvme/lv_4... 2026-02-24T07:46:06.618 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T07:46:06.732 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:07.185 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:07.203 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch daemon add osd trial016:vg_nvme/lv_4 --skip-validation 2026-02-24T07:46:07.319 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:07.422 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:07.420+0000 7fee302ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:07.422 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:07.420+0000 7fee302ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:08.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='client.14200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:08.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: osd.default does not exist. Creating it now. 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: Creating OSDs with service ID: default on trial016:['vg_nvme/lv_4'] 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: Marking host: trial016 for OSDSpec preview refresh. 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: Saving service osd.default spec with placement trial016 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:08.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3931876207' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22020e1a-4666-4547-975e-a1c54d782ef5"} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3931876207' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22020e1a-4666-4547-975e-a1c54d782ef5"}]': finished 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:08.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1280126602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:46:10.883 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T07:46:10.884 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:10.884 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: Deploying daemon osd.0 on trial016 2026-02-24T07:46:10.884 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T07:46:10.884 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:10.884 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:10 trial016 ceph-mon[39544]: Deploying daemon osd.0 on trial016 2026-02-24T07:46:13.169 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:13 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:13.169 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:13 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:14.501 INFO:teuthology.orchestra.run.trial016.stdout:Created osd(s) 0 on host 'trial016' 2026-02-24T07:46:14.544 DEBUG:teuthology.orchestra.run.trial016:osd.0> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.0.service 2026-02-24T07:46:14.546 INFO:tasks.cephadm:Deploying osd.1 on trial016 with /dev/vg_nvme/lv_3... 2026-02-24T07:46:14.546 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T07:46:14.703 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:14.716 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:14 trial016 ceph-mon[39544]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T07:46:14.716 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:14 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:14.716 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:14 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:14.716 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:14 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:14.716 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:14 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:15.451 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:15.468 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch daemon add osd trial016:vg_nvme/lv_3 --skip-validation 2026-02-24T07:46:15.585 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:15.677 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:15.675+0000 7fe83f5ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:15.678 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:15.676+0000 7fe83f5ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:15.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='osd.0 [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T07:46:15.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:15.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:15.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:15.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:15.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:15 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.732 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:16 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0[55646]: 2026-02-24T07:46:16.534+0000 7ff9f8d91640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T07:46:16.733 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:16 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0[55646]: 2026-02-24T07:46:16.536+0000 7ff9f0c50640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='osd.0 [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='osd.0 [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial016", "root=default"]} : dispatch 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:16.733 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:16.734 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:16 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:17.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='client.14210 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:17.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: osd.default does not exist. Creating it now. 2026-02-24T07:46:17.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: Creating OSDs with service ID: default on trial016:['vg_nvme/lv_3'] 2026-02-24T07:46:17.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: Marking host: trial016 for OSDSpec preview refresh. 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: Saving service osd.default spec with placement trial016 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: Detected new or changed devices on trial016 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial016 to 84047M 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='osd.0 [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial016", "root=default"]}]': finished 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1920910397' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "121f0fef-9a82-4630-97c6-fdecadf14a25"} : dispatch 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1920910397' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "121f0fef-9a82-4630-97c6-fdecadf14a25"}]': finished 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: osd.0 [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433] boot 2026-02-24T07:46:17.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T07:46:17.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:17.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:17.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2726881727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:46:18.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:18 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:46:18.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:18 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:46:18.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:18 trial016 ceph-mon[39544]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T07:46:18.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:18 trial016 ceph-mon[39544]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T07:46:18.567 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:18 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:19.730 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:19 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T07:46:19.730 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:19 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:19.730 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:19 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T07:46:19.730 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:19 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:20.737 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:20 trial016 ceph-mon[39544]: Deploying daemon osd.1 on trial016 2026-02-24T07:46:20.737 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:20 trial016 ceph-mon[39544]: Deploying daemon osd.1 on trial016 2026-02-24T07:46:20.737 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:20 trial016 ceph-mon[39544]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:46:22.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:21 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:22.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:21 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:22.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:21 trial016 ceph-mon[39544]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:46:23.170 INFO:teuthology.orchestra.run.trial016.stdout:Created osd(s) 1 on host 'trial016' 2026-02-24T07:46:23.230 DEBUG:teuthology.orchestra.run.trial016:osd.1> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.1.service 2026-02-24T07:46:23.233 INFO:tasks.cephadm:Deploying osd.2 on trial043 with /dev/vg_nvme/lv_4... 2026-02-24T07:46:23.233 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T07:46:23.349 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:23.566 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:23 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T07:46:23.311+0000 7fa11379d780 -1 osd.1 0 log_to_monitors true 2026-02-24T07:46:23.848 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:46:23.867 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch daemon add osd trial043:vg_nvme/lv_4 --skip-validation 2026-02-24T07:46:23.891 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:23 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:23.892 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:23 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:23.892 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:23 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:23.892 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:23 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:23.892 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:23 trial016 ceph-mon[39544]: from='osd.1 [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T07:46:24.026 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:24.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:24.149+0000 7f7ec6fdf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:24.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:24.149+0000 7f7ec6fdf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:24.923 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='osd.1 [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T07:46:24.924 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='osd.1 [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial016", "root=default"]} : dispatch 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:24.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:24 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:25.316 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T07:46:24.920+0000 7fa10f71f640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T07:46:25.316 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T07:46:24.922+0000 7fa10b5e6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:46:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial043:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: osd.default does not exist. Creating it now. 2026-02-24T07:46:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: Creating OSDs with service ID: default on trial043:['vg_nvme/lv_4'] 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: Marking host: trial043 for OSDSpec preview refresh. 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: Saving service osd.default spec with placement trial043 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/2721838330' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c8029751-589f-4aba-90a4-a0cbecaac822"} : dispatch 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='osd.1 [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial016", "root=default"]}]': finished 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/2721838330' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8029751-589f-4aba-90a4-a0cbecaac822"}]': finished 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: osdmap e12: 3 total, 1 up, 3 in 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:26.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:26.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/3918749178' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:46:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:46:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:46:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: Detected new or changed devices on trial016 2026-02-24T07:46:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial016 to 42023M 2026-02-24T07:46:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:46:27.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: osd.1 [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715] boot 2026-02-24T07:46:27.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: osdmap e13: 3 total, 2 up, 3 in 2026-02-24T07:46:27.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:27.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:26 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T07:46:28.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:27 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:29.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:28 trial016 ceph-mon[39544]: Deploying daemon osd.2 on trial043 2026-02-24T07:46:29.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:28 trial016 ceph-mon[39544]: Deploying daemon osd.2 on trial043 2026-02-24T07:46:29.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:28 trial016 ceph-mon[39544]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:46:30.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:30 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:30.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:30 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:30.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:30 trial016 ceph-mon[39544]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:46:31.460 INFO:teuthology.orchestra.run.trial043.stdout:Created osd(s) 2 on host 'trial043' 2026-02-24T07:46:31.501 DEBUG:teuthology.orchestra.run.trial043:osd.2> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.2.service 2026-02-24T07:46:31.503 INFO:tasks.cephadm:Deploying osd.3 on trial043 with /dev/vg_nvme/lv_3... 2026-02-24T07:46:31.503 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T07:46:31.659 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:31.682 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:31 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T07:46:31.539+0000 7fdf1379b780 -1 osd.2 0 log_to_monitors true 2026-02-24T07:46:32.230 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:32.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:32.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:32.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:32.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:46:32.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:31 trial016 ceph-mon[39544]: from='osd.2 [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T07:46:32.474 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-24T07:46:32.490 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch daemon add osd trial043:vg_nvme/lv_3 --skip-validation 2026-02-24T07:46:32.611 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:32.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:32.715+0000 7fe883529640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:32.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:32.715+0000 7fe883529640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='osd.2 [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: osdmap e15: 3 total, 2 up, 3 in 2026-02-24T07:46:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='osd.2 [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial043", "root=default"]} : dispatch 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:33.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:32 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:33.721 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:33 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T07:46:33.461+0000 7fdf0f71d640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T07:46:33.721 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:33 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T07:46:33.464+0000 7fdf0b5e4640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:46:34.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial043:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:34.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: osd.default does not exist. Creating it now. 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: Creating OSDs with service ID: default on trial043:['vg_nvme/lv_3'] 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: Marking host: trial043 for OSDSpec preview refresh. 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: Saving service osd.default spec with placement trial043 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: Detected new or changed devices on trial043 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial043 to 89167M 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='osd.2 [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial043", "root=default"]}]': finished 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: osdmap e16: 3 total, 2 up, 3 in 2026-02-24T07:46:34.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/2328003513' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "89f56ad0-46e8-4029-a5b4-a47768c64a7a"} : dispatch 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/2328003513' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89f56ad0-46e8-4029-a5b4-a47768c64a7a"}]': finished 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: osd.2 [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778] boot 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: osdmap e17: 4 total, 3 up, 4 in 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:34.819 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/660295817' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:46:35.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:35 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:46:35.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:35 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:46:36.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T07:46:36.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:36.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: pgmap v29: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:46:36.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:46:36.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T07:46:36.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:36.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T07:46:36.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:36 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:37.762 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: Deploying daemon osd.3 on trial043 2026-02-24T07:46:37.762 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: Deploying daemon osd.3 on trial043 2026-02-24T07:46:37.762 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T07:46:37.763 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T07:46:37.763 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:37.763 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:46:37.763 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71569]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:46:37.763 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71569]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71569]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71573]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71577]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:46:37.764 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71577]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71577]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.765 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71581]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:37.908 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54100]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:46:37.908 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54100]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.908 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.908 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54100]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:37.909 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54160]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:46:37.909 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54160]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:37.909 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:37.909 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 07:46:37 trial043 sudo[54160]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71585]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-24T07:46:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71585]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71585]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71589]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-24T07:46:38.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71589]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:46:38.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:46:38.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:37 trial016 sudo[71589]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:46:38.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:46:38.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T07:46:38.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:38.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: pgmap v32: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T07:46:38.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:38 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:39.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:39 trial016 ceph-mon[39544]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T07:46:39.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:39 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:40.054 INFO:teuthology.orchestra.run.trial043.stdout:Created osd(s) 3 on host 'trial043' 2026-02-24T07:46:40.100 DEBUG:teuthology.orchestra.run.trial043:osd.3> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.3.service 2026-02-24T07:46:40.103 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-02-24T07:46:40.103 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:46:40.226 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:40.340 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:40.336+0000 7f08e3dba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:40.340 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:40.337+0000 7f08e3dba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:40.400 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 07:46:40 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T07:46:40.188+0000 7f108fe83780 -1 osd.3 0 log_to_monitors true 2026-02-24T07:46:40.447 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:40.484 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1771919193,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":0} 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:40.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='osd.3 [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T07:46:40.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3460481955' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:46:40.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: mgrmap e14: x(active, since 46s) 2026-02-24T07:46:40.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:40.784 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:40 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:41.486 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:46:41.604 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:41.706 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:41.703+0000 7f8f4b43a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:41.707 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:41.703+0000 7f8f4b43a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:41.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:41.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:41.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:41.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:41.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:41.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='osd.3 [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T07:46:41.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T07:46:41.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:41.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:41 trial016 ceph-mon[39544]: from='osd.3 [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial043", "root=default"]} : dispatch 2026-02-24T07:46:41.817 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:41.858 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":22,"num_osds":4,"num_up_osds":3,"osd_up_since":1771919193,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":0} 2026-02-24T07:46:42.343 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 07:46:42 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T07:46:42.055+0000 7f108be05640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T07:46:42.343 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 07:46:42 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T07:46:42.057+0000 7f1087ccc640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:46:42.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:46:42.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/52198509' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:46:42.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:42.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='osd.3 [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial043", "root=default"]}]': finished 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: osdmap e23: 4 total, 3 up, 4 in 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:42.818 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:42 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:42.859 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:46:42.978 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:43.079 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.076+0000 7f95ac68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.080 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.076+0000 7f95ac68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.189 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:43.241 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":24,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1} 2026-02-24T07:46:43.242 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:46:43.357 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:43.454 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.450+0000 7f0418481640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.454 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.451+0000 7f0418481640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.566 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:43.566 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":24,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","created":"2026-02-24T07:45:33.912476+0000","modified":"2026-02-24T07:46:43.054636+0000","last_up_change":"2026-02-24T07:46:43.054636+0000","last_in_change":"2026-02-24T07:46:33.899592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:46:35.731149+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22020e1a-4666-4547-975e-a1c54d782ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6803","nonce":535869433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6805","nonce":535869433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6809","nonce":535869433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6807","nonce":535869433}]},"public_addr":"10.20.193.16:6803/535869433","cluster_addr":"10.20.193.16:6805/535869433","heartbeat_back_addr":"10.20.193.16:6809/535869433","heartbeat_front_addr":"10.20.193.16:6807/535869433","state":["exists","up"]},{"osd":1,"uuid":"121f0fef-9a82-4630-97c6-fdecadf14a25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6811","nonce":157128715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6813","nonce":157128715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6817","nonce":157128715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6815","nonce":157128715}]},"public_addr":"10.20.193.16:6811/157128715","cluster_addr":"10.20.193.16:6813/157128715","heartbeat_back_addr":"10.20.193.16:6817/157128715","heartbeat_front_addr":"10.20.193.16:6815/157128715","state":["exists","up"]},{"osd":2,"uuid":"c8029751-589f-4aba-90a4-a0cbecaac822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6800","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6801","nonce":3201731778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6802","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6803","nonce":3201731778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6806","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6807","nonce":3201731778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6804","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6805","nonce":3201731778}]},"public_addr":"10.20.193.43:6801/3201731778","cluster_addr":"10.20.193.43:6803/3201731778","heartbeat_back_addr":"10.20.193.43:6807/3201731778","heartbeat_front_addr":"10.20.193.43:6805/3201731778","state":["exists","up"]},{"osd":3,"uuid":"89f56ad0-46e8-4029-a5b4-a47768c64a7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6808","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6809","nonce":563824018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6810","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6811","nonce":563824018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6814","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6815","nonce":563824018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6812","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6813","nonce":563824018}]},"public_addr":"10.20.193.43:6809/563824018","cluster_addr":"10.20.193.43:6811/563824018","heartbeat_back_addr":"10.20.193.43:6815/563824018","heartbeat_front_addr":"10.20.193.43:6813/563824018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:15.545610+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:24.320390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:32.515271+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.16:6800/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3304616791":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6801/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3946948853":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/823394954":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/1863982042":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6801/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/3890433861":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6800/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/1699817835":"2026-02-25T07:45:43.999704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:46:43.606 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T07:46:35.731149+0000', 'flags': 262145, 'flags_names': 'hashpspool,crimson', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T07:46:43.606 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-24T07:46:43.723 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: Detected new or changed devices on trial043 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial043 to 44583M 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: osd.3 [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018] boot 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: osdmap e24: 4 total, 4 up, 4 in 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:43.746 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3464759660' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:46:43.835 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.832+0000 7f2f930f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.836 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:43.832+0000 7f2f930f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:43.945 INFO:teuthology.orchestra.run.trial016.stdout:pg_num: 1 2026-02-24T07:46:43.981 INFO:tasks.cephadm:Adding prometheus.a on trial043 2026-02-24T07:46:43.982 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch apply prometheus '1;trial043=a' 2026-02-24T07:46:44.098 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:44.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:44.196+0000 7fe97509c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:44.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:44.197+0000 7fe97509c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:44.318 INFO:teuthology.orchestra.run.trial043.stdout:Scheduled prometheus update... 2026-02-24T07:46:44.372 DEBUG:teuthology.orchestra.run.trial043:prometheus.a> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@prometheus.a.service 2026-02-24T07:46:44.374 INFO:tasks.cephadm:Adding node-exporter.a on trial016 2026-02-24T07:46:44.374 INFO:tasks.cephadm:Adding node-exporter.b on trial043 2026-02-24T07:46:44.375 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph orch apply node-exporter '2;trial016=a;trial043=b' 2026-02-24T07:46:44.531 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:44.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:44.631+0000 7f83eaee7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:44.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:44.632+0000 7f83eaee7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:44.755 INFO:teuthology.orchestra.run.trial043.stdout:Scheduled node-exporter update... 2026-02-24T07:46:44.794 DEBUG:teuthology.orchestra.run.trial016:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.a.service 2026-02-24T07:46:44.797 DEBUG:teuthology.orchestra.run.trial043:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.b.service 2026-02-24T07:46:44.800 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T07:46:44.800 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: pgmap v39: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2055496117' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1779459110' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: osdmap e25: 4 total, 4 up, 4 in 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: 1.0 starting backfill to osd.3 from (0'0,0'0] MAX to 20'92 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:44.835 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:44 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:44.949 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:45.059 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:45.056+0000 7f58ff6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:45.059 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:45.057+0000 7f58ff6d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:45.209 INFO:teuthology.orchestra.run.trial016.stdout:[client.0] 2026-02-24T07:46:45.209 INFO:teuthology.orchestra.run.trial016.stdout: key = AQBlV51pFf9qDBAA/gVNf/00hjgA8+B9R6nQZg== 2026-02-24T07:46:45.247 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-24T07:46:45.247 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T07:46:45.247 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T07:46:45.281 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T07:46:45.400 INFO:teuthology.orchestra.run.trial043.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:45.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:45.515+0000 7fe2a69c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:45.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-24T07:46:45.515+0000 7fe2a69c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:45.672 INFO:teuthology.orchestra.run.trial043.stdout:[client.1] 2026-02-24T07:46:45.673 INFO:teuthology.orchestra.run.trial043.stdout: key = AQBlV51pOhH4JxAAHMoAzPLHcZXoQGf63UPQ6Q== 2026-02-24T07:46:45.710 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-24T07:46:45.711 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-24T07:46:45.711 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-24T07:46:45.747 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-24T07:46:45.863 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;trial043=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: Saving service prometheus spec with placement trial043=a;count:1 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='client.14255 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;trial016=a;trial043=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: Saving service node-exporter spec with placement trial016=a;trial043=b;count:2 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.914 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3265971135' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3265971135' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:45 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:45.966 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:45.963+0000 7fccf9b67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:45.966 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:45.963+0000 7fccf9b67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:46.076 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:46.112 INFO:teuthology.orchestra.run.trial016.stdout:[{"version":13,"timestamp":"2026-02-24T07:46:41.836342+0000","name":"","changes":[{"name":"osd/host:trial043/osd_memory_target","previous_value":"93498632192","new_value":"46749316096"}]}] 2026-02-24T07:46:46.113 INFO:tasks.ceph_manager:config epoch is 13 2026-02-24T07:46:46.113 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T07:46:46.113 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T07:46:46.113 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T07:46:46.227 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:46.323 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:46.320+0000 7f3069206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:46.323 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:46.320+0000 7f3069206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:46.464 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:46.498 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":14,"flags":0,"active_gid":14154,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6800","nonce":540268995},{"type":"v1","addr":"10.20.193.16:6801","nonce":540268995}]},"active_addr":"10.20.193.16:6801/540268995","active_change":"2026-02-24T07:45:53.520925+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.16:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":2594083080}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":1404893956}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":3708454832}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":2716152770}]}]} 2026-02-24T07:46:46.499 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T07:46:46.499 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T07:46:46.499 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:46:46.617 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:46.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:46.712+0000 7fe77afa0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:46.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:46.712+0000 7fe77afa0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: pgmap v41: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: Deploying daemon prometheus.a on trial043 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/370313682' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.43:0/370313682' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4099310594' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T07:46:46.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1481535887' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T07:46:46.825 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:46.825 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":25,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","created":"2026-02-24T07:45:33.912476+0000","modified":"2026-02-24T07:46:44.055489+0000","last_up_change":"2026-02-24T07:46:43.054636+0000","last_in_change":"2026-02-24T07:46:33.899592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:46:35.731149+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22020e1a-4666-4547-975e-a1c54d782ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6803","nonce":535869433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6805","nonce":535869433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6809","nonce":535869433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6807","nonce":535869433}]},"public_addr":"10.20.193.16:6803/535869433","cluster_addr":"10.20.193.16:6805/535869433","heartbeat_back_addr":"10.20.193.16:6809/535869433","heartbeat_front_addr":"10.20.193.16:6807/535869433","state":["exists","up"]},{"osd":1,"uuid":"121f0fef-9a82-4630-97c6-fdecadf14a25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6811","nonce":157128715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6813","nonce":157128715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6817","nonce":157128715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6815","nonce":157128715}]},"public_addr":"10.20.193.16:6811/157128715","cluster_addr":"10.20.193.16:6813/157128715","heartbeat_back_addr":"10.20.193.16:6817/157128715","heartbeat_front_addr":"10.20.193.16:6815/157128715","state":["exists","up"]},{"osd":2,"uuid":"c8029751-589f-4aba-90a4-a0cbecaac822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6800","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6801","nonce":3201731778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6802","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6803","nonce":3201731778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6806","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6807","nonce":3201731778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6804","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6805","nonce":3201731778}]},"public_addr":"10.20.193.43:6801/3201731778","cluster_addr":"10.20.193.43:6803/3201731778","heartbeat_back_addr":"10.20.193.43:6807/3201731778","heartbeat_front_addr":"10.20.193.43:6805/3201731778","state":["exists","up"]},{"osd":3,"uuid":"89f56ad0-46e8-4029-a5b4-a47768c64a7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6808","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6809","nonce":563824018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6810","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6811","nonce":563824018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6814","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6815","nonce":563824018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6812","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6813","nonce":563824018}]},"public_addr":"10.20.193.43:6809/563824018","cluster_addr":"10.20.193.43:6811/563824018","heartbeat_back_addr":"10.20.193.43:6815/563824018","heartbeat_front_addr":"10.20.193.43:6813/563824018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:15.545610+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:24.320390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:32.515271+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:41.156068+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.16:6800/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3304616791":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6801/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3946948853":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/823394954":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/1863982042":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6801/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/3890433861":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6800/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/1699817835":"2026-02-25T07:45:43.999704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:46:46.864 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T07:46:46.865 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:46:46.980 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.076 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.073+0000 7f132150a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.076 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.074+0000 7f132150a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.186 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:47.187 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":25,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","created":"2026-02-24T07:45:33.912476+0000","modified":"2026-02-24T07:46:44.055489+0000","last_up_change":"2026-02-24T07:46:43.054636+0000","last_in_change":"2026-02-24T07:46:33.899592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:46:35.731149+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22020e1a-4666-4547-975e-a1c54d782ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6803","nonce":535869433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6805","nonce":535869433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6809","nonce":535869433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6807","nonce":535869433}]},"public_addr":"10.20.193.16:6803/535869433","cluster_addr":"10.20.193.16:6805/535869433","heartbeat_back_addr":"10.20.193.16:6809/535869433","heartbeat_front_addr":"10.20.193.16:6807/535869433","state":["exists","up"]},{"osd":1,"uuid":"121f0fef-9a82-4630-97c6-fdecadf14a25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6811","nonce":157128715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6813","nonce":157128715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6817","nonce":157128715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6815","nonce":157128715}]},"public_addr":"10.20.193.16:6811/157128715","cluster_addr":"10.20.193.16:6813/157128715","heartbeat_back_addr":"10.20.193.16:6817/157128715","heartbeat_front_addr":"10.20.193.16:6815/157128715","state":["exists","up"]},{"osd":2,"uuid":"c8029751-589f-4aba-90a4-a0cbecaac822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6800","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6801","nonce":3201731778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6802","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6803","nonce":3201731778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6806","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6807","nonce":3201731778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6804","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6805","nonce":3201731778}]},"public_addr":"10.20.193.43:6801/3201731778","cluster_addr":"10.20.193.43:6803/3201731778","heartbeat_back_addr":"10.20.193.43:6807/3201731778","heartbeat_front_addr":"10.20.193.43:6805/3201731778","state":["exists","up"]},{"osd":3,"uuid":"89f56ad0-46e8-4029-a5b4-a47768c64a7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6808","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6809","nonce":563824018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6810","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6811","nonce":563824018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6814","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6815","nonce":563824018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6812","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6813","nonce":563824018}]},"public_addr":"10.20.193.43:6809/563824018","cluster_addr":"10.20.193.43:6811/563824018","heartbeat_back_addr":"10.20.193.43:6815/563824018","heartbeat_front_addr":"10.20.193.43:6813/563824018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:15.545610+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:24.320390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:32.515271+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:46:41.156068+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.16:6800/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3304616791":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6801/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3946948853":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/823394954":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/1863982042":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6801/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/3890433861":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6800/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/1699817835":"2026-02-25T07:45:43.999704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:46:47.223 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T07:46:47.223 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T07:46:47.224 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T07:46:47.224 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T07:46:47.343 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.344 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.344 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.348 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.456 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.454+0000 7fb449ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.457 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.454+0000 7f6c190be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.457 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.454+0000 7fb449ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.458 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.454+0000 7f6c190be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.458 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.455+0000 7fc37431a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.458 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.455+0000 7fc37431a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.455+0000 7fcad7343640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.455+0000 7fcad7343640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.507 INFO:teuthology.orchestra.run.trial016.stdout:103079215106 2026-02-24T07:46:47.508 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T07:46:47.513 INFO:teuthology.orchestra.run.trial016.stdout:38654705672 2026-02-24T07:46:47.514 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T07:46:47.520 INFO:teuthology.orchestra.run.trial016.stdout:73014444036 2026-02-24T07:46:47.521 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T07:46:47.523 INFO:teuthology.orchestra.run.trial016.stdout:55834574854 2026-02-24T07:46:47.524 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T07:46:47.626 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.631 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.682 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.682 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:47.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.738+0000 7f094188d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.739+0000 7f094188d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.738+0000 7f4f67458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.739+0000 7f4f67458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.786 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.782+0000 7fcb58e31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.786 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.782+0000 7fcb58e31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.787 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.783+0000 7f847a0b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.787 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:47.784+0000 7f847a0b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:47.854 INFO:teuthology.orchestra.run.trial016.stdout:103079215106 2026-02-24T07:46:47.856 INFO:teuthology.orchestra.run.trial016.stdout:38654705672 2026-02-24T07:46:47.896 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215106 got 103079215106 for osd.3 2026-02-24T07:46:47.896 DEBUG:teuthology.parallel:result is None 2026-02-24T07:46:47.896 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 systemd[1]: Started Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:46:47.898 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2026-02-24T07:46:47.898 DEBUG:teuthology.parallel:result is None 2026-02-24T07:46:47.898 INFO:teuthology.orchestra.run.trial016.stdout:55834574854 2026-02-24T07:46:47.898 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/997296631' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:46:47.899 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4290447844' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:46:47.904 INFO:teuthology.orchestra.run.trial016.stdout:73014444036 2026-02-24T07:46:47.939 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2026-02-24T07:46:47.939 DEBUG:teuthology.parallel:result is None 2026-02-24T07:46:47.943 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444036 got 73014444036 for osd.2 2026-02-24T07:46:47.943 DEBUG:teuthology.parallel:result is None 2026-02-24T07:46:47.943 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T07:46:47.943 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:48.097 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:48.195 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.192+0000 7f630a1df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:48.195 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.192+0000 7f630a1df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.894Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.895Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.895Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212527104 previous=9223372036854775807 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.895Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.895Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial043 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T07:46:48.246 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.896Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.897Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.897Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.897Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.898Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.898Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=982ns 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.898Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.899Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=0 duration=881.884µs 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.899Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=18.193µs wal_replay_duration=896.051µs wbl_replay_duration=120ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=982ns total_replay_duration=976.299µs 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.900Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.900Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T07:46:48.247 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.900Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T07:46:48.248 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.910Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=852ns remote_storage=1.222µs web_handler=441ns query_engine=310ns scrape=343.517µs scrape_sd=32.37µs notify=741ns notify_sd=431ns rules=9.713341ms tracing=4.568µs filename=/etc/prometheus/prometheus.yml totalDuration=10.26257ms 2026-02-24T07:46:48.248 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.910Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T07:46:48.248 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:47 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:47.910Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T07:46:48.304 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:48.305 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:48.340 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-24T07:46:47.529439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110428,"kb_used_data":2572,"kb_used_omap":37,"kb_used_meta":107738,"kb_avail":2935902372,"statfs":{"total":3006477107200,"available":3006364028928,"internally_reserved":0,"allocated":2633728,"data_stored":2055916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38356,"internal_metadata":110324268},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000683"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":136,"reported_epoch":25,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:44.227232+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:44.227232+0000","last_peered":"2026-02-24T07:46:44.227232+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:44.227232+0000","last_undegraded":"2026-02-24T07:46:44.227232+0000","last_fullsized":"2026-02-24T07:46:44.227232+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215106,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11375,"internal_metadata":27579281},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:48.341 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:48.456 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:48.556 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.553+0000 7f3ddac3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:48.556 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.553+0000 7f3ddac3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:48.663 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:48.664 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:48.700 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-24T07:46:47.529439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110428,"kb_used_data":2572,"kb_used_omap":37,"kb_used_meta":107738,"kb_avail":2935902372,"statfs":{"total":3006477107200,"available":3006364028928,"internally_reserved":0,"allocated":2633728,"data_stored":2055916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38356,"internal_metadata":110324268},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000683"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":136,"reported_epoch":25,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:44.227232+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:44.227232+0000","last_peered":"2026-02-24T07:46:44.227232+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:44.227232+0000","last_undegraded":"2026-02-24T07:46:44.227232+0000","last_fullsized":"2026-02-24T07:46:44.227232+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215106,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11375,"internal_metadata":27579281},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":661571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:48.701 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: pgmap v42: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2253790971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1889732322' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1362810230' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T07:46:48.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/425188084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T07:46:48.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:48.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:48.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:48.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:48 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-24T07:46:48.817 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:48.916 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.913+0000 7fbc1782e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:48.917 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:48.913+0000 7fbc1782e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:49.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:48 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setuser ceph since I am not root 2026-02-24T07:46:49.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:48 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ignoring --setgroup ceph since I am not root 2026-02-24T07:46:49.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:48 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:46:48.954+0000 7f3f31f85fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:49.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:48 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:46:48.956+0000 7f3f31f85fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:49.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:48 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:46:48.957+0000 7f3f31f85fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:50.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:49 trial016 ceph-mon[39544]: from='client.14285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:50.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:49 trial016 ceph-mon[39544]: from='client.14287 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:50.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:49 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' 2026-02-24T07:46:50.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:49 trial016 ceph-mon[39544]: from='mgr.14154 10.20.193.16:0/1336106990' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-24T07:46:50.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:49 trial016 ceph-mon[39544]: mgrmap e15: x(active, since 55s) 2026-02-24T07:46:50.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:49 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:46:50.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:49 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:46:50.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:49 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: from numpy import show_config as show_numpy_config 2026-02-24T07:46:52.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: Active manager daemon x restarted 2026-02-24T07:46:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: Activating manager daemon x 2026-02-24T07:46:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: osdmap e26: 4 total, 4 up, 4 in 2026-02-24T07:46:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: mgrmap e16: x(active, starting, since 0.00319717s) 2026-02-24T07:46:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:46:52.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:46:52.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:46:52.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:46:52.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:46:52.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:46:52.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:46:52.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:46:52.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:46:52.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:51 trial016 ceph-mon[39544]: Manager daemon x is now available 2026-02-24T07:46:52.742 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:52.743 INFO:teuthology.orchestra.run.trial016.stderr:Warning: due to ceph-mgr restart, some PG states may not be up to date 2026-02-24T07:46:52.743 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:52.782 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":false,"pg_map":{"version":2,"stamp":"2026-02-24T07:46:51.741711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:46:51.735998+0000","last_change":"2026-02-24T07:46:51.735998+0000","last_active":"2026-02-24T07:46:51.735998+0000","last_peered":"2026-02-24T07:46:51.735998+0000","last_clean":"2026-02-24T07:46:51.735998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:46:51.735998+0000","last_undegraded":"2026-02-24T07:46:51.735998+0000","last_fullsized":"2026-02-24T07:46:51.735998+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:51.735998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:51.735998+0000","last_clean_scrub_stamp":"2026-02-24T07:46:51.735998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[],"pool_statfs":[]}} 2026-02-24T07:46:52.783 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:46:52.783 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2026-02-24T07:46:51.735998+0000', 'last_change': '2026-02-24T07:46:51.735998+0000', 'last_active': '2026-02-24T07:46:51.735998+0000', 'last_peered': '2026-02-24T07:46:51.735998+0000', 'last_clean': '2026-02-24T07:46:51.735998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2026-02-24T07:46:51.735998+0000', 'last_undegraded': '2026-02-24T07:46:51.735998+0000', 'last_fullsized': '2026-02-24T07:46:51.735998+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:51.735998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:51.735998+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:51.735998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2026-02-24T07:46:52.783 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:46:52.901 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:53.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:53.007+0000 7f2df21cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:53.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:53.007+0000 7f2df21cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:53.009 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:52 trial016 ceph-mon[39544]: mgrmap e17: x(active, since 1.00549s) 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:52] ENGINE Bus STARTING 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: CherryPy Checker: 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: The Application mounted at '' has an empty config. 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:52] ENGINE Serving on http://:::9283 2026-02-24T07:46:53.010 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:52 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:52] ENGINE Bus STARTED 2026-02-24T07:46:53.161 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:53.161 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113078272,"bytes_avail":3006364028928,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{"0fa6c74d-872c-4424-82da-6fc0035a78da":{"message":"Updating prometheus deployment (+1 -> 1) (0s)\n [............................] ","progress":0,"add_to_ceph_s":true}}} 2026-02-24T07:46:53.217 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:46:53.217 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:53.331 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:53.432 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:53.430+0000 7f2ac0bc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:53.433 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:53.430+0000 7f2ac0bc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:53.543 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:53.543 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:53.670 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2026-02-24T07:46:52.743326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110452,"kb_used_data":2596,"kb_used_omap":39,"kb_used_meta":107736,"kb_avail":2935902348,"statfs":{"total":3006477107200,"available":3006364004352,"internally_reserved":0,"allocated":2658304,"data_stored":2068888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40323,"internal_metadata":110322301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":138,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:51.737686+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:51.737686+0000","last_peered":"2026-02-24T07:46:51.737686+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:51.737686+0000","last_undegraded":"2026-02-24T07:46:51.737686+0000","last_fullsized":"2026-02-24T07:46:51.737686+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:54.066 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:53 trial016 bash[79239]: Trying to pull quay.io/prometheus/node-exporter:v1.9.1... 2026-02-24T07:46:54.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: [24/Feb/2026:07:46:52] ENGINE Bus STARTING 2026-02-24T07:46:54.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: [24/Feb/2026:07:46:52] ENGINE Serving on http://10.20.193.16:8765 2026-02-24T07:46:54.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: [24/Feb/2026:07:46:52] ENGINE Serving on https://10.20.193.16:7150 2026-02-24T07:46:54.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: [24/Feb/2026:07:46:52] ENGINE Bus STARTED 2026-02-24T07:46:54.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: [24/Feb/2026:07:46:52] ENGINE Client ('10.20.193.16', 34550) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: pgmap v3: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial043 to 44071M 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: Updating trial016:/etc/ceph/ceph.conf 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: Updating trial043:/etc/ceph/ceph.conf 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3935864479' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:54.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.070 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:53 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:54.404 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Getting image source signatures 2026-02-24T07:46:54.404 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-24T07:46:54.404 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-24T07:46:54.405 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-24T07:46:54.405 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-24T07:46:54.405 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: Writing manifest to image destination 2026-02-24T07:46:54.405 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 podman[79239]: 2026-02-24 07:46:54.38190906 +0000 UTC m=+0.521238267 container create 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 podman[79239]: 2026-02-24 07:46:54.404591174 +0000 UTC m=+0.543920381 container init 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 podman[79239]: 2026-02-24 07:46:54.406668527 +0000 UTC m=+0.545997734 container start 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 bash[79239]: 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 podman[79239]: 2026-02-24 07:46:54.376862651 +0000 UTC m=+0.516191858 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.409Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-24T07:46:54.817 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.409Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 systemd[1]: Started Ceph node-exporter.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-24T07:46:54.818 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-24T07:46:54.819 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.410Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-24T07:46:54.820 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=os 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-24T07:46:54.821 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=time 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-24T07:46:54.822 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a[79363]: time=2026-02-24T07:46:54.411Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-24T07:46:55.245 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:54 trial043 bash[64934]: Trying to pull quay.io/prometheus/node-exporter:v1.9.1... 2026-02-24T07:46:55.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:46:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:46:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial016:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial043:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.conf 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial016:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial043:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial016:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Updating trial043:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: Deploying daemon node-exporter.a on trial016 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: pgmap v4: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:46:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: mgrmap e18: x(active, since 2s) 2026-02-24T07:46:55.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.704 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Getting image source signatures 2026-02-24T07:46:55.704 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-24T07:46:55.704 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-24T07:46:55.704 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: Writing manifest to image destination 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 podman[64934]: 2026-02-24 07:46:55.397133617 +0000 UTC m=+0.437430932 container create 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 podman[64934]: 2026-02-24 07:46:55.419986892 +0000 UTC m=+0.460284217 container init 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 podman[64934]: 2026-02-24 07:46:55.422023146 +0000 UTC m=+0.462320471 container start 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 bash[64934]: 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 podman[64934]: 2026-02-24 07:46:55.390867304 +0000 UTC m=+0.431164629 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.424Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.424Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-24T07:46:55.705 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 systemd[1]: Started Ceph node-exporter.b for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-24T07:46:55.706 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-24T07:46:55.707 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=os 2026-02-24T07:46:55.708 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-24T07:46:55.709 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=time 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.425Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.426Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-24T07:46:55.710 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 07:46:55 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b[64981]: time=2026-02-24T07:46:55.426Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-24T07:46:55.956 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: Deploying daemon node-exporter.b on trial043 2026-02-24T07:46:55.956 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.956 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.956 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.956 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.957 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:55.957 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:56.485 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 systemd[1]: Stopping Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.442Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T07:46:56.486 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[63564]: time=2026-02-24T07:46:56.443Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65629]: 2026-02-24 07:46:56.453197181 +0000 UTC m=+0.023150447 container died f8f804a025099935a66ee0b1f53c83ea58825da3e7db44568abfb98d0d07f2ba (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:46:56.487 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65629]: 2026-02-24 07:46:56.460596554 +0000 UTC m=+0.030549820 container remove f8f804a025099935a66ee0b1f53c83ea58825da3e7db44568abfb98d0d07f2ba (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T07:46:56.488 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 bash[65629]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a 2026-02-24T07:46:56.671 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:56.791 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:56.903 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:56.900+0000 7fbe9d9e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:56.903 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:56.901+0000 7fbe9d9e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:56.951 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:56 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:56] ENGINE Bus STOPPING 2026-02-24T07:46:56.951 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:56 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:56] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T07:46:56.951 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:56 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:56] ENGINE Bus STOPPED 2026-02-24T07:46:56.951 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: pgmap v5: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:56.952 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: mgrmap e19: x(active, since 4s) 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial043:9095"} : dispatch 2026-02-24T07:46:56.953 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:56.995 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@prometheus.a.service: Deactivated successfully. 2026-02-24T07:46:56.995 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 systemd[1]: Stopped Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 systemd[1]: Starting Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65756]: 2026-02-24 07:46:56.622218431 +0000 UTC m=+0.017281559 container create 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65756]: 2026-02-24 07:46:56.650102129 +0000 UTC m=+0.045165277 container init 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65756]: 2026-02-24 07:46:56.652445522 +0000 UTC m=+0.047508650 container start 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 bash[65756]: 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 podman[65756]: 2026-02-24 07:46:56.615050156 +0000 UTC m=+0.010113294 image pull 4fcecf061b747d0b5dc55bc7efdba26f87768d058d403b5bcc3f0904cf49f973 quay.io/prometheus/prometheus:v3.6.0 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 systemd[1]: Started Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.677Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T07:46:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.677Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.677Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212527104 previous=9223372036854775807 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.677Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.677Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial043 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.679Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.680Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.680Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.680Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.682Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.682Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=772ns 2026-02-24T07:46:56.997 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.682Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.682Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=1 duration=420.169µs 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.683Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=1 maxSegment=1 duration=819.138µs 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.683Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=13.895µs wal_replay_duration=1.254475ms wbl_replay_duration=171ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=772ns total_replay_duration=1.290041ms 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.684Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.684Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.684Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.694Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=541ns remote_storage=731ns web_handler=211ns query_engine=430ns scrape=358.515µs scrape_sd=51.425µs notify=811ns notify_sd=381ns rules=9.115985ms tracing=4.318µs filename=/etc/prometheus/prometheus.yml totalDuration=9.67994ms 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.694Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T07:46:56.998 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 07:46:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T07:46:56.694Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T07:46:57.011 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:57.011 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:57.049 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-24T07:46:55.741559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110452,"kb_used_data":2596,"kb_used_omap":39,"kb_used_meta":107736,"kb_avail":2935902348,"statfs":{"total":3006477107200,"available":3006364004352,"internally_reserved":0,"allocated":2658304,"data_stored":2068888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40323,"internal_metadata":110322301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.998232"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":138,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:51.737686+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:51.737686+0000","last_peered":"2026-02-24T07:46:51.737686+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:51.737686+0000","last_undegraded":"2026-02-24T07:46:51.737686+0000","last_fullsized":"2026-02-24T07:46:51.737686+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:57.050 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:57.166 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:57.221 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:56 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:56] ENGINE Bus STARTING 2026-02-24T07:46:57.221 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:57 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:57] ENGINE Serving on http://:::9283 2026-02-24T07:46:57.221 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:46:57 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:46:57] ENGINE Bus STARTED 2026-02-24T07:46:57.279 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:57.276+0000 7fce6a5c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:57.279 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:57.277+0000 7fce6a5c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:57.388 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:57.388 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:57.427 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-24T07:46:55.741559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110452,"kb_used_data":2596,"kb_used_omap":39,"kb_used_meta":107736,"kb_avail":2935902348,"statfs":{"total":3006477107200,"available":3006364004352,"internally_reserved":0,"allocated":2658304,"data_stored":2068888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40323,"internal_metadata":110322301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.998232"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":138,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:51.737686+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:51.737686+0000","last_peered":"2026-02-24T07:46:51.737686+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:51.737686+0000","last_undegraded":"2026-02-24T07:46:51.737686+0000","last_fullsized":"2026-02-24T07:46:51.737686+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:57.428 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:46:57.429 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "20'92", 'reported_seq': 138, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:46:51.737686+0000', 'last_change': '2026-02-24T07:46:44.227232+0000', 'last_active': '2026-02-24T07:46:51.737686+0000', 'last_peered': '2026-02-24T07:46:51.737686+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:46:51.737686+0000', 'last_undegraded': '2026-02-24T07:46:51.737686+0000', 'last_fullsized': '2026-02-24T07:46:51.737686+0000', 'mapping_epoch': 24, 'log_start': "20'89", 'ondisk_log_start': "20'89", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 89, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 76, 'num_read_kb': 64, 'num_write': 123, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:46:57.429 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:46:57.545 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:57.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:57.644+0000 7fd6d916d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:57.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:57.644+0000 7fd6d916d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:57.798 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:57.798 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113102848,"bytes_avail":3006364004352,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:46:57.834 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:46:57.834 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:46:57.952 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:46:58.051 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:58.049+0000 7f7376dde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:58.051 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:46:58.049+0000 7f7376dde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:46:58.160 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:46:58.161 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:46:58.161 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: Reconfiguring prometheus.a deps ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:False', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] -> ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:True', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] (diff {'node-exporter_configured:True', 'node-exporter_configured:False'}) 2026-02-24T07:46:58.161 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: Reconfiguring daemon prometheus.a on trial043 2026-02-24T07:46:58.161 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial043:9095"}]: dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: Certificate for "cephadm-signed_agent_cert (trial016)" is still valid for 1824 days. 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:46:58.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:46:58.163 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/382416709' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:46:58.198 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2026-02-24T07:46:57.741782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110452,"kb_used_data":2596,"kb_used_omap":39,"kb_used_meta":107736,"kb_avail":2935902348,"statfs":{"total":3006477107200,"available":3006364004352,"internally_reserved":0,"allocated":2658304,"data_stored":2068888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40323,"internal_metadata":110322301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.998456"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":138,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:51.737686+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:51.737686+0000","last_peered":"2026-02-24T07:46:51.737686+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:51.737686+0000","last_undegraded":"2026-02-24T07:46:51.737686+0000","last_fullsized":"2026-02-24T07:46:51.737686+0000","mapping_epoch":24,"log_start":"20'89","ondisk_log_start":"20'89","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":89,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27172,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":733976028,"statfs":{"total":751619276800,"available":751591452672,"internally_reserved":0,"allocated":212992,"data_stored":71203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4863,"internal_metadata":27585793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:46:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:58 trial016 ceph-mon[39544]: from='client.14305 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:58 trial016 ceph-mon[39544]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:46:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:58 trial016 ceph-mon[39544]: pgmap v6: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:46:59 trial016 ceph-mon[39544]: from='client.14311 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:01.199 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:01.225 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:00 trial016 ceph-mon[39544]: pgmap v7: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:01.322 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:01.421 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:01.419+0000 7f4a748f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:01.422 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:01.419+0000 7f4a748f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:01.530 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:01.531 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:01.586 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2026-02-24T07:46:59.742075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.998749"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:01.586 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:01.740 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:01.841 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:01.839+0000 7f295c3bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:01.841 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:01.840+0000 7f295c3bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:01.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:01.951 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:01.990 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2026-02-24T07:47:01.742380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.999053"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:01.991 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:01.991 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 163, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:46:53.947312+0000', 'last_change': '2026-02-24T07:46:44.227232+0000', 'last_active': '2026-02-24T07:46:53.947312+0000', 'last_peered': '2026-02-24T07:46:53.947312+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:46:53.947312+0000', 'last_undegraded': '2026-02-24T07:46:53.947312+0000', 'last_fullsized': '2026-02-24T07:46:53.947312+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:01.991 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:02.108 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:02.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:02.213+0000 7f62d8ad8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:02.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:02.213+0000 7f62d8ad8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:02.365 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:02.365 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326,"read_bytes_sec":20026,"write_bytes_sec":0,"read_op_per_sec":6,"write_op_per_sec":1},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:02.404 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:02.404 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:02.520 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:02.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:02.619+0000 7fe87c197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:02.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:02.619+0000 7fe87c197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:02.733 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:02.734 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:02.771 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2026-02-24T07:47:01.742380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.999053"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:02 trial016 ceph-mon[39544]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:02 trial016 ceph-mon[39544]: pgmap v8: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:02 trial016 ceph-mon[39544]: from='client.14315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/926883605' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:03 trial016 ceph-mon[39544]: from='client.14319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:04 trial016 ceph-mon[39544]: pgmap v9: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:05.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:47:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:47:05.773 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:05.890 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:05.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:05.991+0000 7fb85664c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:05.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:05.991+0000 7fb85664c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:06.103 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:06.103 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:06.141 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-24T07:47:05.742862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001549"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:06.142 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:06.257 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:06.355 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:06.353+0000 7f131cc51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:06.356 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:06.354+0000 7f131cc51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:06.467 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:06.467 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:06.506 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-24T07:47:05.742862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001549"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:06.507 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:06.507 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 163, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:46:53.947312+0000', 'last_change': '2026-02-24T07:46:44.227232+0000', 'last_active': '2026-02-24T07:46:53.947312+0000', 'last_peered': '2026-02-24T07:46:53.947312+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:46:53.947312+0000', 'last_undegraded': '2026-02-24T07:46:53.947312+0000', 'last_fullsized': '2026-02-24T07:46:53.947312+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:06.507 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:06.625 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:06.721 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:06.719+0000 7f1f89827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:06.721 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:06.719+0000 7f1f89827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:06.872 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:06.872 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326,"read_bytes_sec":15016,"write_bytes_sec":0,"read_op_per_sec":4,"write_op_per_sec":0},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:06.907 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:06 trial016 ceph-mon[39544]: pgmap v10: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:06.909 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:06.909 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:07.025 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:07.131 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:07.128+0000 7ff59ef79640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:07.131 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:07.129+0000 7ff59ef79640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:07.241 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:07.242 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:07.281 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-24T07:47:05.742862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001549"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:07 trial016 ceph-mon[39544]: from='client.14321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:07 trial016 ceph-mon[39544]: from='client.14323 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2836123169' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:08 trial016 ceph-mon[39544]: from='client.14327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:08 trial016 ceph-mon[39544]: pgmap v11: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:10.283 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:10.398 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:10.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:10.494+0000 7fa1713b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:10.497 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:10.494+0000 7fa1713b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:10.605 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:10.605 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:10.640 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-24T07:47:09.743459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:10.642 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:10.757 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:10.856 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:10.854+0000 7f33f2188640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:10.856 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:10 trial016 ceph-mon[39544]: pgmap v12: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:10.857 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:10.854+0000 7f33f2188640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:10.964 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:10.965 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:11.000 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-24T07:47:09.743459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:11.001 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:11.001 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 163, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:46:53.947312+0000', 'last_change': '2026-02-24T07:46:44.227232+0000', 'last_active': '2026-02-24T07:46:53.947312+0000', 'last_peered': '2026-02-24T07:46:53.947312+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:46:53.947312+0000', 'last_undegraded': '2026-02-24T07:46:53.947312+0000', 'last_fullsized': '2026-02-24T07:46:53.947312+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:11.002 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:11.117 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:11.217 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:11.216+0000 7f1985df0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:11.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:11.216+0000 7f1985df0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:11.369 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:11.369 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326,"read_bytes_sec":15016,"write_bytes_sec":0,"read_op_per_sec":4,"write_op_per_sec":0},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:11.407 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:11.408 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:11.523 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:11.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:11.618+0000 7fca0e490640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:11.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:11.619+0000 7fca0e490640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:11.730 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:11.731 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:11.767 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-24T07:47:09.743459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:12.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:11 trial016 ceph-mon[39544]: from='client.14329 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:12.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/462339585' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:12 trial016 ceph-mon[39544]: from='client.14331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:12 trial016 ceph-mon[39544]: from='client.14335 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:12 trial016 ceph-mon[39544]: pgmap v13: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:14.769 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:14.889 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:14.991 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:14.989+0000 7f6ca70e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:14.989+0000 7f6ca70e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:15.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:14 trial016 ceph-mon[39544]: pgmap v14: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:15.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:47:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:47:15.103 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:15.103 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:15.140 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-24T07:47:13.743828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001447"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:15.141 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:15.257 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:15.360 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:15.358+0000 7fa9f18d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:15.360 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:15.358+0000 7fa9f18d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:15.468 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:15.468 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:15.505 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-24T07:47:13.743828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001447"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:15.506 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:15.506 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 163, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:46:53.947312+0000', 'last_change': '2026-02-24T07:46:44.227232+0000', 'last_active': '2026-02-24T07:46:53.947312+0000', 'last_peered': '2026-02-24T07:46:53.947312+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:46:53.947312+0000', 'last_undegraded': '2026-02-24T07:46:53.947312+0000', 'last_fullsized': '2026-02-24T07:46:53.947312+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:15.507 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:15.622 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:15.722 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:15.720+0000 7fd520fce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:15.723 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:15.720+0000 7fd520fce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:15.875 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:15.875 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":101,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:15.927 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:15.927 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:16.043 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:16.140 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:16.138+0000 7fd403fe1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:16.141 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:16.138+0000 7fd403fe1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:16.248 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:16.249 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:16.283 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-24T07:47:15.744103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001522"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":163,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:46:53.947312+0000","last_change":"2026-02-24T07:46:44.227232+0000","last_active":"2026-02-24T07:46:53.947312+0000","last_peered":"2026-02-24T07:46:53.947312+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:46:53.947312+0000","last_undegraded":"2026-02-24T07:46:53.947312+0000","last_fullsized":"2026-02-24T07:46:53.947312+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:16 trial016 ceph-mon[39544]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:16 trial016 ceph-mon[39544]: from='client.14339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:16 trial016 ceph-mon[39544]: pgmap v15: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:17.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2263863843' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:17 trial016 ceph-mon[39544]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:19.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:18 trial016 ceph-mon[39544]: pgmap v16: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:19.286 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:19.404 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:19.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:19.500+0000 7f103a7a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:19.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:19.501+0000 7f103a7a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:19.611 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:19.611 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:19.648 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-24T07:47:17.744307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001445"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:19.650 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:19.765 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:19.863 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:19.861+0000 7fa506ea1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:19.863 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:19.861+0000 7fa506ea1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:19.969 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:19.970 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:20.004 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-24T07:47:19.744609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001398"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215113,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:20.005 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:20.006 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:20.006 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:20.121 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:20.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:20.218+0000 7fb140425640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:20.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:20.219+0000 7fb140425640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:20.369 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:20.370 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":105,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:20.408 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:20.408 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:20.524 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:20.624 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:20.622+0000 7fbab5f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:20.624 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:20.622+0000 7fbab5f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:20.737 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:20.738 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:20.777 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-24T07:47:19.744609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001398"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215113,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:21.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:20 trial016 ceph-mon[39544]: from='client.14345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:21.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:20 trial016 ceph-mon[39544]: pgmap v17: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:21.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/915563622' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:21 trial016 ceph-mon[39544]: from='client.14347 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:21 trial016 ceph-mon[39544]: from='client.14351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:22 trial016 ceph-mon[39544]: pgmap v18: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:23.779 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:23.896 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:24.005 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.003+0000 7fd12fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.005 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.003+0000 7fd12fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.112 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:24.113 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:24.151 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-24T07:47:23.745184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001523"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215114,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:24.152 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:24.267 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:24.370 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.367+0000 7fa950c22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.370 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.367+0000 7fa950c22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.480 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:24.481 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:24.516 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-24T07:47:23.745184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001523"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215114,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:24.517 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:24.517 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:24.518 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:24.633 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:24.730 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.728+0000 7fb9ddef5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.730 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:24.728+0000 7fb9ddef5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:24.882 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:24.883 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:24.903 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:24 trial016 ceph-mon[39544]: pgmap v19: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:24.919 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:24.919 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:25.033 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:25.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:25.131+0000 7fd31cb82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:25.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:25.131+0000 7fd31cb82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:25.244 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:25.245 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:25.245 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:47:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:47:25.281 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-24T07:47:23.745184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40977,"internal_metadata":110321647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001523"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215114,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:25 trial016 ceph-mon[39544]: from='client.14353 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:25 trial016 ceph-mon[39544]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1636117443' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:26 trial016 ceph-mon[39544]: from='client.14359 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:26 trial016 ceph-mon[39544]: pgmap v20: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:26 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:47:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:26 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:47:28.283 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:28.402 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:28.507 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:28.504+0000 7f4a6ed04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:28.507 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:28.505+0000 7f4a6ed04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:28.617 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:28.617 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:28.653 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-24T07:47:27.745647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001543"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:28.654 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:28.771 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:28.874 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:28.872+0000 7fcd7dfa1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:28.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:28.872+0000 7fcd7dfa1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:28.875 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:28 trial016 ceph-mon[39544]: pgmap v21: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:28.984 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:28.984 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:29.020 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-24T07:47:27.745647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001543"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:29.021 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:29.021 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:29.022 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:29.138 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:29.233 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:29.230+0000 7fb269198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:29.233 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:29.230+0000 7fb269198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:29.385 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:29.385 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":114,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:29.436 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:29.437 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:29.551 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:29.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:29.648+0000 7f2156227640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:29.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:29.648+0000 7f2156227640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:29.761 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:29.761 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:29.798 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-24T07:47:29.745840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001533"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:30.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:29 trial016 ceph-mon[39544]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:30.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4148222845' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:30 trial016 ceph-mon[39544]: from='client.14363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:30 trial016 ceph-mon[39544]: pgmap v22: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:30 trial016 ceph-mon[39544]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:32.800 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:32.915 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:33.013 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.010+0000 7f70294a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.014 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.010+0000 7f70294a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.119 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:33.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:32 trial016 ceph-mon[39544]: pgmap v23: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:33.120 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:33.156 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-24T07:47:31.746089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001479"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:33.156 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:33.271 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:33.371 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.368+0000 7f328744e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.369+0000 7f328744e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.478 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:33.479 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:33.514 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-24T07:47:31.746089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001479"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:33.515 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:33.515 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:33.516 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:33.630 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:33.725 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.721+0000 7f4cf21e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.725 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:33.722+0000 7f4cf21e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:33.875 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:33.875 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":119,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:33.912 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:33.912 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:34.028 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:34.126 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:34.123+0000 7f09fcbe7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:34.127 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:34.123+0000 7f09fcbe7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:34.234 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:34.234 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:34.272 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-24T07:47:33.746405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001528"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215116,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:35.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:47:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:47:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:34 trial016 ceph-mon[39544]: from='client.14369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:34 trial016 ceph-mon[39544]: from='client.14371 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:34 trial016 ceph-mon[39544]: pgmap v24: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/188012006' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:36.315 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:35 trial016 ceph-mon[39544]: from='client.14375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:37.273 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:37.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:36 trial016 ceph-mon[39544]: pgmap v25: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:37.391 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:37.498 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:37.495+0000 7f4510259640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:37.498 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:37.496+0000 7f4510259640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:37.605 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:37.605 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:37.641 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2026-02-24T07:47:35.746671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":40,"kb_used_meta":107735,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41628,"internal_metadata":110320996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001486"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215116,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:37.641 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:37.795 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:37.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:37.892+0000 7f98e5d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:37.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:37.892+0000 7f98e5d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:38.006 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:38.007 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:38.044 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-24T07:47:37.747014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001604"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:38.045 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:38.045 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:38.045 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:38.163 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:38.187 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:37 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:47:38.187 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:37 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:47:38.265 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:38.262+0000 7f79fdd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:38.265 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:38.263+0000 7f79fdd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:38.421 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:38.421 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:38.457 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:38.458 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:38.574 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:38.681 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:38.678+0000 7f4e4945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:38.681 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:38.678+0000 7f4e4945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:38.788 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:38.789 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:38.825 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-24T07:47:37.747014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001604"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:39.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:38 trial016 ceph-mon[39544]: from='client.14377 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:39.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:38 trial016 ceph-mon[39544]: pgmap v26: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:39.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3592125815' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:39 trial016 ceph-mon[39544]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:39 trial016 ceph-mon[39544]: from='client.14383 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:40 trial016 ceph-mon[39544]: pgmap v27: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:41.826 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:41.943 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:42.042 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.039+0000 7f52b1e0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.042 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.040+0000 7f52b1e0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.150 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:42.151 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:42.187 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-24T07:47:41.747555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001714"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:42.188 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:42.304 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:42.400 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.397+0000 7f4d4b958640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.400 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.397+0000 7f4d4b958640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.507 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:42.508 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:42.546 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-24T07:47:41.747555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001714"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:42.548 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:42.548 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:42.548 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:42.665 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:42.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.760+0000 7ff82975e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:42.760+0000 7ff82975e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:42.915 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:42.915 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":128,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":26,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:42.937 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:42 trial016 ceph-mon[39544]: pgmap v28: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:42.952 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:42.953 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:43.067 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:43.169 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:43.166+0000 7fb3e0aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:43.169 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:43.166+0000 7fb3e0aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:43.278 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:43.278 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:43.314 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-24T07:47:41.747555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001714"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:43 trial016 ceph-mon[39544]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:43 trial016 ceph-mon[39544]: from='client.14387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/8385718' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:44 trial016 ceph-mon[39544]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:44 trial016 ceph-mon[39544]: pgmap v29: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:44 trial016 ceph-mon[39544]: osdmap e27: 4 total, 4 up, 4 in 2026-02-24T07:47:45.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:47:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:47:46.316 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:46.432 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:46.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:46.533+0000 7f495e1e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:46.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:46.533+0000 7f495e1e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:46.643 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:46.643 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:46.682 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-02-24T07:47:45.789256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.042242"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215118,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:46.684 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:46.799 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:46.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:46.899+0000 7f9f04a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:46.902 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:46 trial016 ceph-mon[39544]: pgmap v31: 1 pgs: 1 active+remapped+backfill_toofull; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects misplaced (33.333%) 2026-02-24T07:47:46.902 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:46 trial016 ceph-mon[39544]: osdmap e28: 4 total, 4 up, 4 in 2026-02-24T07:47:46.902 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:46.900+0000 7f9f04a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:47.009 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:47.009 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:47.045 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-02-24T07:47:45.789256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2073212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42279,"internal_metadata":110320345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.042242"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":167,"reported_epoch":26,"state":"active+remapped+backfill_toofull","last_fresh":"2026-02-24T07:47:14.227967+0000","last_change":"2026-02-24T07:47:14.227967+0000","last_active":"2026-02-24T07:47:14.227967+0000","last_peered":"2026-02-24T07:47:14.227967+0000","last_clean":"2026-02-24T07:46:37.803467+0000","last_became_active":"2026-02-24T07:46:44.226531+0000","last_became_peered":"2026-02-24T07:46:44.226531+0000","last_unstale":"2026-02-24T07:47:14.227967+0000","last_undegraded":"2026-02-24T07:47:14.227967+0000","last_fullsized":"2026-02-24T07:47:14.227967+0000","mapping_epoch":24,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0,1,2","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215118,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":75527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":665895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:47.045 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-24T07:47:47.045 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "26'99", 'reported_seq': 167, 'reported_epoch': 26, 'state': 'active+remapped+backfill_toofull', 'last_fresh': '2026-02-24T07:47:14.227967+0000', 'last_change': '2026-02-24T07:47:14.227967+0000', 'last_active': '2026-02-24T07:47:14.227967+0000', 'last_peered': '2026-02-24T07:47:14.227967+0000', 'last_clean': '2026-02-24T07:46:37.803467+0000', 'last_became_active': '2026-02-24T07:46:44.226531+0000', 'last_became_peered': '2026-02-24T07:46:44.226531+0000', 'last_unstale': '2026-02-24T07:47:14.227967+0000', 'last_undegraded': '2026-02-24T07:47:14.227967+0000', 'last_fullsized': '2026-02-24T07:47:14.227967+0000', 'mapping_epoch': 24, 'log_start': "26'96", 'ondisk_log_start': "26'96", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'last_clean_scrub_stamp': '2026-02-24T07:46:36.462890+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 96, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 2, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 136, 'num_read_kb': 240, 'num_write': 135, 'num_write_kb': 2150, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 2], 'acting': [0, 2, 1], 'avail_no_missing': ['0', '1', '2'], 'object_location_counts': [{'shards': '0,1,2', 'objects': 2}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 0, 'purged_snaps': []} 2026-02-24T07:47:47.046 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:47:47.160 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:47.257 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:47.255+0000 7fe6ef858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:47.257 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:47.255+0000 7fe6ef858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:47.410 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:47.410 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":132,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":28,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+remapped+backfill_toofull","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":113111040,"bytes_avail":3006363996160,"bytes_total":3006477107200,"misplaced_objects":2,"misplaced_total":6,"misplaced_ratio":0.33333333333333326},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":1,"modified":"2026-02-24T07:45:33.912753+0000","services":{}},"progress_events":{}} 2026-02-24T07:47:47.448 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:47:47.448 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:47.562 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:47.663 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:47.660+0000 7ff3fda8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:47.663 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:47.661+0000 7ff3fda8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:47.771 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:47.772 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:47.809 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-24T07:47:47.748352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110524,"kb_used_data":2668,"kb_used_omap":46,"kb_used_meta":107729,"kb_avail":2935902276,"statfs":{"total":3006477107200,"available":3006363930624,"internally_reserved":0,"allocated":2732032,"data_stored":2105624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47489,"internal_metadata":110315135},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001104"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-24T07:47:45.792077+0000","last_change":"2026-02-24T07:47:45.791889+0000","last_active":"2026-02-24T07:47:45.792077+0000","last_peered":"2026-02-24T07:47:45.792077+0000","last_clean":"2026-02-24T07:47:45.792077+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:45.792077+0000","last_undegraded":"2026-02-24T07:47:45.792077+0000","last_fullsized":"2026-02-24T07:47:45.792077+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:53.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215119,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27196,"kb_used_data":232,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976004,"statfs":{"total":751619276800,"available":751591428096,"internally_reserved":0,"allocated":237568,"data_stored":83630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705685,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:48.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:47 trial016 ceph-mon[39544]: from='client.14393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:48.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2372444678' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:47:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:48 trial016 ceph-mon[39544]: from='client.14395 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:48 trial016 ceph-mon[39544]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T07:47:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:48 trial016 ceph-mon[39544]: from='client.14399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:48 trial016 ceph-mon[39544]: Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2026-02-24T07:47:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:48 trial016 ceph-mon[39544]: Cluster is now healthy 2026-02-24T07:47:50.811 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:50.928 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:51.036 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.033+0000 7f8d37b28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.036 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.034+0000 7f8d37b28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:50 trial016 ceph-mon[39544]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T07:47:51.142 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:51.142 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:51.178 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2026-02-24T07:47:49.748543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110524,"kb_used_data":2668,"kb_used_omap":46,"kb_used_meta":107729,"kb_avail":2935902276,"statfs":{"total":3006477107200,"available":3006363930624,"internally_reserved":0,"allocated":2732032,"data_stored":2105624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47489,"internal_metadata":110315135},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000988"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-24T07:47:45.792077+0000","last_change":"2026-02-24T07:47:45.791889+0000","last_active":"2026-02-24T07:47:45.792077+0000","last_peered":"2026-02-24T07:47:45.792077+0000","last_clean":"2026-02-24T07:47:45.792077+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:45.792077+0000","last_undegraded":"2026-02-24T07:47:45.792077+0000","last_fullsized":"2026-02-24T07:47:45.792077+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:53.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215119,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27196,"kb_used_data":232,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976004,"statfs":{"total":751619276800,"available":751591428096,"internally_reserved":0,"allocated":237568,"data_stored":83630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705685,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:51.179 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T07:47:51.179 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T07:47:51.180 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T07:47:51.180 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph health --format=json 2026-02-24T07:47:51.294 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:51.400 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.398+0000 7f2ed83e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.401 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.398+0000 7f2ed83e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.533 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:51.534 INFO:teuthology.orchestra.run.trial016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T07:47:51.572 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T07:47:51.572 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T07:47:51.573 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T07:47:51.593 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial016.front.sepia.ceph.com 2026-02-24T07:47:51.593 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-24T07:47:51.708 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:51.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.803+0000 7f76196ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:51.803+0000 7f76196ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:51.922 INFO:teuthology.orchestra.run.trial016.stdout:Backend: cephadm 2026-02-24T07:47:51.923 INFO:teuthology.orchestra.run.trial016.stdout:Available: Yes 2026-02-24T07:47:51.923 INFO:teuthology.orchestra.run.trial016.stdout:Paused: No 2026-02-24T07:47:51.961 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-24T07:47:51.983 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3941321850' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T07:47:52.080 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:52.182 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.179+0000 7f167f52a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:52.182 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.180+0000 7f167f52a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:52.298 INFO:teuthology.orchestra.run.trial016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:mgr.x trial016 *:9283,8765 running (2m) 56s ago 2m 530M - 20.3.0-5440-gff63f3d9 3992f70354a3 72cd74a3aa80 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:mon.a trial016 running (2m) 56s ago 2m 48.3M 2048M 20.3.0-5440-gff63f3d9 3992f70354a3 fa83df801aba 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:node-exporter.a trial016 *:9100 running (57s) 56s ago 57s 5649k - 1.9.1 255ec253085f 85f4f7f04e88 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:node-exporter.b trial043 *:9100 running (56s) 54s ago 56s 4126k - 1.9.1 255ec253085f 7dd2b5fc82e7 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:osd.0 trial016 running (98s) 56s ago 100s 38.4M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 b8ed11e689ad 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:osd.1 trial016 running (89s) 56s ago 91s 40.0M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 421d705c232b 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:osd.2 trial043 running (81s) 54s ago 83s 40.7M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 04c6bbfc61f7 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:osd.3 trial043 running (72s) 54s ago 74s 37.4M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 0904cc9d8a41 2026-02-24T07:47:52.299 INFO:teuthology.orchestra.run.trial016.stdout:prometheus.a trial043 *:9095 running (55s) 54s ago 64s 28.9M - 3.6.0 4fcecf061b74 15d3de41d159 2026-02-24T07:47:52.337 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-24T07:47:52.492 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:52.596 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.594+0000 7faa740b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:52.597 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.594+0000 7faa740b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:52.710 INFO:teuthology.orchestra.run.trial016.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-24T07:47:52.710 INFO:teuthology.orchestra.run.trial016.stdout:mgr 1/1 56s ago 109s trial016=x;count:1 2026-02-24T07:47:52.710 INFO:teuthology.orchestra.run.trial016.stdout:mon 1/1 56s ago 111s trial016:10.20.193.16=a;count:1 2026-02-24T07:47:52.711 INFO:teuthology.orchestra.run.trial016.stdout:node-exporter ?:9100 2/2 56s ago 67s trial016=a;trial043=b;count:2 2026-02-24T07:47:52.711 INFO:teuthology.orchestra.run.trial016.stdout:osd.default 4 56s ago 79s trial043 2026-02-24T07:47:52.711 INFO:teuthology.orchestra.run.trial016.stdout:prometheus ?:9095 1/1 55s ago 68s trial043=a;count:1 2026-02-24T07:47:52.747 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-24T07:47:52.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:52 trial016 ceph-mon[39544]: from='client.14401 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:52.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:52 trial016 ceph-mon[39544]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T07:47:52.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:52 trial016 ceph-mon[39544]: from='client.14405 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:47:52.861 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:52.964 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.962+0000 7fd773aff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:52.964 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:52.962+0000 7fd773aff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:53.075 INFO:teuthology.orchestra.run.trial016.stdout:HOST ADDR LABELS STATUS 2026-02-24T07:47:53.075 INFO:teuthology.orchestra.run.trial016.stdout:trial016 10.20.193.16 2026-02-24T07:47:53.075 INFO:teuthology.orchestra.run.trial016.stdout:trial043 10.20.193.43 2026-02-24T07:47:53.075 INFO:teuthology.orchestra.run.trial016.stdout:2 hosts in cluster 2026-02-24T07:47:53.111 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-24T07:47:53.228 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:53.324 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:53.322+0000 7fbca540b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:53.324 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:53.322+0000 7fbca540b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:53.439 INFO:teuthology.orchestra.run.trial016.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-24T07:47:53.439 INFO:teuthology.orchestra.run.trial016.stdout:trial016 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00360 1788G No 71s ago Has a FileSystem, LVM detected 2026-02-24T07:47:53.439 INFO:teuthology.orchestra.run.trial016.stdout:trial016 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B003EB 1788G No 71s ago Has a FileSystem, LVM detected 2026-02-24T07:47:53.439 INFO:teuthology.orchestra.run.trial016.stdout:trial043 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5117 1788G No 67s ago Has a FileSystem, LVM detected 2026-02-24T07:47:53.439 INFO:teuthology.orchestra.run.trial016.stdout:trial043 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5132 1788G No 67s ago Has a FileSystem, LVM detected 2026-02-24T07:47:53.476 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-24T07:47:53.504 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 2, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-24T07:47:53.504 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'wip-shraddhaag-enable-cephadm-tests', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'a78040ddef3ba5a489697ca2fe95df59a7d8bd08'}} 2026-02-24T07:47:53.504 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-24T07:47:53.505 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-24T07:47:53.621 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:53.726 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:53.724+0000 7f3be712b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:53.726 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:53.724+0000 7f3be712b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:53.878 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-24T07:47:53.878 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T07:47:53.878 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:53.994 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:54.014 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:53 trial016 ceph-mon[39544]: from='client.14407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:47:54.014 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:53 trial016 ceph-mon[39544]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:47:54.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.103+0000 7fda80749640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.103+0000 7fda80749640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.214 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:54.215 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:54.252 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-24T07:47:53.748992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110524,"kb_used_data":2668,"kb_used_omap":46,"kb_used_meta":107729,"kb_avail":2935902276,"statfs":{"total":3006477107200,"available":3006363930624,"internally_reserved":0,"allocated":2732032,"data_stored":2105624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47489,"internal_metadata":110315135},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.960028"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-24T07:47:45.792077+0000","last_change":"2026-02-24T07:47:45.791889+0000","last_active":"2026-02-24T07:47:45.792077+0000","last_peered":"2026-02-24T07:47:45.792077+0000","last_clean":"2026-02-24T07:47:45.792077+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:45.792077+0000","last_undegraded":"2026-02-24T07:47:45.792077+0000","last_fullsized":"2026-02-24T07:47:45.792077+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:53.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215120,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27196,"kb_used_data":232,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976004,"statfs":{"total":751619276800,"available":751591428096,"internally_reserved":0,"allocated":237568,"data_stored":83630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:54.253 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:54.275 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:47:54] ENGINE Bus STOPPING 2026-02-24T07:47:54.370 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:54.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.465+0000 7f4778dca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.465+0000 7f4778dca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.566 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:47:54] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T07:47:54.566 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:47:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:47:54] ENGINE Bus STOPPED 2026-02-24T07:47:54.575 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:54.575 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:54.613 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-24T07:47:53.748992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110524,"kb_used_data":2668,"kb_used_omap":46,"kb_used_meta":107729,"kb_avail":2935902276,"statfs":{"total":3006477107200,"available":3006363930624,"internally_reserved":0,"allocated":2732032,"data_stored":2105624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47489,"internal_metadata":110315135},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.960028"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":186,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-24T07:47:45.792077+0000","last_change":"2026-02-24T07:47:45.791889+0000","last_active":"2026-02-24T07:47:45.792077+0000","last_peered":"2026-02-24T07:47:45.792077+0000","last_clean":"2026-02-24T07:47:45.792077+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:45.792077+0000","last_undegraded":"2026-02-24T07:47:45.792077+0000","last_fullsized":"2026-02-24T07:47:45.792077+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:46:36.462890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:53.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215120,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27196,"kb_used_data":232,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976004,"statfs":{"total":751619276800,"available":751591428096,"internally_reserved":0,"allocated":237568,"data_stored":83630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":27576662},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":673998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:54.614 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T07:47:54.614 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump 2026-02-24T07:47:54.770 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:54.872 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.870+0000 7f878f717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.872 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:54.870+0000 7f878f717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:54.980 INFO:teuthology.orchestra.run.trial016.stdout:epoch 28 2026-02-24T07:47:54.980 INFO:teuthology.orchestra.run.trial016.stdout:fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T07:47:54.980 INFO:teuthology.orchestra.run.trial016.stdout:created 2026-02-24T07:45:33.912476+0000 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:modified 2026-02-24T07:47:45.788692+0000 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:crush_version 10 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:full_ratio 0.95 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:backfillfull_ratio 0.9 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:nearfull_ratio 0.85 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:require_min_compat_client luminous 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:min_compat_client jewel 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:require_osd_release tentacle 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:stretch_mode_enabled false 2026-02-24T07:47:54.981 INFO:teuthology.orchestra.run.trial016.stdout:allow_crimson=true 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:max_osd 4 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:osd.0 up in weight 1 up_from 9 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433] [v2:10.20.193.16:6804/535869433,v1:10.20.193.16:6805/535869433] exists,up 22020e1a-4666-4547-975e-a1c54d782ef5 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715] [v2:10.20.193.16:6812/157128715,v1:10.20.193.16:6813/157128715] exists,up 121f0fef-9a82-4630-97c6-fdecadf14a25 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:osd.2 up in weight 1 up_from 17 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778] [v2:10.20.193.43:6802/3201731778,v1:10.20.193.43:6803/3201731778] exists,up c8029751-589f-4aba-90a4-a0cbecaac822 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:osd.3 up in weight 1 up_from 24 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018] [v2:10.20.193.43:6810/563824018,v1:10.20.193.43:6811/563824018] exists,up 89f56ad0-46e8-4029-a5b4-a47768c64a7a 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6801/540268995 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6800/540268995 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/1699817835 expires 2026-02-25T07:45:43.999704+0000 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/3890433861 expires 2026-02-25T07:45:53.520777+0000 2026-02-24T07:47:54.982 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/2716152770 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6801/1119481031 expires 2026-02-25T07:45:43.999704+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/1863982042 expires 2026-02-25T07:45:43.999704+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/823394954 expires 2026-02-25T07:45:53.520777+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/3946948853 expires 2026-02-25T07:45:43.999704+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6801/305334144 expires 2026-02-25T07:45:53.520777+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/3304616791 expires 2026-02-25T07:45:53.520777+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6800/1119481031 expires 2026-02-25T07:45:43.999704+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:6800/305334144 expires 2026-02-25T07:45:53.520777+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/1404893956 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/2594083080 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:54.983 INFO:teuthology.orchestra.run.trial016.stdout:blocklist 10.20.193.16:0/3708454832 expires 2026-02-25T07:46:51.735974+0000 2026-02-24T07:47:55.017 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:10.20.193.16:6802/535869433,v1:10.20.193.16:6803/535869433] [v2:10.20.193.16:6804/535869433,v1:10.20.193.16:6805/535869433] exists,up 22020e1a-4666-4547-975e-a1c54d782ef5', 'osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.16:6810/157128715,v1:10.20.193.16:6811/157128715] [v2:10.20.193.16:6812/157128715,v1:10.20.193.16:6813/157128715] exists,up 121f0fef-9a82-4630-97c6-fdecadf14a25', 'osd.2 up in weight 1 up_from 17 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:10.20.193.43:6800/3201731778,v1:10.20.193.43:6801/3201731778] [v2:10.20.193.43:6802/3201731778,v1:10.20.193.43:6803/3201731778] exists,up c8029751-589f-4aba-90a4-a0cbecaac822', 'osd.3 up in weight 1 up_from 24 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:10.20.193.43:6808/563824018,v1:10.20.193.43:6809/563824018] [v2:10.20.193.43:6810/563824018,v1:10.20.193.43:6811/563824018] exists,up 89f56ad0-46e8-4029-a5b4-a47768c64a7a'] 2026-02-24T07:47:55.017 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph daemon mon.a config show 2026-02-24T07:47:55.132 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:55.153 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='client.14411 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='client.14413 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 64 KiB/s, 0 objects/s recovering 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2760466553' entity='client.admin' 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:47:55.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout:{ 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "name": "mon.a", 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "cluster": "ceph", 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "admin_socket_mode": "", 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2026-02-24T07:47:55.239 INFO:teuthology.orchestra.run.trial016.stdout: "auth_client_required": "cephx, none", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_cluster_required": "cephx", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_debug": "true", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_service_required": "cephx", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "auth_supported": "", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio": "true", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_poll_ms": "250", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_reap_max": "16", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard": "false", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard_threads": "0", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_block_size": "4096", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio": "false", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_discard_sleep": "0", 2026-02-24T07:47:55.240 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_inflight_ios": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_enable_discard": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_flock_retry": "3", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_inject_crash": "0", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring_hipri": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_max_discard_length": "2147483648", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_type": "", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_alloc_size": "1048576", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_allocator": "hybrid", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_buffered_io": "true", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_for_zeros": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-24T07:47:55.241 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_compact_log_sync": "false", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_max_log_runway": "4194304", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_max_prefetch": "1048576", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_min_flush_size": "524288", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_min_log_runway": "1048576", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_replay_recovery": "false", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_sync_write": "false", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocation_from_file": "true", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocator": "hybrid", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_async_db_compaction": "true", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-24T07:47:55.242 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_multi": "true", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_create": "true", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_create": "false", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_path": "", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_size": "0", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_path": "", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_preallocate_file": "false", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_size": "107374182400", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_create": "false", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_path": "", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_size": "100663296", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs": "true", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-24T07:47:55.243 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_autotune": "true", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size": "0", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_type": "2q", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_clone_cow": "true", 2026-02-24T07:47:55.244 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_mode": "none", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_csum_type": "crc32c", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-24T07:47:55.245 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_freelist": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-24T07:47:55.246 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_small_allocations": "0", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_default_buffered_read": "true", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_default_buffered_write": "false", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-24T07:47:55.247 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fail_eio": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mount": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_umount": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-24T07:47:55.248 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_ignore_data_csum": "false", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-24T07:47:55.249 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_op_age": "5.000000", 2026-02-24T07:47:55.250 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_alloc_size": "0", 2026-02-24T07:47:55.250 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size": "0", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_deferred_txc": "32", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size": "0", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_nid_prealloc": "1024", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_onode_segment_size": "0", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-24T07:47:55.251 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_retry_disk_reads": "3", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_cf": "true", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_mem": "512", 2026-02-24T07:47:55.252 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_tracing": "false", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-24T07:47:55.253 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_write_v2": "false", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_write_v2_random": "false", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_zero_block_detection": "false", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "breakpad": "false", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "ceph_assert_supresssions": "", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-24T07:47:55.254 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_cluster_require_signatures": "false", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_cluster_require_version": "2", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_require_signatures": "false", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_require_version": "2", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_service_require_signatures": "false", 2026-02-24T07:47:55.255 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_service_require_version": "2", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_sign_messages": "true", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "chdir": "", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_acl_type": "", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_asio_thread_count": "2", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_cache_mid": "0.750000", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_cache_size": "16384", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_caps_release_delay": "5", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_check_pool_perm": "true", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_force_sync_read": "false", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_getattr_caps": "false", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_inject_features": "", 2026-02-24T07:47:55.256 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_inject_tick_delay": "0", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_die_on_failed_remount": "false", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_dirsize_rbytes": "true", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_force_lazyio": "false", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_fs": "", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_fscrypt_as": "true", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_release_failure": "false", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_write_delay_secs": "0", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_max_inline_size": "4096", 2026-02-24T07:47:55.257 INFO:teuthology.orchestra.run.trial016.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_mds_namespace": "", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_metadata": "", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_gid": "-1", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_timeout": "300", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_uid": "-1", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_mountpoint": "/", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_notify_timeout": "10", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc": "true", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_dirty": "104857600", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_objects": "1000", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_size": "209715200", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_target_dirty": "8388608", 2026-02-24T07:47:55.258 INFO:teuthology.orchestra.run.trial016.stdout: "client_permissions": "true", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_quota": "true", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_quota_df": "true", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_max_bytes": "0", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_max_periods": "4", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_min": "131072", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_reconnect_stale": "false", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_shutdown_timeout": "30", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_snapdir": ".snap", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_tick_interval": "1", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_trace": "", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_try_dentry_invalidate": "false", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_use_faked_inos": "false", 2026-02-24T07:47:55.259 INFO:teuthology.orchestra.run.trial016.stdout: "client_use_random_mds": "false", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog": "false", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog_port": "12201", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_monitors": "default=true", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog": "false", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog_level": "info", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_addr": "-", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_network": "", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_network_interface": "", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_isal": "false", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_level": "5", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_winsize": "-15", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zstd_level": "1", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148", 2026-02-24T07:47:55.260 INFO:teuthology.orchestra.run.trial016.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_allow_pg_split": "false", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_bluestore_cpu_set": "", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_bluestore_num_threads": "6", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_cpu_num": "0", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_cpu_set": "", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_stat_interval": "0", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_poll_mode": "false", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_backend": "", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location": "", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location_hook": "", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location_hook_timeout": "10", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "d4n_writecache_enabled": "false", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "daemonize": "false", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "daos_pool": "tank", 2026-02-24T07:47:55.261 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_alienstore": "0/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_allow_any_pool_priority": "false", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asok": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asok_assert_abort": "false", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asserts_on_shutdown": "true", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_auth": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bdev": "1/3", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluefs": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluestore": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluestore_compression": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_buffer": "0/1", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ceph_dedup": "0/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ceph_exporter": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cephfs_mirror": "0/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cephsqlite": "0/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_client": "0/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_compressor": "1/5", 2026-02-24T07:47:55.262 INFO:teuthology.orchestra.run.trial016.stdout: "debug_context": "0/1", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crimson_interrupt": "0/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crush": "1/1", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crypto": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cyanstore": "0/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_deliberately_leak_memory": "false", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_disable_randomized_ping": "false", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_dpdk": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_eventtrace": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_filer": "0/1", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_filestore": "1/3", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_finisher": "1/1", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_fuse": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_heartbeat_testing_span": "0", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_heartbeatmap": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_javaclient": "1/5", 2026-02-24T07:47:55.263 INFO:teuthology.orchestra.run.trial016.stdout: "debug_journal": "1/3", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_journaler": "0/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_kstore": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_lockdep": "0/1", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mclock": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_balancer": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_locker": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_log": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_log_expire": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_migrator": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_quiesce": "3/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_memstore": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mgr": "2/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mgrc": "1/5", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mon": "20/20", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_monc": "0/10", 2026-02-24T07:47:55.264 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ms": "1/1", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_none": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objclass": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objectcacher": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objecter": "0/1", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_optracker": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_osd": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_paxos": "20/20", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_perfcounter": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_prioritycache": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rados": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_mirror": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_pwl": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_replay": "0/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_refs": "0/0", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_reserver": "1/1", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_access": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_datacache": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_dbstore": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_dedup": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_flight": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_notification": "1/5", 2026-02-24T07:47:55.265 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_restore": "1/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_sync": "1/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rocksdb": "4/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_backref": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_cache": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_cleaner": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_device": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_epm": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_journal": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_lba": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_odata": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_omap": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_onode": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_t": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_tm": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_striper": "0/1", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_test": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_throttle": "1/1", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_timer": "0/1", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_tp": "0/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "debug_trace": "1/5", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "device_failure_prediction_mode": "none", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "ec_extent_cache_size": "10485760", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "ec_pdw_write_mode": "0", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "enable_availability_tracking": "false", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-24T07:47:55.266 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_graylog": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_journald": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_stderr": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_syslog": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "event_tracing": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_addr": "0.0.0.0", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_cert_file": "", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_http_port": "9926", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_key_file": "", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_prio_limit": "5", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_sort_metrics": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_stats_period": "5", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "fake_statfs_for_testing": "0", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "fatal_signal_handlers": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filer_max_purge_ops": "10", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filer_max_truncate_ops": "128", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_apply_finisher_threads": "1", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_blackhole": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_btrfs_clone_range": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_btrfs_snap": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_caller_concurrency": "10", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_collect_device_partition_information": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_commit_timeout": "600.000000", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_inject_read_err": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_omap_check": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_verify_split": "false", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_dump_file": "", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fadvise": "true", 2026-02-24T07:47:55.267 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fail_eio": "true", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fd_cache_shards": "16", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fd_cache_size": "128", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fiemap": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fiemap_threshold": "4096", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_inject_stall": "0", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_parallel": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_trailing": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_writeahead": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_kill_at": "0", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs": "0", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size": "0", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_merge_threshold": "-10", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_odsync_write": "false", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_backend": "rocksdb", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_backend_path": "", 2026-02-24T07:47:55.268 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_thread_timeout": "60", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_threads": "2", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_punch_hole": "false", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_ops": "50", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_seek_data_hole": "false", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_sloppy_crc": "false", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_splice": "false", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_split_multiple": "2", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_split_rand_factor": "20", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_update_to": "1000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_enable": "true", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-24T07:47:55.269 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_xfs_extsize": "false", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_zfs_snap": "false", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fio_dir": "/tmp/fio", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fsid": "c4ff2ae8-1154-11f1-bd55-d404e6e7d460", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_allow_other": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_atomic_o_trunc": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_big_writes": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_debug": "false", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_default_permissions": "false", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_disable_pagecache": "false", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_max_write": "0", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_multithreaded": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_require_active_mds": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_set_user_groups": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_move": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_read": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_write": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_use_invalidate_cb": "true", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "gss_target_name": "ceph", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_file": "", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_inject_failure": "0", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_interval": "5", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "host": "trial016", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-24T07:47:55.270 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "inject_early_sigterm": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "jaeger_agent_port": "6799", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "jaeger_tracing_enable": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_aio": "true", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_align_min_size": "65536", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_block_align": "true", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_block_size": "4096", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_dio": "true", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_discard": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_force_aio": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_ignore_corruption": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_max_write_bytes": "10485760", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_max_write_entries": "100", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_replay_from": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_write_header_frequency": "0", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journal_zero_on_create": "false", 2026-02-24T07:47:55.271 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_prefetch_periods": "10", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_prezero_periods": "5", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_write_head_interval": "15", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "key": "", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "keyfile": "", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "librados_thread_count": "2", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "lockdep": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "lockdep_force_backtrace": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_coarse_timestamps": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_flush_on_exit": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_graylog_host": "127.0.0.1", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_graylog_port": "12201", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_max_new": "1000", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_max_recent": "10000", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_stderr_prefix": "", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_stop_at_utilization": "0.970000", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_file": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_graylog": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_journald": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_stderr": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_syslog": "false", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "max_rotating_auth_attempts": "10", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_action_on_write_error": "1", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_allow_async_dirops": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_allow_batched_ops": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_alternate_name_max": "8192", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_asio_thread_count": "2", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_export_pin": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_dirs": "true", 2026-02-24T07:47:55.272 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_interval": "5", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_interval": "10", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_max": "-1", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_max_until": "-1", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_merge_size": "50", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_midchunk": "0.300000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_min_start": "0.200000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_minchunk": "0.001000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_mode": "0", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_need_max": "1.200000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_need_min": "0.800000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_overload_epochs": "2", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_bits": "3", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_size": "10000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_target_decay": "10.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_grace": "15.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_interval": "4.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_mid": "0.700000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_delay": "0", 2026-02-24T07:47:55.273 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_release_free_interval": "10", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_reservation": "0.050000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_interval": "1", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_threshold": "262144", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_prealloc_inos": "1000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_connect_bootstrapping": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_damage_table_max_entries": "10000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_auth_pins": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_frag": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_scatterstat": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_subtrees": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_decay_halflife": "5.000000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_default_dir_hash": "2", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_defer_session_stale": "true", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_deny_all_reconnect": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_keys_per_op": "16384", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_max_commit_size": "10", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_max_entries": "0", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_prefetch": "true", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_on_map": "false", 2026-02-24T07:47:55.274 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_early_reply": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_enable_op_tracker": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_enforce_unique_name": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_random": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_health_summarize_threshold": "10", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_health_dummy": "false", 2026-02-24T07:47:55.275 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_migrator_session_race": "false", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_join_fs": "", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_journal_format": "1", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_create_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_dirfrag_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_export_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_import_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_expire_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_replay_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_link_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_mdstable_at": "0", 2026-02-24T07:47:55.276 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_openc_at": "0", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_rename_at": "0", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_shutdown_at": "0", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_event_large_threshold": "524288", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_events_per_segment": "1024", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_max_events": "-1", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_max_segments": "128", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_pause": "false", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_segment_size": "0", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_threshold": "128", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_warn_factor": "2.000000", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_caps_per_client": "1048576", 2026-02-24T07:47:55.277 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_completed_flushes": "100000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_completed_requests": "100000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_export_size": "20971520", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_file_recover": "32", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_files": "64", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_ops": "8192", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_snaps_per_dir": "100", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_metrics_update_interval": "2", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_min_caps_per_client": "100", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_min_caps_working_set": "10000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_numa_node": "-1", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_complaint_time": "30.000000", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_duration": "600", 2026-02-24T07:47:55.278 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_size": "20", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_slow_op_size": "20", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_log_threshold": "5", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_ping_grace": "15", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_ping_interval": "5", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_caps": "30000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_warning_threshold": "262144", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_replay_interval": "1.000000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-24T07:47:55.279 INFO:teuthology.orchestra.run.trial016.stdout: "mds_root_ino_gid": "0", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_root_ino_uid": "0", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_scrub_stats_review_period": "1", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_shutdown_check": "0", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_skip_ino": "0", 2026-02-24T07:47:55.280 INFO:teuthology.orchestra.run.trial016.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_max_uid": "4294967294", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_min_uid": "0", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_rstat": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_standby_replay_damaged": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_symlink_recovery": "true", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_thrash_exports": "0", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_thrash_fragments": "0", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_tick_interval": "5.000000", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_valgrind_exit": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_verify_backtrace": "1", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_verify_scatter": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mds_wipe_sessions": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "mempool_debug": "false", 2026-02-24T07:47:55.281 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_device_bytes": "1073741824", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_page_set": "false", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_page_size": "65536", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_bytes": "134217728", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_messages": "512", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_disabled_modules": "", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_enable_op_tracker": "true", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_max_pg_creating": "1024", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_max_pg_num_change": "128", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mds_bytes": "134217728", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mds_messages": "128", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-24T07:47:55.282 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mon_bytes": "134217728", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mon_messages": "128", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_duration": "600", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_size": "20", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_log_threshold": "5", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_osd_bytes": "536870912", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_osd_messages": "8192", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_pool": "true", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_standby_modules": "true", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_stats_period": "5", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_stats_threshold": "5", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_tick_period": "2", 2026-02-24T07:47:55.283 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_allow_pool_delete": "true", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_allow_pool_size_one": "false", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_auth_validate_all_caps": "true", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_bytes": "104857600", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_directed_command_retry": "2", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_on_resend": "true", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_parallel": "3", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_log_interval": "1.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_ping_interval": "10.000000", 2026-02-24T07:47:55.284 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_target_rank": "-1", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_level": "debug", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_file": "true", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_journald": "true", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_bootstrap": "false", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_start": "false", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_trim": "true", 2026-02-24T07:47:55.285 INFO:teuthology.orchestra.run.trial016.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cpu_threads": "4", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_crush_min_required_version": "hammer", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_daemon_bytes": "419430400", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_avail_crit": "5", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_avail_warn": "5", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_size_warn": "16106127360", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_json": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_transactions": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_extra_checks": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-24T07:47:55.286 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_squid": "false", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_added_grace": "180", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_mkfs_grace": "60", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_uptime_grace": "60", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_election_default_strategy": "1", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_election_timeout": "5.000000", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ping_divisor": "2", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_enable_op_tracker": "true", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_fake_pool_delete": "false", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_force_quorum_join": "false", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_globalid_prealloc": "10000", 2026-02-24T07:47:55.287 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_detail_to_clog": "true", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_log_update_period": "5", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_max_detail": "50", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog": "true", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog_interval": "600", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_host": "[v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0]", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_host_override": "", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_initial_members": "", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease": "5.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_full_interval": "50", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_max": "10000", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_max_summary": "50", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_log_epochs": "500", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-24T07:47:55.288 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_osd": "10000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_pg_per_osd": "10000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_pool_pg_num": "65536", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_force_trim_to": "0", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_skip_sanity": "false", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_memory_autotune": "true", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_memory_target": "2147483648", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_beacon_grace": "30", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_digest_period": "5", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_inactive_grace": "60", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_min_osdmap_epochs": "50", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_netsplit_grace_period": "9", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-24T07:47:55.289 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_complaint_time": "30", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_duration": "600", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_size": "20", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_slow_op_size": "20", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_log_threshold": "5", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_in": "false", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_cache_size": "500", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_down_out_interval": "600", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_force_trim_to": "0", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-24T07:47:55.290 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_down_reporters": "2", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_report_timeout": "900", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-24T07:47:55.291 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_stuck_threshold": "60", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_probe_timeout": "2.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_max_change": "0.050000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_max_osds": "4", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_interval": "86400", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_max_keys": "100", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_timeout": "300", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_session_timeout": "300", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_smart_report_timeout": "5", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stat_smooth_intervals": "6", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_pool_min_size": "2", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_pool_size": "4", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_debug": "false", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-24T07:47:55.292 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_provider_kill_at": "0", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_requester_kill_at": "0", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_timeout": "60.000000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_target_pg_per_osd": "100", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_tick_interval": "5", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_timecheck_interval": "300.000000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_use_min_delay_socket": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_older_version_delay": "604800", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_filestore_osds": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_misplaced": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_older_version": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_redundancy": "true", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "monmap": "", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-24T07:47:55.293 INFO:teuthology.orchestra.run.trial016.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "motr_tracing_enabled": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_op_threads": "3", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_cm": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_device_name": "", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_dscp": "96", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_local_gid": "", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_port_num": "1", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_sl": "3", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_support_srq": "true", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_type": "ib", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_reap_threshold": "5", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_before_connect": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_ipv4": "true", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_ipv6": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_msgr1": "true", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_msgr2": "true", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_port_max": "7568", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_port_min": "6800", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_retry_count": "3", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_retry_delay": "5", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_client": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mds": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mgr": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mon": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_osd": "false", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_client_mode": "crc", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-24T07:47:55.294 INFO:teuthology.orchestra.run.trial016.stdout: "ms_cluster_mode": "crc", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_cluster_type": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_compress_secure": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_connection_idle_timeout": "900", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_connection_ready_timeout": "10", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_crc_data": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_crc_header": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_bad_msg": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_bug": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_old_message": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_skipped_message": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_coremask": "0xF", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_enable_tso": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hugepages": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_lro": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_memory_channel": "4", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_pmd": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_port_id": "0", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dump_on_send": "false", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_initial_backoff": "0.200000", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_max": "1.000000", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_type": "", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_network_congestion": "0", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_socket_failures": "0", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_learn_addr_from_peer": "true", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_max_accept_failures": "4", 2026-02-24T07:47:55.295 INFO:teuthology.orchestra.run.trial016.stdout: "ms_max_backoff": "15.000000", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_client_mode": "crc", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_cluster_mode": "crc", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_service_mode": "crc", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compress_min_size": "1024", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compress_mode": "none", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_pq_min_cost": "65536", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_public_type": "", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_service_mode": "crc", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_listen_backlog": "512", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_nodelay": "true", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_rcvbuf": "0", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-24T07:47:55.296 INFO:teuthology.orchestra.run.trial016.stdout: "ms_type": "async+posix", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "no_config_file": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_completion_locks_per_session": "32", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inflight_ops": "1024", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_tick_interval": "5.000000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_timeout": "10.000000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objectstore_blackhole": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "openssl_conf": "", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_delay_time": "5.000000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_hist_halflife": "1000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_max_low_ops": "2", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_max_ops": "4", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_slop": "0.020000", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_asio_thread_count": "2", 2026-02-24T07:47:55.297 INFO:teuthology.orchestra.run.trial016.stdout: "osd_async_recovery_min_cost": "100", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_scan_max": "512", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_scan_min": "64", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_degraded": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_peering": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_unfound": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_beacon_report_interval": "300", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_duration": "30", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_max_block_size": "67108864", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_blkin_trace_all": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_check_for_log_corruption": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_update_on_start": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_message_cap": "256", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_message_size_cap": "524288000", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_op_priority": "63", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_watch_timeout": "30", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_command_max_records": "256", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_compact_on_start": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_chooseleaf_type": "1", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_update_on_start": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_update_weight_set": "true", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-24T07:47:55.298 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_feed_pullee": "-1", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_misdirected_ops": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_no_acting_change": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_no_purge_strays": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_op_order": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_shutdown": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_trim_objects": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_snaps": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_keys": "1024", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_default_data_pool_replay_window": "45", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_default_notify_timeout": "30", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep": "0.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_discard_disconnected_ops": "true", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_ec_partial_reads": "true", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_enable_op_tracker": "true", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_info": "true", 2026-02-24T07:47:55.299 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown": "true", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_function_tracing": "false", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_grace": "20", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_interval": "6", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_peers": "10", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_size": "2000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_stale": "600", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_max_size": "100000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_min_size": "1000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal_size": "5120", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_kill_backfill_at": "0", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_cache_size": "50", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_dedup": "true", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_message_max": "40", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_share_max_epochs": "40", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_attr_name_len": "100", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_attr_size": "0", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_backfills": "1", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_markdown_count": "5", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_markdown_period": "600", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_name_len": "2048", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_namespace_len": "256", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_size": "134217728", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_blocked_by": "16", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_log_entries": "2", 2026-02-24T07:47:55.300 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pgls": "1024", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_push_cost": "8388608", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_push_objects": "10", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_scrubs": "3", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_trimming_pgs": "2", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_write_op_reply_len": "64", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_write_size": "90", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_profile": "balanced", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_base": "805306368", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_cache_min": "134217728", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target": "4294967296", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target_autotune": "false", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_min_pg_log_entries": "1", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_min_recovery_priority": "0", 2026-02-24T07:47:55.301 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_report_interval": "5", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_num_cache_shards": "32", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_num_op_tracker_shard": "32", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_auto_affinity": "true", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_node": "-1", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_prefer_iface": "true", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objecter_finishers": "1", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore": "bluestore", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_fuse": "false", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_tracing": "false", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_complaint_time": "30.000000", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_duration": "600", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_size": "20", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_slow_op_size": "20", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_log_threshold": "5", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards": "0", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards_hdd": "1", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards_ssd": "8", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_pq_min_cost": "65536", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_queue_cut_off": "high", 2026-02-24T07:47:55.302 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_thread_timeout": "15", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_open_classes_on_start": "true", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_os_flags": "0", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_peering_op_priority": "255", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_delete_cost": "1048576", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_delete_priority": "5", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_trim_max": "10000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_trim_min": "0", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_crimson": "true", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-24T07:47:55.303 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flags": "0", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_min_size": "2", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pg_num": "32", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pgp_num": "0", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_read_ratio": "70", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_size": "3", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_type": "replicated", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_push_per_object_cost": "1000", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recover_clone_overlap": "true", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_cost": "20971520", 2026-02-24T07:47:55.304 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active": "0", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_single_start": "1", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_op_priority": "3", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_priority": "5", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep": "0.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_requested_scrub_priority": "5", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_auto_repair": "false", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-24T07:47:55.305 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_begin_hour": "0", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_begin_week_day": "0", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_chunk_max": "15", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_chunk_min": "5", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_cost": "52428800", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_during_recovery": "false", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_end_hour": "0", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_end_week_day": "0", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_event_cost": "4096", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_invalid_stats": "true", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_max_preemptions": "5", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_priority": "5", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_delay": "30", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_trimming": "10", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_sleep": "0.000000", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-24T07:47:55.306 INFO:teuthology.orchestra.run.trial016.stdout: "osd_skip_data_digest": "false", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_smart_report_timeout": "5", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_cost": "1048576", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_priority": "5", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_target_transaction_size": "30", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tracing": "false", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_use_stale_snap": "false", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "osdc_blkin_trace_all": "false", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_kill_at": "0", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_max_join_drift": "10", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_min": "500", 2026-02-24T07:47:55.307 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_min_wait": "0.050000", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_propose_interval": "1.000000", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_max": "500", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_min": "10", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_stash_full_interval": "25", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_trim_max": "500", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_trim_min": "250", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "perf": "true", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "pid_file": "", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "pool_availability_update_interval": "1.000000", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "public_addr": "-", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "public_addrv": "", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "public_bind_addr": "-", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "public_network": "", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "public_network_interface": "", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_busy_polling": "false", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_enabled": "false", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_session_max_number": "256", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rados_mon_op_timeout": "0", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rados_osd_op_timeout": "0", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rados_replica_read_policy": "default", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rados_tracing": "false", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_atime_update_interval": "60", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-24T07:47:55.308 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_balance_parent_reads": "false", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_balance_snap_reads": "false", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blkin_trace_all": "false", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache": "true", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_policy": "writearound", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_size": "33554432", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_clone_copy_on_read": "false", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_compression_hint": "none", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_concurrent_management_ops": "10", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_clone_format": "auto", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_data_pool": "", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_features": "61", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_format": "2", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_map_options": "", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_order": "22", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_pool": "rbd", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_stripe_count": "0", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_stripe_unit": "0", 2026-02-24T07:47:55.309 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_enable_alloc_hint": "true", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_io_scheduler": "simple", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_order": "24", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_pool": "", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_splay_width": "4", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_localize_parent_reads": "false", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_localize_snap_reads": "false", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-24T07:47:55.310 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-24T07:47:55.311 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mtime_update_interval": "60", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_non_blocking_aio": "true", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_op_thread_timeout": "60", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_op_threads": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_parent_cache_enabled": "false", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_plugins": "", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_burst": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_limit": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_exclude_ops": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_burst": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_limit": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-24T07:47:55.312 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_read_from_replica_policy": "default", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_skip_partial_discard": "true", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_tracing": "false", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_validate_names": "true", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_validate_pool": "true", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "restapi_base_url": "", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "restapi_log_level": "", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_acl_grants_max_num": "100", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_admin_entry": "admin", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_asio_assert_yielding": "false", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_backend_store": "rados", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_barbican_url": "", 2026-02-24T07:47:55.313 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_beast_enable_async": "true", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_counters_cache": "false", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_eexist_override": "false", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_enabled": "true", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_expiry_interval": "900", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_lru_size": "25000", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_config_store": "rados", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_content_length_compat": "false", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_copy_obj_progress": "true", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cors_rules_max_num": "100", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cross_domain_policy": "", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-24T07:47:55.314 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_addr": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_password": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_username": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_require_ssl": "true", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_addr": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_auth": "token", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_namespace": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_prefix": "", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-24T07:47:55.315 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_token_file": "", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_buffersize": "524288", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_low_speed_time": "300", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_changes_size": "1000", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_num_shards": "128", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_window": "30", 2026-02-24T07:47:55.316 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_disable_s3select": "false", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dns_name": "", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dns_s3website_name": "", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding": "true", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-24T07:47:55.317 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_gc_threads": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_lc_threads": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_mdsearch": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_ops_log": "false", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_quota_threads": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_restore_threads": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_static_website": "false", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_usage_log": "false", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enforce_swift_acls": "true", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_exit_timeout_secs": "120", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_expose_bucket": "false", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_extended_http_attrs": "", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_filter": "none", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_frontends": "beast port=7480", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_deferred": "50", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_objs": "32", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_processor_period": "3600", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-24T07:47:55.318 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_graceful_stop": "false", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_init_timeout": "300", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_connection_idle": "300", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_domain": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_password": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_password_path": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_project": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_tenant": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_user": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_domain": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_password": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_project": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_user": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_url": "", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_debug_interval": "-1", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_list_cnt": "1000", 2026-02-24T07:47:55.319 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_lock_max_time": "90", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_objs": "32", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_rules": "1000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_worker": "3", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_thread_delay": "0", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_dnattr": "uid", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_searchfilter": "", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_uri": "", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_http_headers": "", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_object_name_utc": "false", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_enable": "true", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attr_name_len": "0", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attr_size": "0", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_chunk_size": "4194304", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_control_aio": "8", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_listing_results": "5000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_notify_retries": "10", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_put_param_size": "1048576", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_put_size": "5368709120", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_slo_entries": "1000", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_md_log_max_shards": "64", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_mp_lock_max_time": "600", 2026-02-24T07:47:55.320 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_max_gc": "300", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_num_async_rados_threads": "32", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_num_control_oids": "8", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_numa_node": "-1", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_chunk_size": "100", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_gc_interval": "600", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_thread_timeout": "600", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_tracing": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_token": "", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_url": "", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_verify_ssl": "true", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_rados": "false", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_socket_path": "", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_push_interval": "2.000000", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-24T07:47:55.321 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_lanes": "3", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_partitions": "3", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_print_continue": "true", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_tracing": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ratelimit_interval": "60", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm": "", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm_id": "", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_region": "", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_request_uri": "", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_batch_size": "64", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_max_aio": "128", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_num_logs": "16", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_thread_interval": "600", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_resolve_cname": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_debug_interval": "-1", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_lock_max_time": "90", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_max_objs": "32", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_processor_period": "900", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_run_sync_thread": "true", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-24T07:47:55.322 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_scheduler_type": "throttler", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_script_uri": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_service_provider_name": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_client_id": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_client_secret": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_entry": "sts", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_key": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_min_session_duration": "900", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_token_introspection_url": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_account_in_url": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_auth_entry": "auth", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_auth_url": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_custom_header": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_need_stats": "true", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_tenant_name": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_token_expiration": "86400", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_url": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_url_prefix": "swift", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_lease_period": "120", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_thread_pool_size": "512", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_comment": "", 2026-02-24T07:47:55.323 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_createby": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_encoding": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_flag": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_origin": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_tracker": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_trust_forwarded_https": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_key_transition": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_max_shards": "32", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_max_user_shards": "1", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_use_opa_authz": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_counters_cache": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_max_buckets": "1000", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_policies_max_num": "100", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_unique_email": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_verify_ssl": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone_id": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup_id": "", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgwlc_auto_session_clear": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_block_size": "4096", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_size": "536870912", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-24T07:47:55.324 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_index_type": "binary_search", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_partition_filters": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_perf": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "run_dir": "/var/run/ceph", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_block_create": "true", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_type": "LRU", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cold_tier_generations": "3", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_default_max_object_size": "16777216", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_device_size": "53687091200", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_full_integrity_check": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_hot_tier_generations": "5", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_capacity": "16", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_main_device_type": "SSD", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_max_data_allocation_size": "0", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_segment_size": "67108864", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "service_unique_id": "", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "set_keepcaps": "false", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "setgroup": "ceph", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "setuser": "ceph", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "setuser_match_path": "", 2026-02-24T07:47:55.325 INFO:teuthology.orchestra.run.trial016.stdout: "subv_metrics_window_interval": "30", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "thp": "false", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "threadpool_default_timeout": "60", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "throttler_perf_counter": "true", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "tmp_dir": "/tmp", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "uadk_compressor_enabled": "false", 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-24T07:47:55.326 INFO:teuthology.orchestra.run.trial016.stdout:} 2026-02-24T07:47:55.327 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-24T07:47:55.443 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:55.552 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.550+0000 7fc609148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.552 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.550+0000 7fc609148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.559 INFO:teuthology.orchestra.run.trial016.stdout:{} 2026-02-24T07:47:55.559 INFO:teuthology.orchestra.run.trial016.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-24T07:47:55.592 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-24T07:47:55.605 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:47:55.607 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:47:55.608 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-24T07:47:55.608 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_0 16 2026-02-24T07:47:55.608 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-24T07:47:55.608 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:47:55.608 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:47:55.608 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-24T07:47:55.609 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:47:55.724 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:55.725 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:55.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.822+0000 7f0208458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.822+0000 7f0208458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.827+0000 7fabb3f69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:55.828+0000 7fabb3f69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:55.838 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:47:55.838 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:47:55.849 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:47:55.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:47:55.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:47:55.860 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:47:55.871 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:47:55.871 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:47:56.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='client.14417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:56.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T07:47:56.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='client.14419 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:47:56.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/845504893' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T07:47:56.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:47:56.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:47:56.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/451191151' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T07:47:56.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/900959279' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:47:56.843 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_0' created 2026-02-24T07:47:56.884 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-24T07:47:56.998 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:57.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:57.102+0000 7f6b58818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:57.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:57.102+0000 7f6b58818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:57.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:56 trial016 ceph-mon[39544]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 58 KiB/s, 0 objects/s recovering 2026-02-24T07:47:57.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/425603900' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} : dispatch 2026-02-24T07:47:57.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:56 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:47:57.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:56 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:47:57.843 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-24T07:47:57.907 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:47:58.021 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:58.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:58.113+0000 7fca1f53a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:58.115 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:57 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:47:58.115 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:57 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:47:58.115 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/425603900' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2026-02-24T07:47:58.115 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:57 trial016 ceph-mon[39544]: osdmap e29: 4 total, 4 up, 4 in 2026-02-24T07:47:58.115 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3658952674' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:47:58.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:58.114+0000 7fca1f53a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:58.127 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:47:58.127 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:47:58.137 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:47:58.138 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:47:58.148 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:47:58.148 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:47:58.160 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:47:58.160 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:47:58.886 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2026-02-24T07:47:58.887 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:47:58.887 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:47:58.890 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:47:58.890 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:47:58.939 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:47:58.939 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:47:58.939 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_86789 2026-02-24T07:47:58.939 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:47:58.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:47:59.027 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:47:59.098 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:58 trial016 ceph-mon[39544]: pgmap v39: 17 pgs: 16 creating+peering, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:47:59.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3658952674' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:47:59.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:58 trial016 ceph-mon[39544]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T07:47:59.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1879124546' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:47:59.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:59.157+0000 7ff11d24b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:59.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:47:59.157+0000 7ff11d24b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:47:59.303 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:47:59.303 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:47:59.350 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-24T07:47:58.849500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110572,"kb_used_data":2716,"kb_used_omap":50,"kb_used_meta":107725,"kb_avail":2935902228,"statfs":{"total":3006477107200,"available":3006363881472,"internally_reserved":0,"allocated":2781184,"data_stored":2124676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51407,"internal_metadata":110311217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.100684"},"pg_stats":[{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843047+0000","last_change":"2026-02-24T07:47:56.843047+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843047+0000","last_undegraded":"2026-02-24T07:47:56.843047+0000","last_fullsized":"2026-02-24T07:47:56.843047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843932+0000","last_change":"2026-02-24T07:47:56.843932+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843932+0000","last_undegraded":"2026-02-24T07:47:56.843932+0000","last_fullsized":"2026-02-24T07:47:56.843932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843872+0000","last_change":"2026-02-24T07:47:56.843872+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843872+0000","last_undegraded":"2026-02-24T07:47:56.843872+0000","last_fullsized":"2026-02-24T07:47:56.843872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843889+0000","last_change":"2026-02-24T07:47:56.843889+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843889+0000","last_undegraded":"2026-02-24T07:47:56.843889+0000","last_fullsized":"2026-02-24T07:47:56.843889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T07:47:56.842263+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:56.842263+0000","last_peered":"2026-02-24T07:47:56.842263+0000","last_clean":"2026-02-24T07:47:56.842263+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:56.842263+0000","last_undegraded":"2026-02-24T07:47:56.842263+0000","last_fullsized":"2026-02-24T07:47:56.842263+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843126+0000","last_change":"2026-02-24T07:47:56.843126+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843126+0000","last_undegraded":"2026-02-24T07:47:56.843126+0000","last_fullsized":"2026-02-24T07:47:56.843126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843021+0000","last_change":"2026-02-24T07:47:56.843021+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843021+0000","last_undegraded":"2026-02-24T07:47:56.843021+0000","last_fullsized":"2026-02-24T07:47:56.843021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843079+0000","last_change":"2026-02-24T07:47:56.843079+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843079+0000","last_undegraded":"2026-02-24T07:47:56.843079+0000","last_fullsized":"2026-02-24T07:47:56.843079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843020+0000","last_change":"2026-02-24T07:47:56.843020+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843020+0000","last_undegraded":"2026-02-24T07:47:56.843020+0000","last_fullsized":"2026-02-24T07:47:56.843020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843070+0000","last_change":"2026-02-24T07:47:56.843070+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843070+0000","last_undegraded":"2026-02-24T07:47:56.843070+0000","last_fullsized":"2026-02-24T07:47:56.843070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843162+0000","last_change":"2026-02-24T07:47:56.843162+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843162+0000","last_undegraded":"2026-02-24T07:47:56.843162+0000","last_fullsized":"2026-02-24T07:47:56.843162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843070+0000","last_change":"2026-02-24T07:47:56.843070+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843070+0000","last_undegraded":"2026-02-24T07:47:56.843070+0000","last_fullsized":"2026-02-24T07:47:56.843070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843202+0000","last_change":"2026-02-24T07:47:56.843202+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843202+0000","last_undegraded":"2026-02-24T07:47:56.843202+0000","last_fullsized":"2026-02-24T07:47:56.843202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843588+0000","last_change":"2026-02-24T07:47:56.843588+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843588+0000","last_undegraded":"2026-02-24T07:47:56.843588+0000","last_fullsized":"2026-02-24T07:47:56.843588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843705+0000","last_change":"2026-02-24T07:47:56.843705+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843705+0000","last_undegraded":"2026-02-24T07:47:56.843705+0000","last_fullsized":"2026-02-24T07:47:56.843705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843826+0000","last_change":"2026-02-24T07:47:56.843826+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843826+0000","last_undegraded":"2026-02-24T07:47:56.843826+0000","last_fullsized":"2026-02-24T07:47:56.843826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2026-02-24T07:47:56.843544+0000","last_change":"2026-02-24T07:47:56.843544+0000","last_active":"2026-02-24T07:47:56.837436+0000","last_peered":"2026-02-24T07:47:56.837436+0000","last_clean":"2026-02-24T07:47:56.837436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:47:56.843544+0000","last_undegraded":"2026-02-24T07:47:56.843544+0000","last_fullsized":"2026-02-24T07:47:56.843544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215121,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":678761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444050,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":678761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27208,"kb_used_data":244,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975992,"statfs":{"total":751619276800,"available":751591415808,"internally_reserved":0,"allocated":249856,"data_stored":88393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":678761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":27574058},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:47:59.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 8154 8026 62.698 62.7031 0.00222834 0.0158193 2026-02-24T07:48:00.196 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:00.222 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:47:59 trial016 ceph-mon[39544]: osdmap e31: 4 total, 4 up, 4 in 2026-02-24T07:48:00.339 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:00.462 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:00.459+0000 7effe5e59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:00.462 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:00.459+0000 7effe5e59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:00.481 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:00.482 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:00.496 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:00.496 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:00.507 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:00.508 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:00.523 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:00.523 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:00.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 16327 16199 63.2722 63.8516 0.00536992 0.0156935 2026-02-24T07:48:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:00 trial016 ceph-mon[39544]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:00 trial016 ceph-mon[39544]: pgmap v42: 17 pgs: 16 creating+peering, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:48:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2802120415' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:01.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 24964 24837 64.6745 67.4844 0.0119184 0.0154233 2026-02-24T07:48:02.569 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:02.710 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:02.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:02.827+0000 7fbd7aba5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:02.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:02.827+0000 7fbd7aba5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:02.843 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:02.843 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:02.857 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:02.857 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:02.871 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:02.871 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:02.886 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:02.886 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:02.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 127 34652 34525 67.4263 75.6875 0.0165365 0.0147896 2026-02-24T07:48:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:02 trial016 ceph-mon[39544]: pgmap v43: 17 pgs: 16 creating+peering, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:48:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3673706883' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:03.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 43443 43315 67.6744 68.6719 0.00870474 0.0147458 2026-02-24T07:48:04.353 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:04.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:04.353 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:48:04.353 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:04.497 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:04.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:04.612+0000 7fefb07d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:04.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:04.613+0000 7fefb07d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:04.754 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:04.754 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:04.754 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:48:04] ENGINE Bus STARTING 2026-02-24T07:48:04.755 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:48:04] ENGINE Serving on http://:::9283 2026-02-24T07:48:04.755 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:07:48:04] ENGINE Bus STARTED 2026-02-24T07:48:04.801 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2026-02-24T07:48:03.750281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269353504,"num_objects":4104,"num_object_clones":0,"num_object_copies":12312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4104,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":32943,"num_write_kb":264614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":989940,"kb_used_data":737700,"kb_used_omap":55,"kb_used_meta":252104,"kb_avail":2935022860,"statfs":{"total":3006477107200,"available":3005463408640,"internally_reserved":0,"allocated":755404800,"data_stored":754688036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56613,"internal_metadata":258155227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":268763136,"num_objects":4102,"num_object_clones":0,"num_object_copies":12306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32808,"num_write_kb":262464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.908553"},"pg_stats":[{"pgid":"2.f","version":"31'2160","reported_seq":2174,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.734701+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:02.734701+0000","last_peered":"2026-02-24T07:48:02.734701+0000","last_clean":"2026-02-24T07:48:02.734701+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:02.734701+0000","last_undegraded":"2026-02-24T07:48:02.734701+0000","last_fullsized":"2026-02-24T07:48:02.734701+0000","mapping_epoch":29,"log_start":"31'2155","ondisk_log_start":"31'2155","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":2155,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2160,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'2096","reported_seq":2110,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.718323+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:02.718323+0000","last_peered":"2026-02-24T07:48:02.718323+0000","last_clean":"2026-02-24T07:48:02.718323+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:02.718323+0000","last_undegraded":"2026-02-24T07:48:02.718323+0000","last_fullsized":"2026-02-24T07:48:02.718323+0000","mapping_epoch":29,"log_start":"31'2064","ondisk_log_start":"31'2064","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2064,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2096,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'2192","reported_seq":2206,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.746883+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:02.746883+0000","last_peered":"2026-02-24T07:48:02.746883+0000","last_clean":"2026-02-24T07:48:02.746883+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:02.746883+0000","last_undegraded":"2026-02-24T07:48:02.746883+0000","last_fullsized":"2026-02-24T07:48:02.746883+0000","mapping_epoch":29,"log_start":"31'2176","ondisk_log_start":"31'2176","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2176,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2192,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'2016","reported_seq":2027,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.747688+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:02.747688+0000","last_peered":"2026-02-24T07:48:02.747688+0000","last_clean":"2026-02-24T07:48:02.747688+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:02.747688+0000","last_undegraded":"2026-02-24T07:48:02.747688+0000","last_fullsized":"2026-02-24T07:48:02.747688+0000","mapping_epoch":29,"log_start":"31'2008","ondisk_log_start":"31'2008","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2008,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2016,"num_write_kb":16128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'1944","reported_seq":1958,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.710876+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:02.710876+0000","last_peered":"2026-02-24T07:48:02.710876+0000","last_clean":"2026-02-24T07:48:02.710876+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:02.710876+0000","last_undegraded":"2026-02-24T07:48:02.710876+0000","last_fullsized":"2026-02-24T07:48:02.710876+0000","mapping_epoch":29,"log_start":"31'1936","ondisk_log_start":"31'1936","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1936,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1944,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'2074","reported_seq":2086,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.737736+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:02.737736+0000","last_peered":"2026-02-24T07:48:02.737736+0000","last_clean":"2026-02-24T07:48:02.737736+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:02.737736+0000","last_undegraded":"2026-02-24T07:48:02.737736+0000","last_fullsized":"2026-02-24T07:48:02.737736+0000","mapping_epoch":29,"log_start":"31'2057","ondisk_log_start":"31'2057","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":2057,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16990208,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2074,"num_write_kb":16592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'2136","reported_seq":2125,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.747054+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:02.747054+0000","last_peered":"2026-02-24T07:48:02.747054+0000","last_clean":"2026-02-24T07:48:02.747054+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:02.747054+0000","last_undegraded":"2026-02-24T07:48:02.747054+0000","last_fullsized":"2026-02-24T07:48:02.747054+0000","mapping_epoch":29,"log_start":"31'2105","ondisk_log_start":"31'2105","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":2105,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2136,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'1880","reported_seq":1884,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.744660+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:02.744660+0000","last_peered":"2026-02-24T07:48:02.744660+0000","last_clean":"2026-02-24T07:48:02.744660+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:02.744660+0000","last_undegraded":"2026-02-24T07:48:02.744660+0000","last_fullsized":"2026-02-24T07:48:02.744660+0000","mapping_epoch":29,"log_start":"31'1864","ondisk_log_start":"31'1864","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1864,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'1992","reported_seq":2006,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.741712+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:02.741712+0000","last_peered":"2026-02-24T07:48:02.741712+0000","last_clean":"2026-02-24T07:48:02.741712+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:02.741712+0000","last_undegraded":"2026-02-24T07:48:02.741712+0000","last_fullsized":"2026-02-24T07:48:02.741712+0000","mapping_epoch":29,"log_start":"31'1979","ondisk_log_start":"31'1979","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1979,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'2088","reported_seq":2100,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.735741+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:02.735741+0000","last_peered":"2026-02-24T07:48:02.735741+0000","last_clean":"2026-02-24T07:48:02.735741+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:02.735741+0000","last_undegraded":"2026-02-24T07:48:02.735741+0000","last_fullsized":"2026-02-24T07:48:02.735741+0000","mapping_epoch":29,"log_start":"31'2084","ondisk_log_start":"31'2084","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2084,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2088,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'2128","reported_seq":2137,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.747817+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:02.747817+0000","last_peered":"2026-02-24T07:48:02.747817+0000","last_clean":"2026-02-24T07:48:02.747817+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:02.747817+0000","last_undegraded":"2026-02-24T07:48:02.747817+0000","last_fullsized":"2026-02-24T07:48:02.747817+0000","mapping_epoch":29,"log_start":"31'2104","ondisk_log_start":"31'2104","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":2104,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2128,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'2120","reported_seq":2134,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.712757+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:02.712757+0000","last_peered":"2026-02-24T07:48:02.712757+0000","last_clean":"2026-02-24T07:48:02.712757+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:02.712757+0000","last_undegraded":"2026-02-24T07:48:02.712757+0000","last_fullsized":"2026-02-24T07:48:02.712757+0000","mapping_epoch":29,"log_start":"31'2096","ondisk_log_start":"31'2096","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":2096,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2120,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'1832","reported_seq":1846,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.732288+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:02.732288+0000","last_peered":"2026-02-24T07:48:02.732288+0000","last_clean":"2026-02-24T07:48:02.732288+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:02.732288+0000","last_undegraded":"2026-02-24T07:48:02.732288+0000","last_fullsized":"2026-02-24T07:48:02.732288+0000","mapping_epoch":29,"log_start":"31'1828","ondisk_log_start":"31'1828","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":1828,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1832,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'1936","reported_seq":1950,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.726058+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:02.726058+0000","last_peered":"2026-02-24T07:48:02.726058+0000","last_clean":"2026-02-24T07:48:02.726058+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:02.726058+0000","last_undegraded":"2026-02-24T07:48:02.726058+0000","last_fullsized":"2026-02-24T07:48:02.726058+0000","mapping_epoch":29,"log_start":"31'1928","ondisk_log_start":"31'1928","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1928,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'2232","reported_seq":2238,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.746622+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:02.746622+0000","last_peered":"2026-02-24T07:48:02.746622+0000","last_clean":"2026-02-24T07:48:02.746622+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:02.746622+0000","last_undegraded":"2026-02-24T07:48:02.746622+0000","last_fullsized":"2026-02-24T07:48:02.746622+0000","mapping_epoch":29,"log_start":"31'2221","ondisk_log_start":"31'2221","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2221,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2232,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'1982","reported_seq":1992,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:02.736402+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:02.736402+0000","last_peered":"2026-02-24T07:48:02.736402+0000","last_clean":"2026-02-24T07:48:02.736402+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:02.736402+0000","last_undegraded":"2026-02-24T07:48:02.736402+0000","last_fullsized":"2026-02-24T07:48:02.736402+0000","mapping_epoch":29,"log_start":"31'1977","ondisk_log_start":"31'1977","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":1977,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16236544,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1982,"num_write_kb":15856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":268763136,"num_objects":4102,"num_object_clones":0,"num_object_copies":12306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32808,"num_write_kb":262464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":807067648,"data_stored":807067648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215122,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":286756,"kb_used_data":223696,"kb_used_omap":9,"kb_used_meta":63030,"kb_avail":733716444,"statfs":{"total":751619276800,"available":751325638656,"internally_reserved":0,"allocated":229064704,"data_stored":228884625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":64543537},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444051,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":236892,"kb_used_data":173832,"kb_used_omap":13,"kb_used_meta":63026,"kb_avail":733766308,"statfs":{"total":751619276800,"available":751376699392,"internally_reserved":0,"allocated":178003968,"data_stored":177823889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":64539617},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":224240,"kb_used_data":161180,"kb_used_omap":15,"kb_used_meta":63024,"kb_avail":733778960,"statfs":{"total":751619276800,"available":751389655040,"internally_reserved":0,"allocated":165048320,"data_stored":164871793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":64537013},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":242052,"kb_used_data":178992,"kb_used_omap":17,"kb_used_meta":63022,"kb_avail":733761148,"statfs":{"total":751619276800,"available":751371415552,"internally_reserved":0,"allocated":183287808,"data_stored":183107729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":64535060},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":184442880,"data_stored":184442880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":202768384,"data_stored":202768384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184172544,"data_stored":184172544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":235683840,"data_stored":235683840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:04.802 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:04.803 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 26 2026-02-24T07:48:04.930 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:04.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 51621 51493 67.0431 63.8906 0.00193504 0.0148897 2026-02-24T07:48:04.944 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:05.008 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:04 trial016 ceph-mon[39544]: pgmap v44: 17 pgs: 17 active+clean; 257 MiB data, 967 MiB used, 2.7 TiB / 2.7 TiB avail; 37 MiB/s wr, 4.75k op/s 2026-02-24T07:48:05.009 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:05.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:05.068+0000 7fecc0f66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:05.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:05.068+0000 7fecc0f66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:05.071 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:05.187 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:05.185+0000 7f39d60de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:05.187 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:05.185+0000 7f39d60de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:05.203 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:05.203 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:05.222 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:05.222 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:05.225 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:05.235 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:05.235 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:05.256 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:05.256 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:05.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:05.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 128 60168 60040 67.0038 66.7734 0.00450573 0.0149081 2026-02-24T07:48:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:05 trial016 ceph-mon[39544]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3072589552' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1566076315' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:48:06.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 69207 69079 67.4548 70.6172 0.0133785 0.0148073 2026-02-24T07:48:07.302 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:07.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:06 trial016 ceph-mon[39544]: pgmap v45: 17 pgs: 17 active+clean; 257 MiB data, 967 MiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.10k op/s 2026-02-24T07:48:07.448 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:07.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 77449 77321 67.1138 64.3906 0.0145637 0.0148812 2026-02-24T07:48:07.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:07.945+0000 7fce477e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:07.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:07.946+0000 7fce477e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:07.983 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:07.983 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:07.993 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:07.993 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:08.012 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:08.012 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:08.025 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:08.025 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:08.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 128 84187 84059 65.6661 52.6406 0.00916802 0.0152049 2026-02-24T07:48:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:08 trial016 ceph-mon[39544]: pgmap v46: 17 pgs: 17 active+clean; 594 MiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.66k op/s 2026-02-24T07:48:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/140855838' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:09.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 92081 91953 65.3026 61.6719 0.00295348 0.0152957 2026-02-24T07:48:10.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:10.267 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:10.267 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:48:10.267 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:10.410 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:10.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:10.533+0000 7fc32b426640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:10.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:10.534+0000 7fc32b426640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:10.686 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:10.686 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:10.731 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2026-02-24T07:48:09.751070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":622567968,"num_objects":9494,"num_object_clones":0,"num_object_copies":28482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9494,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":76060,"num_write_kb":609550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":2340316,"kb_used_data":1781252,"kb_used_omap":55,"kb_used_meta":558920,"kb_avail":2933672484,"statfs":{"total":3006477107200,"available":3004080623616,"internally_reserved":0,"allocated":1824002048,"data_stored":1823285284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56613,"internal_metadata":572334811},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":621977600,"num_objects":9492,"num_object_clones":0,"num_object_copies":28476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75925,"num_write_kb":607400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.901570"},"pg_stats":[{"pgid":"2.f","version":"31'4928","reported_seq":4942,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.718620+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:07.718620+0000","last_peered":"2026-02-24T07:48:07.718620+0000","last_clean":"2026-02-24T07:48:07.718620+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:07.718620+0000","last_undegraded":"2026-02-24T07:48:07.718620+0000","last_fullsized":"2026-02-24T07:48:07.718620+0000","mapping_epoch":29,"log_start":"31'4920","ondisk_log_start":"31'4920","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4928,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'4880","reported_seq":4886,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.738089+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:07.738089+0000","last_peered":"2026-02-24T07:48:07.738089+0000","last_clean":"2026-02-24T07:48:07.738089+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:07.738089+0000","last_undegraded":"2026-02-24T07:48:07.738089+0000","last_fullsized":"2026-02-24T07:48:07.738089+0000","mapping_epoch":29,"log_start":"31'4871","ondisk_log_start":"31'4871","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4880,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'4592","reported_seq":4606,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.703465+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:07.703465+0000","last_peered":"2026-02-24T07:48:07.703465+0000","last_clean":"2026-02-24T07:48:07.703465+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:07.703465+0000","last_undegraded":"2026-02-24T07:48:07.703465+0000","last_fullsized":"2026-02-24T07:48:07.703465+0000","mapping_epoch":29,"log_start":"31'4584","ondisk_log_start":"31'4584","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37617664,"num_objects":574,"num_object_clones":0,"num_object_copies":1722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4592,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'4432","reported_seq":4439,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.740969+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:07.740969+0000","last_peered":"2026-02-24T07:48:07.740969+0000","last_clean":"2026-02-24T07:48:07.740969+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:07.740969+0000","last_undegraded":"2026-02-24T07:48:07.740969+0000","last_fullsized":"2026-02-24T07:48:07.740969+0000","mapping_epoch":29,"log_start":"31'4424","ondisk_log_start":"31'4424","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'4336","reported_seq":4350,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.746681+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:07.746681+0000","last_peered":"2026-02-24T07:48:07.746681+0000","last_clean":"2026-02-24T07:48:07.746681+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:07.746681+0000","last_undegraded":"2026-02-24T07:48:07.746681+0000","last_fullsized":"2026-02-24T07:48:07.746681+0000","mapping_epoch":29,"log_start":"31'4320","ondisk_log_start":"31'4320","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4336,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'4618","reported_seq":4630,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.746974+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:07.746974+0000","last_peered":"2026-02-24T07:48:07.746974+0000","last_clean":"2026-02-24T07:48:07.746974+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:07.746974+0000","last_undegraded":"2026-02-24T07:48:07.746974+0000","last_fullsized":"2026-02-24T07:48:07.746974+0000","mapping_epoch":29,"log_start":"31'4609","ondisk_log_start":"31'4609","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37830656,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4618,"num_write_kb":36944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'4696","reported_seq":4710,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.740459+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:07.740459+0000","last_peered":"2026-02-24T07:48:07.740459+0000","last_clean":"2026-02-24T07:48:07.740459+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:07.740459+0000","last_undegraded":"2026-02-24T07:48:07.740459+0000","last_fullsized":"2026-02-24T07:48:07.740459+0000","mapping_epoch":29,"log_start":"31'4680","ondisk_log_start":"31'4680","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4696,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'4680","reported_seq":4694,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.745669+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:07.745669+0000","last_peered":"2026-02-24T07:48:07.745669+0000","last_clean":"2026-02-24T07:48:07.745669+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:07.745669+0000","last_undegraded":"2026-02-24T07:48:07.745669+0000","last_fullsized":"2026-02-24T07:48:07.745669+0000","mapping_epoch":29,"log_start":"31'4666","ondisk_log_start":"31'4666","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4680,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'4832","reported_seq":4846,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.692833+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:07.692833+0000","last_peered":"2026-02-24T07:48:07.692833+0000","last_clean":"2026-02-24T07:48:07.692833+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:07.692833+0000","last_undegraded":"2026-02-24T07:48:07.692833+0000","last_fullsized":"2026-02-24T07:48:07.692833+0000","mapping_epoch":29,"log_start":"31'4824","ondisk_log_start":"31'4824","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39583744,"num_objects":604,"num_object_clones":0,"num_object_copies":1812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4832,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'4928","reported_seq":4942,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.739562+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:07.739562+0000","last_peered":"2026-02-24T07:48:07.739562+0000","last_clean":"2026-02-24T07:48:07.739562+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:07.739562+0000","last_undegraded":"2026-02-24T07:48:07.739562+0000","last_fullsized":"2026-02-24T07:48:07.739562+0000","mapping_epoch":29,"log_start":"31'4917","ondisk_log_start":"31'4917","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4928,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'4923","reported_seq":4919,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.724609+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:07.724609+0000","last_peered":"2026-02-24T07:48:07.724609+0000","last_clean":"2026-02-24T07:48:07.724609+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:07.724609+0000","last_undegraded":"2026-02-24T07:48:07.724609+0000","last_fullsized":"2026-02-24T07:48:07.724609+0000","mapping_epoch":29,"log_start":"31'4904","ondisk_log_start":"31'4904","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40329216,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4923,"num_write_kb":39384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'4904","reported_seq":4918,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.733601+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:07.733601+0000","last_peered":"2026-02-24T07:48:07.733601+0000","last_clean":"2026-02-24T07:48:07.733601+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:07.733601+0000","last_undegraded":"2026-02-24T07:48:07.733601+0000","last_fullsized":"2026-02-24T07:48:07.733601+0000","mapping_epoch":29,"log_start":"31'4883","ondisk_log_start":"31'4883","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40173568,"num_objects":613,"num_object_clones":0,"num_object_copies":1839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4904,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'4648","reported_seq":4662,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.740474+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:07.740474+0000","last_peered":"2026-02-24T07:48:07.740474+0000","last_clean":"2026-02-24T07:48:07.740474+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:07.740474+0000","last_undegraded":"2026-02-24T07:48:07.740474+0000","last_fullsized":"2026-02-24T07:48:07.740474+0000","mapping_epoch":29,"log_start":"31'4626","ondisk_log_start":"31'4626","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38076416,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4648,"num_write_kb":37184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'4536","reported_seq":4550,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.737805+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:07.737805+0000","last_peered":"2026-02-24T07:48:07.737805+0000","last_clean":"2026-02-24T07:48:07.737805+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:07.737805+0000","last_undegraded":"2026-02-24T07:48:07.737805+0000","last_fullsized":"2026-02-24T07:48:07.737805+0000","mapping_epoch":29,"log_start":"31'4523","ondisk_log_start":"31'4523","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4536,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'5272","reported_seq":5286,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.739567+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:07.739567+0000","last_peered":"2026-02-24T07:48:07.739567+0000","last_clean":"2026-02-24T07:48:07.739567+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:07.739567+0000","last_undegraded":"2026-02-24T07:48:07.739567+0000","last_fullsized":"2026-02-24T07:48:07.739567+0000","mapping_epoch":29,"log_start":"31'5264","ondisk_log_start":"31'5264","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5272,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'4720","reported_seq":4734,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:07.728409+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:07.728409+0000","last_peered":"2026-02-24T07:48:07.728409+0000","last_clean":"2026-02-24T07:48:07.728409+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:07.728409+0000","last_undegraded":"2026-02-24T07:48:07.728409+0000","last_fullsized":"2026-02-24T07:48:07.728409+0000","mapping_epoch":29,"log_start":"31'4695","ondisk_log_start":"31'4695","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38666240,"num_objects":590,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4720,"num_write_kb":37760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":621977600,"num_objects":9492,"num_object_clones":0,"num_object_copies":28476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75925,"num_write_kb":607400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1866326016,"data_stored":1866326016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215123,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":682012,"kb_used_data":528712,"kb_used_omap":9,"kb_used_meta":153270,"kb_avail":733321188,"statfs":{"total":751619276800,"available":750920896512,"internally_reserved":0,"allocated":541401088,"data_stored":541221009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":156949297},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444052,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":554404,"kb_used_data":419152,"kb_used_omap":13,"kb_used_meta":135218,"kb_avail":733448796,"statfs":{"total":751619276800,"available":751051567104,"internally_reserved":0,"allocated":429211648,"data_stored":429031569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":138464225},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":556296,"kb_used_data":421044,"kb_used_omap":15,"kb_used_meta":135216,"kb_avail":733446904,"statfs":{"total":751619276800,"available":751049629696,"internally_reserved":0,"allocated":431149056,"data_stored":430972529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":138461621},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":547604,"kb_used_data":412344,"kb_used_omap":17,"kb_used_meta":135214,"kb_avail":733455596,"statfs":{"total":751619276800,"available":751058530304,"internally_reserved":0,"allocated":422240256,"data_stored":422060177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":138459668},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":424574976,"data_stored":424574976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":464961536,"data_stored":464961536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":434438144,"data_stored":434438144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":542351360,"data_stored":542351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:10.735 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:10.735 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 36 2026-02-24T07:48:10.803 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:10.878 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:10.938 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:10 trial016 ceph-mon[39544]: pgmap v47: 17 pgs: 17 active+clean; 594 MiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.96k op/s 2026-02-24T07:48:10.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 100421 100293 65.29 65.1562 0.00858371 0.0153049 2026-02-24T07:48:10.942 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:11.010 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:11.007+0000 7f5b521b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:11.010 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:11.008+0000 7f5b521b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:11.068 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:11.065+0000 7fb0741da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:11.068 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:11.066+0000 7fb0741da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:11.082 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:11.083 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:11.099 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:11.099 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:11.112 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:11.113 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:11.129 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:11.129 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:11.151 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:11.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:11.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 108744 108616 65.2691 65.0234 0.00409058 0.01531 2026-02-24T07:48:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:11 trial016 ceph-mon[39544]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3231400894' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/933848310' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:48:12.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 128 116996 116868 65.2116 64.4688 0.014891 0.0153197 2026-02-24T07:48:13.173 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:13.198 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:12 trial016 ceph-mon[39544]: pgmap v48: 17 pgs: 17 active+clean; 594 MiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.33k op/s 2026-02-24T07:48:13.311 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:13.439 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:13.437+0000 7fdb607d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:13.440 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:13.438+0000 7fdb607d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:13.454 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:13.454 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:13.485 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:13.485 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:13.498 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:13.498 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:13.511 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:13.511 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:13.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 125342 125214 65.2108 65.2031 0.00744846 0.0153218 2026-02-24T07:48:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1341197773' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:14.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 134055 133927 65.3892 68.0703 0.00355946 0.0152828 2026-02-24T07:48:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:14 trial016 ceph-mon[39544]: pgmap v49: 17 pgs: 17 active+clean; 902 MiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail; 75 MiB/s wr, 9.61k op/s 2026-02-24T07:48:15.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:15.556 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:15.702 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:15.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:15.822+0000 7f4dca92e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:15.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:15.823+0000 7f4dca92e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:15.838 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:15.838 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:15.862 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:15.862 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:15.877 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:15.878 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:15.893 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:15.893 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:15.940 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 142412 142284 65.383 65.2891 0.00979237 0.0152866 2026-02-24T07:48:16.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:16.194 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:16.195 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:48:16.195 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:16.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:15 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2292705978' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:16.335 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:16.448 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:16.446+0000 7f7117f21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:16.449 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:16.446+0000 7f7117f21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:16.583 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:16.584 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:16.628 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-24T07:48:15.751832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945504800,"num_objects":14421,"num_object_clones":0,"num_object_copies":43263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14421,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":115481,"num_write_kb":924918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3582140,"kb_used_data":2734292,"kb_used_omap":55,"kb_used_meta":847688,"kb_avail":2932430660,"statfs":{"total":3006477107200,"available":3002808995840,"internally_reserved":0,"allocated":2799915008,"data_stored":2799198244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56613,"internal_metadata":868033243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":676151296,"num_objects":10317,"num_object_clones":0,"num_object_copies":30951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82538,"num_write_kb":660304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001550"},"pg_stats":[{"pgid":"2.f","version":"31'7480","reported_seq":7494,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.747794+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:12.747794+0000","last_peered":"2026-02-24T07:48:12.747794+0000","last_clean":"2026-02-24T07:48:12.747794+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:12.747794+0000","last_undegraded":"2026-02-24T07:48:12.747794+0000","last_fullsized":"2026-02-24T07:48:12.747794+0000","mapping_epoch":29,"log_start":"31'7476","ondisk_log_start":"31'7476","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61276160,"num_objects":935,"num_object_clones":0,"num_object_copies":2805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7480,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'7504","reported_seq":7518,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.721464+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:12.721464+0000","last_peered":"2026-02-24T07:48:12.721464+0000","last_clean":"2026-02-24T07:48:12.721464+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:12.721464+0000","last_undegraded":"2026-02-24T07:48:12.721464+0000","last_fullsized":"2026-02-24T07:48:12.721464+0000","mapping_epoch":29,"log_start":"31'7496","ondisk_log_start":"31'7496","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61472768,"num_objects":938,"num_object_clones":0,"num_object_copies":2814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7504,"num_write_kb":60032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'7168","reported_seq":7174,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.748281+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:12.748281+0000","last_peered":"2026-02-24T07:48:12.748281+0000","last_clean":"2026-02-24T07:48:12.748281+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:12.748281+0000","last_undegraded":"2026-02-24T07:48:12.748281+0000","last_fullsized":"2026-02-24T07:48:12.748281+0000","mapping_epoch":29,"log_start":"31'7144","ondisk_log_start":"31'7144","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7168,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'6951","reported_seq":6958,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.750421+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:12.750421+0000","last_peered":"2026-02-24T07:48:12.750421+0000","last_clean":"2026-02-24T07:48:12.750421+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:12.750421+0000","last_undegraded":"2026-02-24T07:48:12.750421+0000","last_fullsized":"2026-02-24T07:48:12.750421+0000","mapping_epoch":29,"log_start":"31'6941","ondisk_log_start":"31'6941","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942592,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6951,"num_write_kb":55608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'6872","reported_seq":6886,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.718562+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:12.718562+0000","last_peered":"2026-02-24T07:48:12.718562+0000","last_clean":"2026-02-24T07:48:12.718562+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:12.718562+0000","last_undegraded":"2026-02-24T07:48:12.718562+0000","last_fullsized":"2026-02-24T07:48:12.718562+0000","mapping_epoch":29,"log_start":"31'6856","ondisk_log_start":"31'6856","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6872,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'7128","reported_seq":7142,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.736716+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:12.736716+0000","last_peered":"2026-02-24T07:48:12.736716+0000","last_clean":"2026-02-24T07:48:12.736716+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:12.736716+0000","last_undegraded":"2026-02-24T07:48:12.736716+0000","last_fullsized":"2026-02-24T07:48:12.736716+0000","mapping_epoch":29,"log_start":"31'7120","ondisk_log_start":"31'7120","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7128,"num_write_kb":57024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'6984","reported_seq":6990,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.733291+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:12.733291+0000","last_peered":"2026-02-24T07:48:12.733291+0000","last_clean":"2026-02-24T07:48:12.733291+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:12.733291+0000","last_undegraded":"2026-02-24T07:48:12.733291+0000","last_fullsized":"2026-02-24T07:48:12.733291+0000","mapping_epoch":29,"log_start":"31'6975","ondisk_log_start":"31'6975","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":873,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6984,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'7120","reported_seq":7122,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.742686+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:12.742686+0000","last_peered":"2026-02-24T07:48:12.742686+0000","last_clean":"2026-02-24T07:48:12.742686+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:12.742686+0000","last_undegraded":"2026-02-24T07:48:12.742686+0000","last_fullsized":"2026-02-24T07:48:12.742686+0000","mapping_epoch":29,"log_start":"31'7104","ondisk_log_start":"31'7104","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58327040,"num_objects":890,"num_object_clones":0,"num_object_copies":2670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7120,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'7296","reported_seq":7310,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.745651+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:12.745651+0000","last_peered":"2026-02-24T07:48:12.745651+0000","last_clean":"2026-02-24T07:48:12.745651+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:12.745651+0000","last_undegraded":"2026-02-24T07:48:12.745651+0000","last_fullsized":"2026-02-24T07:48:12.745651+0000","mapping_epoch":29,"log_start":"31'7265","ondisk_log_start":"31'7265","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":3000,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59768832,"num_objects":912,"num_object_clones":0,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7296,"num_write_kb":58368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'7216","reported_seq":7230,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.733173+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:12.733173+0000","last_peered":"2026-02-24T07:48:12.733173+0000","last_clean":"2026-02-24T07:48:12.733173+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:12.733173+0000","last_undegraded":"2026-02-24T07:48:12.733173+0000","last_fullsized":"2026-02-24T07:48:12.733173+0000","mapping_epoch":29,"log_start":"31'7213","ondisk_log_start":"31'7213","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59113472,"num_objects":902,"num_object_clones":0,"num_object_copies":2706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7216,"num_write_kb":57728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'7235","reported_seq":7246,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.749503+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:12.749503+0000","last_peered":"2026-02-24T07:48:12.749503+0000","last_clean":"2026-02-24T07:48:12.749503+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:12.749503+0000","last_undegraded":"2026-02-24T07:48:12.749503+0000","last_fullsized":"2026-02-24T07:48:12.749503+0000","mapping_epoch":29,"log_start":"31'7230","ondisk_log_start":"31'7230","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59269120,"num_objects":905,"num_object_clones":0,"num_object_copies":2715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7235,"num_write_kb":57880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'7328","reported_seq":7342,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.716841+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:12.716841+0000","last_peered":"2026-02-24T07:48:12.716841+0000","last_clean":"2026-02-24T07:48:12.716841+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:12.716841+0000","last_undegraded":"2026-02-24T07:48:12.716841+0000","last_fullsized":"2026-02-24T07:48:12.716841+0000","mapping_epoch":29,"log_start":"31'7312","ondisk_log_start":"31'7312","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7328,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'7136","reported_seq":7150,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.748470+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:12.748470+0000","last_peered":"2026-02-24T07:48:12.748470+0000","last_clean":"2026-02-24T07:48:12.748470+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:12.748470+0000","last_undegraded":"2026-02-24T07:48:12.748470+0000","last_fullsized":"2026-02-24T07:48:12.748470+0000","mapping_epoch":29,"log_start":"31'7128","ondisk_log_start":"31'7128","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7136,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'7312","reported_seq":7326,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.750815+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:12.750815+0000","last_peered":"2026-02-24T07:48:12.750815+0000","last_clean":"2026-02-24T07:48:12.750815+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:12.750815+0000","last_undegraded":"2026-02-24T07:48:12.750815+0000","last_fullsized":"2026-02-24T07:48:12.750815+0000","mapping_epoch":29,"log_start":"31'7296","ondisk_log_start":"31'7296","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59899904,"num_objects":914,"num_object_clones":0,"num_object_copies":2742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7312,"num_write_kb":58496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'7592","reported_seq":7606,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.751150+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:12.751150+0000","last_peered":"2026-02-24T07:48:12.751150+0000","last_clean":"2026-02-24T07:48:12.751150+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:12.751150+0000","last_undegraded":"2026-02-24T07:48:12.751150+0000","last_fullsized":"2026-02-24T07:48:12.751150+0000","mapping_epoch":29,"log_start":"31'7576","ondisk_log_start":"31'7576","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62193664,"num_objects":949,"num_object_clones":0,"num_object_copies":2847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7592,"num_write_kb":60736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'7024","reported_seq":7038,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:12.707727+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:12.707727+0000","last_peered":"2026-02-24T07:48:12.707727+0000","last_clean":"2026-02-24T07:48:12.707727+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:12.707727+0000","last_undegraded":"2026-02-24T07:48:12.707727+0000","last_fullsized":"2026-02-24T07:48:12.707727+0000","mapping_epoch":29,"log_start":"31'7008","ondisk_log_start":"31'7008","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57540608,"num_objects":878,"num_object_clones":0,"num_object_copies":2634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7024,"num_write_kb":56192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":944914432,"num_objects":14419,"num_object_clones":0,"num_object_copies":43257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115346,"num_write_kb":922768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2834989056,"data_stored":2834989056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215124,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1084660,"kb_used_data":805016,"kb_used_omap":9,"kb_used_meta":279606,"kb_avail":732918540,"statfs":{"total":751619276800,"available":750508584960,"internally_reserved":0,"allocated":824336384,"data_stored":824156305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":286317361},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444053,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":825708,"kb_used_data":636312,"kb_used_omap":13,"kb_used_meta":189362,"kb_avail":733177492,"statfs":{"total":751619276800,"available":750773751808,"internally_reserved":0,"allocated":651583488,"data_stored":651403409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":193907681},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":848912,"kb_used_data":659500,"kb_used_omap":15,"kb_used_meta":189360,"kb_avail":733154288,"statfs":{"total":751619276800,"available":750749990912,"internally_reserved":0,"allocated":675328000,"data_stored":675151473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":193905077},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":822860,"kb_used_data":633464,"kb_used_omap":17,"kb_used_meta":189358,"kb_avail":733180340,"statfs":{"total":751619276800,"available":750776668160,"internally_reserved":0,"allocated":648667136,"data_stored":648487057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":193903124},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":648814592,"data_stored":648814592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":708493312,"data_stored":708493312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":653852672,"data_stored":653852672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":823828480,"data_stored":823828480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:16.630 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:16.630 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 46 2026-02-24T07:48:16.811 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:16.934 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:16.932+0000 7fce73097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:16.935 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:16.932+0000 7fce73097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:16.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 127 150584 150457 65.2977 63.8516 0.011969 0.0153066 2026-02-24T07:48:17.075 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:17.088 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:16 trial016 ceph-mon[39544]: pgmap v50: 17 pgs: 17 active+clean; 902 MiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.88k op/s 2026-02-24T07:48:17.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:17.936 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:17.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 127 158803 158676 65.2402 64.2109 0.0205133 0.0153165 2026-02-24T07:48:18.076 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:18.131 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:17 trial016 ceph-mon[39544]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:18.131 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3124597491' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T07:48:18.202 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:18.200+0000 7f4758c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:18.203 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:18.200+0000 7f4758c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:18.216 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:18.217 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:18.230 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:18.231 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:18.246 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:18.247 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:18.269 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:18.269 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:18.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:48:18.940194+0000 min lat: 0.000684159 max lat: 0.058818 avg lat: 0.0152944 2026-02-24T07:48:18.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:48:18.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 127 167417 167290 65.3428 67.2969 0.0155212 0.0152944 2026-02-24T07:48:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:18 trial016 ceph-mon[39544]: pgmap v51: 17 pgs: 17 active+clean; 1.0 GiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.59k op/s 2026-02-24T07:48:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1351877417' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:19.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 175819 175691 65.3563 65.6328 0.022115 0.0152909 2026-02-24T07:48:20.319 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:20.460 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:20.587 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:20.585+0000 7f0c20955640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:20.587 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:20.586+0000 7f0c20955640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:20.604 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:20.604 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:20.629 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:20.630 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:20.642 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:20.643 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:20.656 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:20.656 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:20.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 128 184903 184775 65.6112 70.9688 0.0190749 0.0152345 2026-02-24T07:48:21.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:20 trial016 ceph-mon[39544]: pgmap v52: 17 pgs: 17 active+clean; 1.2 GiB data, 4.7 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.78k op/s 2026-02-24T07:48:21.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/473075735' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:21.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 128 193797 193669 65.7794 69.4844 0.00397967 0.0151961 2026-02-24T07:48:22.117 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:22.117 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:22.117 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:48:22.117 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:22.260 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:22.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.374+0000 7ff48bb82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.374+0000 7ff48bb82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.508 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:22.509 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:22.553 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2026-02-24T07:48:21.752518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1288733216,"num_objects":19659,"num_object_clones":0,"num_object_copies":58977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19659,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":157379,"num_write_kb":1260102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4964284,"kb_used_data":3737452,"kb_used_omap":55,"kb_used_meta":1226696,"kb_avail":2931048516,"statfs":{"total":3006477107200,"available":3001393680384,"internally_reserved":0,"allocated":3827150848,"data_stored":3826434084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56613,"internal_metadata":1256137435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,13,8,30,36],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":666165248,"num_objects":10165,"num_object_clones":0,"num_object_copies":30495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81319,"num_write_kb":650552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001447"},"pg_stats":[{"pgid":"2.f","version":"31'10064","reported_seq":10078,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.743865+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:17.743865+0000","last_peered":"2026-02-24T07:48:17.743865+0000","last_clean":"2026-02-24T07:48:17.743865+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:17.743865+0000","last_undegraded":"2026-02-24T07:48:17.743865+0000","last_fullsized":"2026-02-24T07:48:17.743865+0000","mapping_epoch":29,"log_start":"31'10061","ondisk_log_start":"31'10061","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82444288,"num_objects":1258,"num_object_clones":0,"num_object_copies":3774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10064,"num_write_kb":80512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'10128","reported_seq":10142,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.729918+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:17.729918+0000","last_peered":"2026-02-24T07:48:17.729918+0000","last_clean":"2026-02-24T07:48:17.729918+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:17.729918+0000","last_undegraded":"2026-02-24T07:48:17.729918+0000","last_fullsized":"2026-02-24T07:48:17.729918+0000","mapping_epoch":29,"log_start":"31'10112","ondisk_log_start":"31'10112","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82968576,"num_objects":1266,"num_object_clones":0,"num_object_copies":3798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10128,"num_write_kb":81024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'10008","reported_seq":10022,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.711946+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:17.711946+0000","last_peered":"2026-02-24T07:48:17.711946+0000","last_clean":"2026-02-24T07:48:17.711946+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:17.711946+0000","last_undegraded":"2026-02-24T07:48:17.711946+0000","last_fullsized":"2026-02-24T07:48:17.711946+0000","mapping_epoch":29,"log_start":"31'9976","ondisk_log_start":"31'9976","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81985536,"num_objects":1251,"num_object_clones":0,"num_object_copies":3753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10008,"num_write_kb":80064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'9642","reported_seq":9654,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.733215+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:17.733215+0000","last_peered":"2026-02-24T07:48:17.733215+0000","last_clean":"2026-02-24T07:48:17.733215+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:17.733215+0000","last_undegraded":"2026-02-24T07:48:17.733215+0000","last_fullsized":"2026-02-24T07:48:17.733215+0000","mapping_epoch":29,"log_start":"31'9636","ondisk_log_start":"31'9636","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78987264,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9642,"num_write_kb":77136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9552","reported_seq":9566,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.747168+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:17.747168+0000","last_peered":"2026-02-24T07:48:17.747168+0000","last_clean":"2026-02-24T07:48:17.747168+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:17.747168+0000","last_undegraded":"2026-02-24T07:48:17.747168+0000","last_fullsized":"2026-02-24T07:48:17.747168+0000","mapping_epoch":29,"log_start":"31'9544","ondisk_log_start":"31'9544","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78249984,"num_objects":1194,"num_object_clones":0,"num_object_copies":3582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9552,"num_write_kb":76416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'9736","reported_seq":9750,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.748249+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:17.748249+0000","last_peered":"2026-02-24T07:48:17.748249+0000","last_clean":"2026-02-24T07:48:17.748249+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:17.748249+0000","last_undegraded":"2026-02-24T07:48:17.748249+0000","last_fullsized":"2026-02-24T07:48:17.748249+0000","mapping_epoch":29,"log_start":"31'9720","ondisk_log_start":"31'9720","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79757312,"num_objects":1217,"num_object_clones":0,"num_object_copies":3651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9736,"num_write_kb":77888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'9624","reported_seq":9633,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.741452+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:17.741452+0000","last_peered":"2026-02-24T07:48:17.741452+0000","last_clean":"2026-02-24T07:48:17.741452+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:17.741452+0000","last_undegraded":"2026-02-24T07:48:17.741452+0000","last_fullsized":"2026-02-24T07:48:17.741452+0000","mapping_epoch":29,"log_start":"31'9608","ondisk_log_start":"31'9608","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78839808,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9624,"num_write_kb":76992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'9800","reported_seq":9814,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.722609+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:17.722609+0000","last_peered":"2026-02-24T07:48:17.722609+0000","last_clean":"2026-02-24T07:48:17.722609+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:17.722609+0000","last_undegraded":"2026-02-24T07:48:17.722609+0000","last_fullsized":"2026-02-24T07:48:17.722609+0000","mapping_epoch":29,"log_start":"31'9784","ondisk_log_start":"31'9784","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80281600,"num_objects":1225,"num_object_clones":0,"num_object_copies":3675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9800,"num_write_kb":78400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'9896","reported_seq":9910,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.731734+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:17.731734+0000","last_peered":"2026-02-24T07:48:17.731734+0000","last_clean":"2026-02-24T07:48:17.731734+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:17.731734+0000","last_undegraded":"2026-02-24T07:48:17.731734+0000","last_fullsized":"2026-02-24T07:48:17.731734+0000","mapping_epoch":29,"log_start":"31'9888","ondisk_log_start":"31'9888","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81068032,"num_objects":1237,"num_object_clones":0,"num_object_copies":3711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9896,"num_write_kb":79168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'9480","reported_seq":9494,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.743854+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:17.743854+0000","last_peered":"2026-02-24T07:48:17.743854+0000","last_clean":"2026-02-24T07:48:17.743854+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:17.743854+0000","last_undegraded":"2026-02-24T07:48:17.743854+0000","last_fullsized":"2026-02-24T07:48:17.743854+0000","mapping_epoch":29,"log_start":"31'9476","ondisk_log_start":"31'9476","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77660160,"num_objects":1185,"num_object_clones":0,"num_object_copies":3555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9480,"num_write_kb":75840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'9952","reported_seq":9966,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.738732+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:17.738732+0000","last_peered":"2026-02-24T07:48:17.738732+0000","last_clean":"2026-02-24T07:48:17.738732+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:17.738732+0000","last_undegraded":"2026-02-24T07:48:17.738732+0000","last_fullsized":"2026-02-24T07:48:17.738732+0000","mapping_epoch":29,"log_start":"31'9936","ondisk_log_start":"31'9936","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81526784,"num_objects":1244,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9952,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'9730","reported_seq":9742,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.748646+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:17.748646+0000","last_peered":"2026-02-24T07:48:17.748646+0000","last_clean":"2026-02-24T07:48:17.748646+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:17.748646+0000","last_undegraded":"2026-02-24T07:48:17.748646+0000","last_fullsized":"2026-02-24T07:48:17.748646+0000","mapping_epoch":29,"log_start":"31'9720","ondisk_log_start":"31'9720","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79708160,"num_objects":1217,"num_object_clones":0,"num_object_copies":3651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9730,"num_write_kb":77840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'9872","reported_seq":9886,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.737567+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:17.737567+0000","last_peered":"2026-02-24T07:48:17.737567+0000","last_clean":"2026-02-24T07:48:17.737567+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:17.737567+0000","last_undegraded":"2026-02-24T07:48:17.737567+0000","last_fullsized":"2026-02-24T07:48:17.737567+0000","mapping_epoch":29,"log_start":"31'9864","ondisk_log_start":"31'9864","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80871424,"num_objects":1234,"num_object_clones":0,"num_object_copies":3702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9872,"num_write_kb":78976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'9784","reported_seq":9798,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.740198+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:17.740198+0000","last_peered":"2026-02-24T07:48:17.740198+0000","last_clean":"2026-02-24T07:48:17.740198+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:17.740198+0000","last_undegraded":"2026-02-24T07:48:17.740198+0000","last_fullsized":"2026-02-24T07:48:17.740198+0000","mapping_epoch":29,"log_start":"31'9744","ondisk_log_start":"31'9744","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80150528,"num_objects":1223,"num_object_clones":0,"num_object_copies":3669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9784,"num_write_kb":78272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'10328","reported_seq":10342,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.736238+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:17.736238+0000","last_peered":"2026-02-24T07:48:17.736238+0000","last_clean":"2026-02-24T07:48:17.736238+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:17.736238+0000","last_undegraded":"2026-02-24T07:48:17.736238+0000","last_fullsized":"2026-02-24T07:48:17.736238+0000","mapping_epoch":29,"log_start":"31'10312","ondisk_log_start":"31'10312","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84606976,"num_objects":1291,"num_object_clones":0,"num_object_copies":3873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10328,"num_write_kb":82624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'9648","reported_seq":9662,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:17.744508+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:17.744508+0000","last_peered":"2026-02-24T07:48:17.744508+0000","last_clean":"2026-02-24T07:48:17.744508+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:17.744508+0000","last_undegraded":"2026-02-24T07:48:17.744508+0000","last_fullsized":"2026-02-24T07:48:17.744508+0000","mapping_epoch":29,"log_start":"31'9642","ondisk_log_start":"31'9642","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79036416,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9648,"num_write_kb":77184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1288142848,"num_objects":19657,"num_object_clones":0,"num_object_copies":58971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157244,"num_write_kb":1257952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3865952256,"data_stored":3865952256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215125,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1445396,"kb_used_data":1093568,"kb_used_omap":9,"kb_used_meta":351798,"kb_avail":732557804,"statfs":{"total":751619276800,"available":750139191296,"internally_reserved":0,"allocated":1119813632,"data_stored":1119633553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":360241969},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1163796,"kb_used_data":866112,"kb_used_omap":13,"kb_used_meta":297650,"kb_avail":732839404,"statfs":{"total":751619276800,"available":750427549696,"internally_reserved":0,"allocated":886898688,"data_stored":886718609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":304794593},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1193712,"kb_used_data":914076,"kb_used_omap":15,"kb_used_meta":279600,"kb_avail":732809488,"statfs":{"total":751619276800,"available":750396915712,"internally_reserved":0,"allocated":936013824,"data_stored":935837297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":286310837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,13,8,28,36],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1161380,"kb_used_data":863696,"kb_used_omap":17,"kb_used_meta":297646,"kb_avail":732841820,"statfs":{"total":751619276800,"available":750430023680,"internally_reserved":0,"allocated":884424704,"data_stored":884244625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":304790036},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":884211712,"data_stored":884211712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968933376,"data_stored":968933376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":888504320,"data_stored":888504320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1124302848,"data_stored":1124302848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:22.555 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:22.555 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 11 2026-02-24T07:48:22.697 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:22.702 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:22.827 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.824+0000 7fb1231b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.827 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.825+0000 7fb1231b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.846 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:22.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 127 203051 202924 66.051 72.3047 0.0184808 0.0151329 2026-02-24T07:48:22.968 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.966+0000 7f6a25d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.968 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:22.966+0000 7f6a25d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:22.975 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:22.982 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:22.982 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:23.014 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:23.015 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:23.020 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:22 trial016 ceph-mon[39544]: pgmap v53: 17 pgs: 17 active+clean; 1.2 GiB data, 4.7 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.78k op/s 2026-02-24T07:48:23.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:23.028 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:23.028 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:23.049 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:23.049 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:23.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 128 212368 212240 66.32 72.7812 0.0120582 0.0150728 2026-02-24T07:48:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:23 trial016 ceph-mon[39544]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1862742861' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3192880126' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"} : dispatch 2026-02-24T07:48:24.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 221248 221120 66.4373 69.375 0.0176328 0.0150456 2026-02-24T07:48:25.096 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:25.241 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:25.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:24 trial016 ceph-mon[39544]: pgmap v54: 17 pgs: 17 active+clean; 1.5 GiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.44k op/s 2026-02-24T07:48:25.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:25.526 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:25.523+0000 7faf5c5f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:25.526 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:25.523+0000 7faf5c5f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:25.542 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:25.542 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:25.573 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:25.573 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:25.586 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:25.586 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:25.599 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:25.599 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:25.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 128 229471 229343 66.3558 64.2422 0.0180382 0.0150652 2026-02-24T07:48:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/212024210' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:26.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 237734 237606 66.2913 64.5547 0.0122365 0.0150802 2026-02-24T07:48:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:26 trial016 ceph-mon[39544]: pgmap v55: 17 pgs: 17 active+clean; 1.5 GiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.16k op/s 2026-02-24T07:48:27.646 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:27.791 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:27.911 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:27.908+0000 7f99deeee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:27.911 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:27.909+0000 7f99deeee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:27.925 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:27.925 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:27.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 127 246469 246342 66.3587 68.25 0.02249 0.0150636 2026-02-24T07:48:27.942 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:27.943 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:27.959 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:27.959 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:27.981 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:27.981 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:28.022 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:28.023 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:28.023 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:28.155 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:28.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:28.281+0000 7f62afb54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:28.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:28.281+0000 7f62afb54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:28.419 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:28.420 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:28.465 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2026-02-24T07:48:27.753289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1670242848,"num_objects":25480,"num_object_clones":0,"num_object_copies":76440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25480,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":203950,"num_write_kb":1632670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6850740,"kb_used_data":5226852,"kb_used_omap":55,"kb_used_meta":1623752,"kb_avail":2929162060,"statfs":{"total":3006477107200,"available":2999461949440,"internally_reserved":0,"allocated":5352296448,"data_stored":5351579684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56613,"internal_metadata":1662722779},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,16,2,22,49,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":724738048,"num_objects":11059,"num_object_clones":0,"num_object_copies":33177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88469,"num_write_kb":707752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001456"},"pg_stats":[{"pgid":"2.f","version":"31'15446","reported_seq":15455,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:27.748139+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:27.748139+0000","last_peered":"2026-02-24T07:48:27.748139+0000","last_clean":"2026-02-24T07:48:27.748139+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:27.748139+0000","last_undegraded":"2026-02-24T07:48:27.748139+0000","last_fullsized":"2026-02-24T07:48:27.748139+0000","mapping_epoch":29,"log_start":"31'15440","ondisk_log_start":"31'15440","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126533632,"num_objects":1931,"num_object_clones":0,"num_object_copies":5793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15446,"num_write_kb":123568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'12896","reported_seq":12910,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.739366+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:22.739366+0000","last_peered":"2026-02-24T07:48:22.739366+0000","last_clean":"2026-02-24T07:48:22.739366+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:22.739366+0000","last_undegraded":"2026-02-24T07:48:22.739366+0000","last_fullsized":"2026-02-24T07:48:22.739366+0000","mapping_epoch":29,"log_start":"31'12872","ondisk_log_start":"31'12872","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105644032,"num_objects":1612,"num_object_clones":0,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12896,"num_write_kb":103168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'13032","reported_seq":13046,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.748200+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:22.748200+0000","last_peered":"2026-02-24T07:48:22.748200+0000","last_clean":"2026-02-24T07:48:22.748200+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:22.748200+0000","last_undegraded":"2026-02-24T07:48:22.748200+0000","last_fullsized":"2026-02-24T07:48:22.748200+0000","mapping_epoch":29,"log_start":"31'12992","ondisk_log_start":"31'12992","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106758144,"num_objects":1629,"num_object_clones":0,"num_object_copies":4887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13032,"num_write_kb":104256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'12312","reported_seq":12326,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.744501+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:22.744501+0000","last_peered":"2026-02-24T07:48:22.744501+0000","last_clean":"2026-02-24T07:48:22.744501+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:22.744501+0000","last_undegraded":"2026-02-24T07:48:22.744501+0000","last_fullsized":"2026-02-24T07:48:22.744501+0000","mapping_epoch":29,"log_start":"31'12302","ondisk_log_start":"31'12302","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100859904,"num_objects":1539,"num_object_clones":0,"num_object_copies":4617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12312,"num_write_kb":98496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'12392","reported_seq":12406,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.733063+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:22.733063+0000","last_peered":"2026-02-24T07:48:22.733063+0000","last_clean":"2026-02-24T07:48:22.733063+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:22.733063+0000","last_undegraded":"2026-02-24T07:48:22.733063+0000","last_fullsized":"2026-02-24T07:48:22.733063+0000","mapping_epoch":29,"log_start":"31'12376","ondisk_log_start":"31'12376","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101515264,"num_objects":1549,"num_object_clones":0,"num_object_copies":4647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12392,"num_write_kb":99136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'12688","reported_seq":12702,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.734018+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:22.734018+0000","last_peered":"2026-02-24T07:48:22.734018+0000","last_clean":"2026-02-24T07:48:22.734018+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:22.734018+0000","last_undegraded":"2026-02-24T07:48:22.734018+0000","last_fullsized":"2026-02-24T07:48:22.734018+0000","mapping_epoch":29,"log_start":"31'12656","ondisk_log_start":"31'12656","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103940096,"num_objects":1586,"num_object_clones":0,"num_object_copies":4758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12688,"num_write_kb":101504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'12592","reported_seq":12606,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.746884+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:22.746884+0000","last_peered":"2026-02-24T07:48:22.746884+0000","last_clean":"2026-02-24T07:48:22.746884+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:22.746884+0000","last_undegraded":"2026-02-24T07:48:22.746884+0000","last_fullsized":"2026-02-24T07:48:22.746884+0000","mapping_epoch":29,"log_start":"31'12584","ondisk_log_start":"31'12584","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103153664,"num_objects":1574,"num_object_clones":0,"num_object_copies":4722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12592,"num_write_kb":100736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'12344","reported_seq":12340,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.752327+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:22.752327+0000","last_peered":"2026-02-24T07:48:22.752327+0000","last_clean":"2026-02-24T07:48:22.752327+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:22.752327+0000","last_undegraded":"2026-02-24T07:48:22.752327+0000","last_fullsized":"2026-02-24T07:48:22.752327+0000","mapping_epoch":29,"log_start":"31'12320","ondisk_log_start":"31'12320","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101122048,"num_objects":1543,"num_object_clones":0,"num_object_copies":4629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12344,"num_write_kb":98752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'12400","reported_seq":12414,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.662524+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:22.662524+0000","last_peered":"2026-02-24T07:48:22.662524+0000","last_clean":"2026-02-24T07:48:22.662524+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:22.662524+0000","last_undegraded":"2026-02-24T07:48:22.662524+0000","last_fullsized":"2026-02-24T07:48:22.662524+0000","mapping_epoch":29,"log_start":"31'12392","ondisk_log_start":"31'12392","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101580800,"num_objects":1550,"num_object_clones":0,"num_object_copies":4650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12400,"num_write_kb":99200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'12312","reported_seq":12325,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.751869+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:22.751869+0000","last_peered":"2026-02-24T07:48:22.751869+0000","last_clean":"2026-02-24T07:48:22.751869+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:22.751869+0000","last_undegraded":"2026-02-24T07:48:22.751869+0000","last_fullsized":"2026-02-24T07:48:22.751869+0000","mapping_epoch":29,"log_start":"31'12308","ondisk_log_start":"31'12308","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100859904,"num_objects":1539,"num_object_clones":0,"num_object_copies":4617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12312,"num_write_kb":98496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'12374","reported_seq":12382,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.747316+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:22.747316+0000","last_peered":"2026-02-24T07:48:22.747316+0000","last_clean":"2026-02-24T07:48:22.747316+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:22.747316+0000","last_undegraded":"2026-02-24T07:48:22.747316+0000","last_fullsized":"2026-02-24T07:48:22.747316+0000","mapping_epoch":29,"log_start":"31'12360","ondisk_log_start":"31'12360","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101367808,"num_objects":1547,"num_object_clones":0,"num_object_copies":4641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12374,"num_write_kb":98992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'12576","reported_seq":12590,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.752647+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:22.752647+0000","last_peered":"2026-02-24T07:48:22.752647+0000","last_clean":"2026-02-24T07:48:22.752647+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:22.752647+0000","last_undegraded":"2026-02-24T07:48:22.752647+0000","last_fullsized":"2026-02-24T07:48:22.752647+0000","mapping_epoch":29,"log_start":"31'12568","ondisk_log_start":"31'12568","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103022592,"num_objects":1572,"num_object_clones":0,"num_object_copies":4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12576,"num_write_kb":100608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'12685","reported_seq":12693,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.752295+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:22.752295+0000","last_peered":"2026-02-24T07:48:22.752295+0000","last_clean":"2026-02-24T07:48:22.752295+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:22.752295+0000","last_undegraded":"2026-02-24T07:48:22.752295+0000","last_fullsized":"2026-02-24T07:48:22.752295+0000","mapping_epoch":29,"log_start":"31'12676","ondisk_log_start":"31'12676","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103915520,"num_objects":1586,"num_object_clones":0,"num_object_copies":4758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12685,"num_write_kb":101480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'12400","reported_seq":12411,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.747585+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:22.747585+0000","last_peered":"2026-02-24T07:48:22.747585+0000","last_clean":"2026-02-24T07:48:22.747585+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:22.747585+0000","last_undegraded":"2026-02-24T07:48:22.747585+0000","last_fullsized":"2026-02-24T07:48:22.747585+0000","mapping_epoch":29,"log_start":"31'12392","ondisk_log_start":"31'12392","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101580800,"num_objects":1550,"num_object_clones":0,"num_object_copies":4650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12400,"num_write_kb":99200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'13094","reported_seq":13102,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.745525+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:22.745525+0000","last_peered":"2026-02-24T07:48:22.745525+0000","last_clean":"2026-02-24T07:48:22.745525+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:22.745525+0000","last_undegraded":"2026-02-24T07:48:22.745525+0000","last_fullsized":"2026-02-24T07:48:22.745525+0000","mapping_epoch":29,"log_start":"31'13087","ondisk_log_start":"31'13087","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107266048,"num_objects":1637,"num_object_clones":0,"num_object_copies":4911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13094,"num_write_kb":104752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'12272","reported_seq":12286,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:22.724754+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:22.724754+0000","last_peered":"2026-02-24T07:48:22.724754+0000","last_clean":"2026-02-24T07:48:22.724754+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:22.724754+0000","last_undegraded":"2026-02-24T07:48:22.724754+0000","last_fullsized":"2026-02-24T07:48:22.724754+0000","mapping_epoch":29,"log_start":"31'12269","ondisk_log_start":"31'12269","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100532224,"num_objects":1534,"num_object_clones":0,"num_object_copies":4602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12272,"num_write_kb":98176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1669652480,"num_objects":25478,"num_object_clones":0,"num_object_copies":76434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203815,"num_write_kb":1630520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5442666496,"data_stored":5442666496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215126,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1823420,"kb_used_data":1399400,"kb_used_omap":9,"kb_used_meta":423990,"kb_avail":732179780,"statfs":{"total":751619276800,"available":749752094720,"internally_reserved":0,"allocated":1432985600,"data_stored":1432805521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":434166577},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,13,1,0,0,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444056,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1770724,"kb_used_data":1346704,"kb_used_omap":13,"kb_used_meta":423986,"kb_avail":732232476,"statfs":{"total":751619276800,"available":749806055424,"internally_reserved":0,"allocated":1379024896,"data_stored":1378844817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":434162657},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1527048,"kb_used_data":1175220,"kb_used_omap":15,"kb_used_meta":351792,"kb_avail":732476152,"statfs":{"total":751619276800,"available":750055579648,"internally_reserved":0,"allocated":1203425280,"data_stored":1203248753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":360235445},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,1,22,49],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1729548,"kb_used_data":1305528,"kb_used_omap":17,"kb_used_meta":423982,"kb_avail":732273652,"statfs":{"total":751619276800,"available":749848219648,"internally_reserved":0,"allocated":1336860672,"data_stored":1336680593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":434158100},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1383718912,"data_stored":1383718912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1238048768,"data_stored":1238048768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1379459072,"data_stored":1379459072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1441439744,"data_stored":1441439744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:28.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 254766 254638 66.307 64.8125 0.0154402 0.0150749 2026-02-24T07:48:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:28 trial016 ceph-mon[39544]: pgmap v56: 17 pgs: 17 active+clean; 1.6 GiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.37k op/s 2026-02-24T07:48:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4217801570' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:29.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 128 263512 263384 66.372 68.3281 0.0157855 0.0150599 2026-02-24T07:48:30.028 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:30.172 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:30.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:29 trial016 ceph-mon[39544]: from='client.14480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:30.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:30.294+0000 7fee95a03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:30.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:30.294+0000 7fee95a03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:30.313 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:30.313 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:30.327 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:30.327 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:30.343 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:30.343 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:30.367 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:30.367 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:30.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 127 272343 272216 66.454 69 0.00167268 0.0150433 2026-02-24T07:48:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:30 trial016 ceph-mon[39544]: pgmap v57: 17 pgs: 17 active+clean; 1.9 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s wr, 9.07k op/s 2026-02-24T07:48:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:30 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:48:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:30 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:48:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1004197044' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:31.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 128 281239 281111 66.5459 69.4922 0.00674728 0.0150214 2026-02-24T07:48:32.409 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:32.547 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:32.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 288867 288739 66.3413 59.5938 0.000791128 0.0150595 2026-02-24T07:48:33.004 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:32 trial016 ceph-mon[39544]: pgmap v58: 17 pgs: 17 active+clean; 1.9 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.29k op/s 2026-02-24T07:48:33.043 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:33.001+0000 7f027ac43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:33.043 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:33.001+0000 7f027ac43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:33.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:33.044 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:33.045 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:33.045 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:33.058 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:33.058 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:33.070 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:33.071 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:33.467 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:33.468 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:33.468 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:48:33.468 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:33.650 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:33.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 295107 294979 65.8385 48.75 0.0155435 0.0151835 2026-02-24T07:48:34.061 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1861895381' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:34.224 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:34.207+0000 7efdbc123640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:34.224 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:34.207+0000 7efdbc123640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:34.344 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:34.344 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:34.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 300957 300829 65.2791 45.7031 0.00385924 0.0153019 2026-02-24T07:48:35.014 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2026-02-24T07:48:33.754077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2357273120,"num_objects":35963,"num_object_clones":0,"num_object_copies":107889,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35963,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":287816,"num_write_kb":2303598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9125756,"kb_used_data":6870188,"kb_used_omap":55,"kb_used_meta":2255432,"kb_avail":2926887044,"statfs":{"total":3006477107200,"available":2997132333056,"internally_reserved":0,"allocated":7035072512,"data_stored":7034355748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57264,"internal_metadata":2309562448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,9,8,28,51],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1068539904,"num_objects":16304,"num_object_clones":0,"num_object_copies":48912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16304,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130437,"num_write_kb":1043496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001559"},"pg_stats":[{"pgid":"2.f","version":"31'18456","reported_seq":18469,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.749277+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:32.749277+0000","last_peered":"2026-02-24T07:48:32.749277+0000","last_clean":"2026-02-24T07:48:32.749277+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:32.749277+0000","last_undegraded":"2026-02-24T07:48:32.749277+0000","last_fullsized":"2026-02-24T07:48:32.749277+0000","mapping_epoch":29,"log_start":"31'18453","ondisk_log_start":"31'18453","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151191552,"num_objects":2307,"num_object_clones":0,"num_object_copies":6921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18456,"num_write_kb":147648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'18497","reported_seq":18498,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.756951+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:32.756951+0000","last_peered":"2026-02-24T07:48:32.756951+0000","last_clean":"2026-02-24T07:48:32.756951+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:32.756951+0000","last_undegraded":"2026-02-24T07:48:32.756951+0000","last_fullsized":"2026-02-24T07:48:32.756951+0000","mapping_epoch":29,"log_start":"31'18467","ondisk_log_start":"31'18467","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151527424,"num_objects":2313,"num_object_clones":0,"num_object_copies":6939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18497,"num_write_kb":147976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'18496","reported_seq":18510,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.745617+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:32.745617+0000","last_peered":"2026-02-24T07:48:32.745617+0000","last_clean":"2026-02-24T07:48:32.745617+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:32.745617+0000","last_undegraded":"2026-02-24T07:48:32.745617+0000","last_fullsized":"2026-02-24T07:48:32.745617+0000","mapping_epoch":29,"log_start":"31'18488","ondisk_log_start":"31'18488","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151519232,"num_objects":2312,"num_object_clones":0,"num_object_copies":6936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18496,"num_write_kb":147968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'17632","reported_seq":17646,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.745117+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:32.745117+0000","last_peered":"2026-02-24T07:48:32.745117+0000","last_clean":"2026-02-24T07:48:32.745117+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:32.745117+0000","last_undegraded":"2026-02-24T07:48:32.745117+0000","last_fullsized":"2026-02-24T07:48:32.745117+0000","mapping_epoch":29,"log_start":"31'17624","ondisk_log_start":"31'17624","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144441344,"num_objects":2204,"num_object_clones":0,"num_object_copies":6612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17632,"num_write_kb":141056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'17776","reported_seq":17790,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.737899+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:32.737899+0000","last_peered":"2026-02-24T07:48:32.737899+0000","last_clean":"2026-02-24T07:48:32.737899+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:32.737899+0000","last_undegraded":"2026-02-24T07:48:32.737899+0000","last_fullsized":"2026-02-24T07:48:32.737899+0000","mapping_epoch":29,"log_start":"31'17752","ondisk_log_start":"31'17752","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'17912","reported_seq":17926,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.752949+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:32.752949+0000","last_peered":"2026-02-24T07:48:32.752949+0000","last_clean":"2026-02-24T07:48:32.752949+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:32.752949+0000","last_undegraded":"2026-02-24T07:48:32.752949+0000","last_fullsized":"2026-02-24T07:48:32.752949+0000","mapping_epoch":29,"log_start":"31'17896","ondisk_log_start":"31'17896","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146735104,"num_objects":2239,"num_object_clones":0,"num_object_copies":6717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17912,"num_write_kb":143296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'17960","reported_seq":17965,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.748915+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:32.748915+0000","last_peered":"2026-02-24T07:48:32.748915+0000","last_clean":"2026-02-24T07:48:32.748915+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:32.748915+0000","last_undegraded":"2026-02-24T07:48:32.748915+0000","last_fullsized":"2026-02-24T07:48:32.748915+0000","mapping_epoch":29,"log_start":"31'17944","ondisk_log_start":"31'17944","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147128320,"num_objects":2245,"num_object_clones":0,"num_object_copies":6735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17960,"num_write_kb":143680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'16976","reported_seq":16990,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.737906+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:32.737906+0000","last_peered":"2026-02-24T07:48:32.737906+0000","last_clean":"2026-02-24T07:48:32.737906+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:32.737906+0000","last_undegraded":"2026-02-24T07:48:32.737906+0000","last_fullsized":"2026-02-24T07:48:32.737906+0000","mapping_epoch":29,"log_start":"31'16968","ondisk_log_start":"31'16968","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16976,"num_write_kb":135808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'17936","reported_seq":17949,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.756567+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:32.756567+0000","last_peered":"2026-02-24T07:48:32.756567+0000","last_clean":"2026-02-24T07:48:32.756567+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:32.756567+0000","last_undegraded":"2026-02-24T07:48:32.756567+0000","last_fullsized":"2026-02-24T07:48:32.756567+0000","mapping_epoch":29,"log_start":"31'17928","ondisk_log_start":"31'17928","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146931712,"num_objects":2242,"num_object_clones":0,"num_object_copies":6726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17936,"num_write_kb":143488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'17504","reported_seq":17518,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.732378+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:32.732378+0000","last_peered":"2026-02-24T07:48:32.732378+0000","last_clean":"2026-02-24T07:48:32.732378+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:32.732378+0000","last_undegraded":"2026-02-24T07:48:32.732378+0000","last_fullsized":"2026-02-24T07:48:32.732378+0000","mapping_epoch":29,"log_start":"31'17499","ondisk_log_start":"31'17499","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143392768,"num_objects":2188,"num_object_clones":0,"num_object_copies":6564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17504,"num_write_kb":140032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'17704","reported_seq":17710,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.756559+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:32.756559+0000","last_peered":"2026-02-24T07:48:32.756559+0000","last_clean":"2026-02-24T07:48:32.756559+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:32.756559+0000","last_undegraded":"2026-02-24T07:48:32.756559+0000","last_fullsized":"2026-02-24T07:48:32.756559+0000","mapping_epoch":29,"log_start":"31'17679","ondisk_log_start":"31'17679","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145031168,"num_objects":2213,"num_object_clones":0,"num_object_copies":6639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17704,"num_write_kb":141632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'17928","reported_seq":17939,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.752656+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:32.752656+0000","last_peered":"2026-02-24T07:48:32.752656+0000","last_clean":"2026-02-24T07:48:32.752656+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:32.752656+0000","last_undegraded":"2026-02-24T07:48:32.752656+0000","last_fullsized":"2026-02-24T07:48:32.752656+0000","mapping_epoch":29,"log_start":"31'17920","ondisk_log_start":"31'17920","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146866176,"num_objects":2241,"num_object_clones":0,"num_object_copies":6723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17928,"num_write_kb":143424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'18496","reported_seq":18510,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.731216+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:32.731216+0000","last_peered":"2026-02-24T07:48:32.731216+0000","last_clean":"2026-02-24T07:48:32.731216+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:32.731216+0000","last_undegraded":"2026-02-24T07:48:32.731216+0000","last_fullsized":"2026-02-24T07:48:32.731216+0000","mapping_epoch":29,"log_start":"31'18493","ondisk_log_start":"31'18493","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151519232,"num_objects":2312,"num_object_clones":0,"num_object_copies":6936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18496,"num_write_kb":147968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'18152","reported_seq":18166,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.746504+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:32.746504+0000","last_peered":"2026-02-24T07:48:32.746504+0000","last_clean":"2026-02-24T07:48:32.746504+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:32.746504+0000","last_undegraded":"2026-02-24T07:48:32.746504+0000","last_fullsized":"2026-02-24T07:48:32.746504+0000","mapping_epoch":29,"log_start":"31'18144","ondisk_log_start":"31'18144","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148701184,"num_objects":2269,"num_object_clones":0,"num_object_copies":6807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18152,"num_write_kb":145216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'18408","reported_seq":18406,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.756585+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:32.756585+0000","last_peered":"2026-02-24T07:48:32.756585+0000","last_clean":"2026-02-24T07:48:32.756585+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:32.756585+0000","last_undegraded":"2026-02-24T07:48:32.756585+0000","last_fullsized":"2026-02-24T07:48:32.756585+0000","mapping_epoch":29,"log_start":"31'18381","ondisk_log_start":"31'18381","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":3000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150798336,"num_objects":2301,"num_object_clones":0,"num_object_copies":6903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18408,"num_write_kb":147264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'17848","reported_seq":17862,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:32.721170+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:32.721170+0000","last_peered":"2026-02-24T07:48:32.721170+0000","last_clean":"2026-02-24T07:48:32.721170+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:32.721170+0000","last_undegraded":"2026-02-24T07:48:32.721170+0000","last_fullsized":"2026-02-24T07:48:32.721170+0000","mapping_epoch":29,"log_start":"31'17840","ondisk_log_start":"31'17840","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146210816,"num_objects":2231,"num_object_clones":0,"num_object_copies":6693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17848,"num_write_kb":142784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2356682752,"num_objects":35961,"num_object_clones":0,"num_object_copies":107883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287681,"num_write_kb":2301448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7069761536,"data_stored":7069761536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2661020,"kb_used_data":2002376,"kb_used_omap":9,"kb_used_meta":658614,"kb_avail":731342180,"statfs":{"total":751619276800,"available":748894392320,"internally_reserved":0,"allocated":2050433024,"data_stored":2050252945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":674421553},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444057,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2112972,"kb_used_data":1580664,"kb_used_omap":13,"kb_used_meta":532274,"kb_avail":731890228,"statfs":{"total":751619276800,"available":749455593472,"internally_reserved":0,"allocated":1618599936,"data_stored":1618419857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":545049569},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2227912,"kb_used_data":1695604,"kb_used_omap":15,"kb_used_meta":532272,"kb_avail":731775288,"statfs":{"total":751619276800,"available":749337894912,"internally_reserved":0,"allocated":1736298496,"data_stored":1736121969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":545046965},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,9,8,28,51],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2123852,"kb_used_data":1591544,"kb_used_omap":18,"kb_used_meta":532269,"kb_avail":731879348,"statfs":{"total":751619276800,"available":749444452352,"internally_reserved":0,"allocated":1629741056,"data_stored":1629560977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":545044361},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1629249536,"data_stored":1629249536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1764491264,"data_stored":1764491264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1617829888,"data_stored":1617829888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2058190848,"data_stored":2058190848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:35.016 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:35.016 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 56 2026-02-24T07:48:35.150 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:35.267 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:34 trial016 ceph-mon[39544]: pgmap v59: 17 pgs: 17 active+clean; 2.2 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.87k op/s 2026-02-24T07:48:35.267 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:35.670 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:35.615+0000 7f673c9bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:35.671 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:35.616+0000 7f673c9bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:35.757 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:35.782 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:35.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 127 307543 307416 64.9056 51.4609 0.0125291 0.0154025 2026-02-24T07:48:36.239 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:36.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:35 trial016 ceph-mon[39544]: from='client.14486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:36.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2734830960' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T07:48:36.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:36.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 313942 313814 64.5128 49.9844 0.0133974 0.0154938 2026-02-24T07:48:36.955 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:36 trial016 ceph-mon[39544]: pgmap v60: 17 pgs: 17 active+clean; 2.2 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.20k op/s 2026-02-24T07:48:36.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:36.908+0000 7f33e5abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:36.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:36.909+0000 7f33e5abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:36.988 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:36.989 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:36.989 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:36.989 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:36.989 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:36.989 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:36.990 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:36.990 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:37.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 127 321395 321268 64.3512 58.2344 0.023873 0.0155351 2026-02-24T07:48:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1212594999' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:38.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:48:38.942026+0000 min lat: 0.000616464 max lat: 0.0911859 avg lat: 0.0155182 2026-02-24T07:48:38.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:48:38.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 128 329967 329839 64.4163 66.9609 0.0163785 0.0155182 2026-02-24T07:48:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:38 trial016 ceph-mon[39544]: pgmap v61: 17 pgs: 17 active+clean; 2.2 GiB data, 9.0 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.35k op/s 2026-02-24T07:48:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:38 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:48:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:38 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:48:39.384 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:39.530 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:39.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:39.642+0000 7f87fbc4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:39.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:39.642+0000 7f87fbc4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:39.660 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:39.660 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:39.684 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:39.685 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:39.698 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:39.698 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:39.716 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:39.716 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:39.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 127 339305 339178 64.6246 72.9609 0.0146589 0.0154708 2026-02-24T07:48:40.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4218973282' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:40.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 127 347867 347740 64.6784 66.8906 0.0211837 0.015457 2026-02-24T07:48:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:40 trial016 ceph-mon[39544]: pgmap v62: 17 pgs: 17 active+clean; 2.4 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.67k op/s 2026-02-24T07:48:41.391 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:41.392 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:41.392 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:48:41.392 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:41.529 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:41.650+0000 7fcf90704640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:41.650+0000 7fcf90704640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:41.763 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:41.796 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:41.797 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:41.841 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2026-02-24T07:48:41.755102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2620703264,"num_objects":39984,"num_object_clones":0,"num_object_copies":119952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39984,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":319973,"num_write_kb":2560854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10044628,"kb_used_data":7554428,"kb_used_omap":55,"kb_used_meta":2490056,"kb_avail":2925968172,"statfs":{"total":3006477107200,"available":2996191408128,"internally_reserved":0,"allocated":7735734272,"data_stored":7735017508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57264,"internal_metadata":2549817424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,3,2,14,0,12],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":614703104,"num_objects":9380,"num_object_clones":0,"num_object_copies":28140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9380,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75037,"num_write_kb":600296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001544"},"pg_stats":[{"pgid":"2.f","version":"31'20288","reported_seq":20302,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.741114+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:37.741114+0000","last_peered":"2026-02-24T07:48:37.741114+0000","last_clean":"2026-02-24T07:48:37.741114+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:37.741114+0000","last_undegraded":"2026-02-24T07:48:37.741114+0000","last_fullsized":"2026-02-24T07:48:37.741114+0000","mapping_epoch":29,"log_start":"31'20280","ondisk_log_start":"31'20280","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166199296,"num_objects":2536,"num_object_clones":0,"num_object_copies":7608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20288,"num_write_kb":162304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'20368","reported_seq":20375,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.757652+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:37.757652+0000","last_peered":"2026-02-24T07:48:37.757652+0000","last_clean":"2026-02-24T07:48:37.757652+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:37.757652+0000","last_undegraded":"2026-02-24T07:48:37.757652+0000","last_fullsized":"2026-02-24T07:48:37.757652+0000","mapping_epoch":29,"log_start":"31'20352","ondisk_log_start":"31'20352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166854656,"num_objects":2546,"num_object_clones":0,"num_object_copies":7638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":162944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'20528","reported_seq":20542,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.739039+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:37.739039+0000","last_peered":"2026-02-24T07:48:37.739039+0000","last_clean":"2026-02-24T07:48:37.739039+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:37.739039+0000","last_undegraded":"2026-02-24T07:48:37.739039+0000","last_fullsized":"2026-02-24T07:48:37.739039+0000","mapping_epoch":29,"log_start":"31'20504","ondisk_log_start":"31'20504","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168165376,"num_objects":2566,"num_object_clones":0,"num_object_copies":7698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20528,"num_write_kb":164224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'19944","reported_seq":19958,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.739777+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:37.739777+0000","last_peered":"2026-02-24T07:48:37.739777+0000","last_clean":"2026-02-24T07:48:37.739777+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:37.739777+0000","last_undegraded":"2026-02-24T07:48:37.739777+0000","last_fullsized":"2026-02-24T07:48:37.739777+0000","mapping_epoch":29,"log_start":"31'19928","ondisk_log_start":"31'19928","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163381248,"num_objects":2493,"num_object_clones":0,"num_object_copies":7479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19944,"num_write_kb":159552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'19842","reported_seq":19854,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.752367+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:37.752367+0000","last_peered":"2026-02-24T07:48:37.752367+0000","last_clean":"2026-02-24T07:48:37.752367+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:37.752367+0000","last_undegraded":"2026-02-24T07:48:37.752367+0000","last_fullsized":"2026-02-24T07:48:37.752367+0000","mapping_epoch":29,"log_start":"31'19839","ondisk_log_start":"31'19839","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162545664,"num_objects":2481,"num_object_clones":0,"num_object_copies":7443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19842,"num_write_kb":158736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'20048","reported_seq":20062,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.725247+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:37.725247+0000","last_peered":"2026-02-24T07:48:37.725247+0000","last_clean":"2026-02-24T07:48:37.725247+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:37.725247+0000","last_undegraded":"2026-02-24T07:48:37.725247+0000","last_fullsized":"2026-02-24T07:48:37.725247+0000","mapping_epoch":29,"log_start":"31'20032","ondisk_log_start":"31'20032","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164233216,"num_objects":2506,"num_object_clones":0,"num_object_copies":7518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20048,"num_write_kb":160384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'19969","reported_seq":19982,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.741144+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:37.741144+0000","last_peered":"2026-02-24T07:48:37.741144+0000","last_clean":"2026-02-24T07:48:37.741144+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:37.741144+0000","last_undegraded":"2026-02-24T07:48:37.741144+0000","last_fullsized":"2026-02-24T07:48:37.741144+0000","mapping_epoch":29,"log_start":"31'19964","ondisk_log_start":"31'19964","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163586048,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19969,"num_write_kb":159752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'19192","reported_seq":19206,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.753755+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:37.753755+0000","last_peered":"2026-02-24T07:48:37.753755+0000","last_clean":"2026-02-24T07:48:37.753755+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:37.753755+0000","last_undegraded":"2026-02-24T07:48:37.753755+0000","last_fullsized":"2026-02-24T07:48:37.753755+0000","mapping_epoch":29,"log_start":"31'19163","ondisk_log_start":"31'19163","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157220864,"num_objects":2399,"num_object_clones":0,"num_object_copies":7197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19192,"num_write_kb":153536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'19968","reported_seq":19966,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.757956+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:37.757956+0000","last_peered":"2026-02-24T07:48:37.757956+0000","last_clean":"2026-02-24T07:48:37.757956+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:37.757956+0000","last_undegraded":"2026-02-24T07:48:37.757956+0000","last_fullsized":"2026-02-24T07:48:37.757956+0000","mapping_epoch":29,"log_start":"31'19944","ondisk_log_start":"31'19944","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":2496,"num_object_clones":0,"num_object_copies":7488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19968,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'19464","reported_seq":19478,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.714806+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:37.714806+0000","last_peered":"2026-02-24T07:48:37.714806+0000","last_clean":"2026-02-24T07:48:37.714806+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:37.714806+0000","last_undegraded":"2026-02-24T07:48:37.714806+0000","last_fullsized":"2026-02-24T07:48:37.714806+0000","mapping_epoch":29,"log_start":"31'19448","ondisk_log_start":"31'19448","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159449088,"num_objects":2433,"num_object_clones":0,"num_object_copies":7299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19464,"num_write_kb":155712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'19664","reported_seq":19678,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.741729+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:37.741729+0000","last_peered":"2026-02-24T07:48:37.741729+0000","last_clean":"2026-02-24T07:48:37.741729+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:37.741729+0000","last_undegraded":"2026-02-24T07:48:37.741729+0000","last_fullsized":"2026-02-24T07:48:37.741729+0000","mapping_epoch":29,"log_start":"31'19632","ondisk_log_start":"31'19632","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161087488,"num_objects":2458,"num_object_clones":0,"num_object_copies":7374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19664,"num_write_kb":157312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'20067","reported_seq":20078,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.753837+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:37.753837+0000","last_peered":"2026-02-24T07:48:37.753837+0000","last_clean":"2026-02-24T07:48:37.753837+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:37.753837+0000","last_undegraded":"2026-02-24T07:48:37.753837+0000","last_fullsized":"2026-02-24T07:48:37.753837+0000","mapping_epoch":29,"log_start":"31'20058","ondisk_log_start":"31'20058","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164388864,"num_objects":2509,"num_object_clones":0,"num_object_copies":7527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20067,"num_write_kb":160536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'20280","reported_seq":20294,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.742278+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:37.742278+0000","last_peered":"2026-02-24T07:48:37.742278+0000","last_clean":"2026-02-24T07:48:37.742278+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:37.742278+0000","last_undegraded":"2026-02-24T07:48:37.742278+0000","last_fullsized":"2026-02-24T07:48:37.742278+0000","mapping_epoch":29,"log_start":"31'20273","ondisk_log_start":"31'20273","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166133760,"num_objects":2535,"num_object_clones":0,"num_object_copies":7605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":162240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'20136","reported_seq":20150,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.716115+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:37.716115+0000","last_peered":"2026-02-24T07:48:37.716115+0000","last_clean":"2026-02-24T07:48:37.716115+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:37.716115+0000","last_undegraded":"2026-02-24T07:48:37.716115+0000","last_fullsized":"2026-02-24T07:48:37.716115+0000","mapping_epoch":29,"log_start":"31'20112","ondisk_log_start":"31'20112","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164954112,"num_objects":2517,"num_object_clones":0,"num_object_copies":7551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20136,"num_write_kb":161088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'20280","reported_seq":20294,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.742115+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:37.742115+0000","last_peered":"2026-02-24T07:48:37.742115+0000","last_clean":"2026-02-24T07:48:37.742115+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:37.742115+0000","last_undegraded":"2026-02-24T07:48:37.742115+0000","last_fullsized":"2026-02-24T07:48:37.742115+0000","mapping_epoch":29,"log_start":"31'20272","ondisk_log_start":"31'20272","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166133760,"num_objects":2535,"num_object_clones":0,"num_object_copies":7605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":162240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'19800","reported_seq":19814,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:37.735734+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:37.735734+0000","last_peered":"2026-02-24T07:48:37.735734+0000","last_clean":"2026-02-24T07:48:37.735734+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:37.735734+0000","last_undegraded":"2026-02-24T07:48:37.735734+0000","last_fullsized":"2026-02-24T07:48:37.735734+0000","mapping_epoch":29,"log_start":"31'19797","ondisk_log_start":"31'19797","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162201600,"num_objects":2475,"num_object_clones":0,"num_object_copies":7425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19800,"num_write_kb":158400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2620112896,"num_objects":39982,"num_object_clones":0,"num_object_copies":119946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319838,"num_write_kb":2558704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7860879360,"data_stored":7860879360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215129,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2990060,"kb_used_data":2223120,"kb_used_omap":9,"kb_used_meta":766902,"kb_avail":731013140,"statfs":{"total":751619276800,"available":748557455360,"internally_reserved":0,"allocated":2276474880,"data_stored":2276294801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":785308465},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444058,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2284620,"kb_used_data":1716216,"kb_used_omap":13,"kb_used_meta":568370,"kb_avail":731718580,"statfs":{"total":751619276800,"available":749279825920,"internally_reserved":0,"allocated":1757405184,"data_stored":1757225105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":582011873},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2474728,"kb_used_data":1888276,"kb_used_omap":15,"kb_used_meta":586416,"kb_avail":731528472,"statfs":{"total":751619276800,"available":749085155328,"internally_reserved":0,"allocated":1933594624,"data_stored":1933418097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":600490421},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,3,2,14,0,12],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2295220,"kb_used_data":1726816,"kb_used_omap":18,"kb_used_meta":568365,"kb_avail":731707980,"statfs":{"total":751619276800,"available":749268971520,"internally_reserved":0,"allocated":1768259584,"data_stored":1768079505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":582006665},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1808867328,"data_stored":1808867328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1966645248,"data_stored":1966645248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1795424256,"data_stored":1795424256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2289942528,"data_stored":2289942528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:41.843 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:48:41.844 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 21 2026-02-24T07:48:41.908 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:41.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 356203 356075 64.6885 65.1172 0.0235242 0.0154536 2026-02-24T07:48:42.021 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:42.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:42.036+0000 7f5d167b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:42.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:42.036+0000 7f5d167b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:42.056 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:42.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:42.077 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:42.077 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:42.093 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:42.093 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:42.109 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:42.110 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:42.149 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:42.146+0000 7ff650e76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:42.149 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:42.147+0000 7ff650e76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:42.297 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:48:42.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 363045 362917 64.4331 53.4531 0.0323383 0.0155065 2026-02-24T07:48:43.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:42 trial016 ceph-mon[39544]: pgmap v63: 17 pgs: 17 active+clean; 2.4 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.25k op/s 2026-02-24T07:48:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:42 trial016 ceph-mon[39544]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3502127969' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/842315548' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "21"} : dispatch 2026-02-24T07:48:43.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 127 371018 370891 64.3851 62.2969 0.0228529 0.0155271 2026-02-24T07:48:44.153 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:44.301 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:44.666+0000 7fb38acb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:44.666+0000 7fb38acb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:44.726 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:44.732 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:44.732 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:44.745 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:44.745 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:44.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 128 377811 377683 64.1389 53.0625 0.0146532 0.0155876 2026-02-24T07:48:44.980 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:44 trial016 ceph-mon[39544]: pgmap v64: 17 pgs: 17 active+clean; 2.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.75k op/s 2026-02-24T07:48:44.981 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1663315813' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:44.981 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:45.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 127 386384 386257 64.1994 66.9844 0.0157471 0.0155732 2026-02-24T07:48:46.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 394616 394488 64.2015 64.3047 0.0200035 0.0155718 2026-02-24T07:48:46.983 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:47.126 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:47.149 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:46 trial016 ceph-mon[39544]: pgmap v65: 17 pgs: 17 active+clean; 2.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s wr, 6.18k op/s 2026-02-24T07:48:47.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:47.236+0000 7f2d8eaaa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:47.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:47.237+0000 7f2d8eaaa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:47.254 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:47.255 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:47.276 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:47.277 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:47.289 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:47.289 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:47.304 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:47.305 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:47.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 128 403055 402927 64.2366 65.9297 0.0146387 0.015563 2026-02-24T07:48:48.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:48.016 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:48:48.016 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-24T07:48:48.017 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:48.146 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:48.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2756090853' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:48.473 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:48.471+0000 7f5fb0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:48.474 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:48.471+0000 7f5fb0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:48.620 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:48.621 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:48.665 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2026-02-24T07:48:47.755836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2985402912,"num_objects":45547,"num_object_clones":0,"num_object_copies":136641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45547,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":364492,"num_write_kb":2917006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12044604,"kb_used_data":9031020,"kb_used_omap":56,"kb_used_meta":3013447,"kb_avail":2923968196,"statfs":{"total":3006477107200,"available":2994143432704,"internally_reserved":0,"allocated":9247764480,"data_stored":9247047716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57915,"internal_metadata":3085770181},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[24,8,13,28,54,32],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":628129792,"num_objects":9584,"num_object_clones":0,"num_object_copies":28752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76676,"num_write_kb":613408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001461"},"pg_stats":[{"pgid":"2.f","version":"31'25648","reported_seq":25662,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:47.711037+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:47.711037+0000","last_peered":"2026-02-24T07:48:47.711037+0000","last_clean":"2026-02-24T07:48:47.711037+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:47.711037+0000","last_undegraded":"2026-02-24T07:48:47.711037+0000","last_fullsized":"2026-02-24T07:48:47.711037+0000","mapping_epoch":29,"log_start":"31'25643","ondisk_log_start":"31'25643","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210108416,"num_objects":3206,"num_object_clones":0,"num_object_copies":9618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25648,"num_write_kb":205184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"31'22824","reported_seq":22838,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.748801+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:42.748801+0000","last_peered":"2026-02-24T07:48:42.748801+0000","last_clean":"2026-02-24T07:48:42.748801+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:42.748801+0000","last_undegraded":"2026-02-24T07:48:42.748801+0000","last_fullsized":"2026-02-24T07:48:42.748801+0000","mapping_epoch":29,"log_start":"31'22816","ondisk_log_start":"31'22816","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186974208,"num_objects":2853,"num_object_clones":0,"num_object_copies":8559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22824,"num_write_kb":182592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"31'23264","reported_seq":23278,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.737226+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:42.737226+0000","last_peered":"2026-02-24T07:48:42.737226+0000","last_clean":"2026-02-24T07:48:42.737226+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:42.737226+0000","last_undegraded":"2026-02-24T07:48:42.737226+0000","last_fullsized":"2026-02-24T07:48:42.737226+0000","mapping_epoch":29,"log_start":"31'23248","ondisk_log_start":"31'23248","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190578688,"num_objects":2908,"num_object_clones":0,"num_object_copies":8724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2908,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23264,"num_write_kb":186112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"31'22592","reported_seq":22606,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.716607+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:42.716607+0000","last_peered":"2026-02-24T07:48:42.716607+0000","last_clean":"2026-02-24T07:48:42.716607+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:42.716607+0000","last_undegraded":"2026-02-24T07:48:42.716607+0000","last_fullsized":"2026-02-24T07:48:42.716607+0000","mapping_epoch":29,"log_start":"31'22584","ondisk_log_start":"31'22584","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185073664,"num_objects":2824,"num_object_clones":0,"num_object_copies":8472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22592,"num_write_kb":180736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:47:58.850427+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:47:58.850427+0000","last_peered":"2026-02-24T07:47:58.850427+0000","last_clean":"2026-02-24T07:47:58.850427+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:47:58.850427+0000","last_undegraded":"2026-02-24T07:47:58.850427+0000","last_fullsized":"2026-02-24T07:47:58.850427+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'22472","reported_seq":22477,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.749716+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:42.749716+0000","last_peered":"2026-02-24T07:48:42.749716+0000","last_clean":"2026-02-24T07:48:42.749716+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:42.749716+0000","last_undegraded":"2026-02-24T07:48:42.749716+0000","last_fullsized":"2026-02-24T07:48:42.749716+0000","mapping_epoch":29,"log_start":"31'22462","ondisk_log_start":"31'22462","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184090624,"num_objects":2809,"num_object_clones":0,"num_object_copies":8427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22472,"num_write_kb":179776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"31'22848","reported_seq":22862,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.748429+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:42.748429+0000","last_peered":"2026-02-24T07:48:42.748429+0000","last_clean":"2026-02-24T07:48:42.748429+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:42.748429+0000","last_undegraded":"2026-02-24T07:48:42.748429+0000","last_fullsized":"2026-02-24T07:48:42.748429+0000","mapping_epoch":29,"log_start":"31'22832","ondisk_log_start":"31'22832","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187170816,"num_objects":2856,"num_object_clones":0,"num_object_copies":8568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22848,"num_write_kb":182784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"31'22661","reported_seq":22646,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.738153+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:42.738153+0000","last_peered":"2026-02-24T07:48:42.738153+0000","last_clean":"2026-02-24T07:48:42.738153+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:42.738153+0000","last_undegraded":"2026-02-24T07:48:42.738153+0000","last_fullsized":"2026-02-24T07:48:42.738153+0000","mapping_epoch":29,"log_start":"31'22631","ondisk_log_start":"31'22631","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185638912,"num_objects":2833,"num_object_clones":0,"num_object_copies":8499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22661,"num_write_kb":181288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'21712","reported_seq":21716,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.749708+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:42.749708+0000","last_peered":"2026-02-24T07:48:42.749708+0000","last_clean":"2026-02-24T07:48:42.749708+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:42.749708+0000","last_undegraded":"2026-02-24T07:48:42.749708+0000","last_fullsized":"2026-02-24T07:48:42.749708+0000","mapping_epoch":29,"log_start":"31'21701","ondisk_log_start":"31'21701","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177864704,"num_objects":2714,"num_object_clones":0,"num_object_copies":8142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21712,"num_write_kb":173696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"31'22672","reported_seq":22686,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.731250+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:42.731250+0000","last_peered":"2026-02-24T07:48:42.731250+0000","last_clean":"2026-02-24T07:48:42.731250+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:42.731250+0000","last_undegraded":"2026-02-24T07:48:42.731250+0000","last_fullsized":"2026-02-24T07:48:42.731250+0000","mapping_epoch":29,"log_start":"31'22664","ondisk_log_start":"31'22664","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185729024,"num_objects":2834,"num_object_clones":0,"num_object_copies":8502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2834,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22672,"num_write_kb":181376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'22168","reported_seq":22181,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.744520+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:42.744520+0000","last_peered":"2026-02-24T07:48:42.744520+0000","last_clean":"2026-02-24T07:48:42.744520+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:42.744520+0000","last_undegraded":"2026-02-24T07:48:42.744520+0000","last_fullsized":"2026-02-24T07:48:42.744520+0000","mapping_epoch":29,"log_start":"31'22163","ondisk_log_start":"31'22163","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181600256,"num_objects":2771,"num_object_clones":0,"num_object_copies":8313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22168,"num_write_kb":177344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'21992","reported_seq":22006,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.734641+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:42.734641+0000","last_peered":"2026-02-24T07:48:42.734641+0000","last_clean":"2026-02-24T07:48:42.734641+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:42.734641+0000","last_undegraded":"2026-02-24T07:48:42.734641+0000","last_fullsized":"2026-02-24T07:48:42.734641+0000","mapping_epoch":29,"log_start":"31'21976","ondisk_log_start":"31'21976","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180158464,"num_objects":2749,"num_object_clones":0,"num_object_copies":8247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21992,"num_write_kb":175936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"31'22632","reported_seq":22646,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.745775+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:42.745775+0000","last_peered":"2026-02-24T07:48:42.745775+0000","last_clean":"2026-02-24T07:48:42.745775+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:42.745775+0000","last_undegraded":"2026-02-24T07:48:42.745775+0000","last_fullsized":"2026-02-24T07:48:42.745775+0000","mapping_epoch":29,"log_start":"31'22624","ondisk_log_start":"31'22624","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185401344,"num_objects":2829,"num_object_clones":0,"num_object_copies":8487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22632,"num_write_kb":181056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'22888","reported_seq":22902,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.691772+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:42.691772+0000","last_peered":"2026-02-24T07:48:42.691772+0000","last_clean":"2026-02-24T07:48:42.691772+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:42.691772+0000","last_undegraded":"2026-02-24T07:48:42.691772+0000","last_fullsized":"2026-02-24T07:48:42.691772+0000","mapping_epoch":29,"log_start":"31'22872","ondisk_log_start":"31'22872","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187498496,"num_objects":2861,"num_object_clones":0,"num_object_copies":8583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22888,"num_write_kb":183104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'22624","reported_seq":22638,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.736811+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:42.736811+0000","last_peered":"2026-02-24T07:48:42.736811+0000","last_clean":"2026-02-24T07:48:42.736811+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:42.736811+0000","last_undegraded":"2026-02-24T07:48:42.736811+0000","last_fullsized":"2026-02-24T07:48:42.736811+0000","mapping_epoch":29,"log_start":"31'22608","ondisk_log_start":"31'22608","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185335808,"num_objects":2828,"num_object_clones":0,"num_object_copies":8484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22624,"num_write_kb":180992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"31'23048","reported_seq":23062,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.737772+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:42.737772+0000","last_peered":"2026-02-24T07:48:42.737772+0000","last_clean":"2026-02-24T07:48:42.737772+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:42.737772+0000","last_undegraded":"2026-02-24T07:48:42.737772+0000","last_fullsized":"2026-02-24T07:48:42.737772+0000","mapping_epoch":29,"log_start":"31'23016","ondisk_log_start":"31'23016","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188809216,"num_objects":2881,"num_object_clones":0,"num_object_copies":8643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2881,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23048,"num_write_kb":184384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"31'22312","reported_seq":22326,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T07:48:42.738058+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:42.738058+0000","last_peered":"2026-02-24T07:48:42.738058+0000","last_clean":"2026-02-24T07:48:42.738058+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:42.738058+0000","last_undegraded":"2026-02-24T07:48:42.738058+0000","last_fullsized":"2026-02-24T07:48:42.738058+0000","mapping_epoch":29,"log_start":"31'22308","ondisk_log_start":"31'22308","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182779904,"num_objects":2789,"num_object_clones":0,"num_object_copies":8367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22312,"num_write_kb":178496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2984812544,"num_objects":45545,"num_object_clones":0,"num_object_copies":136635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364357,"num_write_kb":2914856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9338650624,"data_stored":9338650624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215130,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3355060,"kb_used_data":2515936,"kb_used_omap":9,"kb_used_meta":839094,"kb_avail":730648140,"statfs":{"total":751619276800,"available":748183695360,"internally_reserved":0,"allocated":2576318464,"data_stored":2576138385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":859233073},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,3,13,24,21],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444060,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2965660,"kb_used_data":2198728,"kb_used_omap":13,"kb_used_meta":766898,"kb_avail":731037540,"statfs":{"total":751619276800,"available":748582440960,"internally_reserved":0,"allocated":2251497472,"data_stored":2251317393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":785304545},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2801760,"kb_used_data":2143116,"kb_used_omap":16,"kb_used_meta":658607,"kb_avail":731201440,"statfs":{"total":751619276800,"available":748750274560,"internally_reserved":0,"allocated":2194550784,"data_stored":2194374257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":674414378},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,8,10,15,30,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2922124,"kb_used_data":2173240,"kb_used_omap":18,"kb_used_meta":748845,"kb_avail":731081076,"statfs":{"total":751619276800,"available":748627021824,"internally_reserved":0,"allocated":2225397760,"data_stored":2225217681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":766818185},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2271346688,"data_stored":2271346688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2222997504,"data_stored":2222997504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2252210176,"data_stored":2252210176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2592096256,"data_stored":2592096256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:48.666 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-24T07:48:48.812 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:48.934 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:48.932+0000 7fdfcfcf1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:48.935 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:48.932+0000 7fdfcfcf1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:48.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 127 411336 411209 64.2458 64.7031 0.0219748 0.0155603 2026-02-24T07:48:49.073 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:48:49.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:48:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:48 trial016 ceph-mon[39544]: pgmap v66: 17 pgs: 17 active+clean; 2.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.39k op/s 2026-02-24T07:48:49.347 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:49.491 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:49.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:49.613+0000 7efd9c5b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:49.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:49.613+0000 7efd9c5b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:49.635 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:49.635 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:49.653 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:49.653 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:49.667 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:49.667 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:49.684 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:49.685 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:49.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 420295 420167 64.3583 69.9844 0.00190955 0.0155345 2026-02-24T07:48:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:49 trial016 ceph-mon[39544]: from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:48:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1855494268' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T07:48:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/820107702' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:50.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 127 428679 428552 64.3803 65.5078 0.0169891 0.0155291 2026-02-24T07:48:51.217 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:50 trial016 ceph-mon[39544]: pgmap v67: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s wr, 9.34k op/s 2026-02-24T07:48:51.728 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:51.873 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:51.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 128 436714 436586 64.3497 62.7656 0.017819 0.0155368 2026-02-24T07:48:52.243 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:52.241+0000 7fce5e8dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:52.243 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:52.241+0000 7fce5e8dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:52.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:52.262 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:52.278 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:52.278 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:52.289 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:52.289 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:52.304 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:52.304 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:52.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 128 444042 443914 64.2182 57.25 0.00640497 0.0155681 2026-02-24T07:48:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:52 trial016 ceph-mon[39544]: pgmap v68: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.81k op/s 2026-02-24T07:48:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/174006229' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:53.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 452608 452480 64.2672 66.9219 0.0118891 0.015556 2026-02-24T07:48:54.114 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:48:54.115 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:48:54.258 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:54.346 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:54.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:54.386+0000 7f8e0a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:54.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:54.386+0000 7f8e0a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:54.488 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:54.611 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:54.608+0000 7f37d37c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:54.611 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:54.609+0000 7f37d37c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:54.625 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:54.626 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:54.648 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:54.648 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:54.661 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:54.661 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:54.682 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:54.683 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:54.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 460867 460739 64.2717 64.5234 0.0229698 0.0155548 2026-02-24T07:48:55.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:48:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:48:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:48:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: pgmap v69: 17 pgs: 17 active+clean; 3.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 80 MiB/s wr, 10.22k op/s 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/230174283' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:48:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2925379673' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:55.387 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:48:55.432 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:48:55.578 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:55.697 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:55.695+0000 7f61657e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:55.697 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:55.695+0000 7f61657e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:55.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 128 469215 469087 64.2882 65.2188 0.0234376 0.0155512 2026-02-24T07:48:56.390 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:48:56.437 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:48:56.577 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:56.640 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/230174283' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:48:56.640 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:56 trial016 ceph-mon[39544]: osdmap e32: 4 total, 4 up, 4 in 2026-02-24T07:48:56.641 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:56 trial016 ceph-mon[39544]: pgmap v71: 17 pgs: 17 active+clean; 3.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.06k op/s 2026-02-24T07:48:56.641 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1317956828' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:48:56.696 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:56.694+0000 7f88d27da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:56.696 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:56.694+0000 7f88d27da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:56.725 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:48:56.861 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:56.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 477576 477449 64.3061 65.3281 0.017835 0.0155476 2026-02-24T07:48:56.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:56.986+0000 7f553941b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:56.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:56.987+0000 7f553941b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:57.006 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:57.006 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:57.022 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:57.022 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:57.037 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:57.037 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:57.051 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:57.051 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:57.390 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:48:57.433 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:48:57.577 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:57.693 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1317956828' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:48:57.693 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:57 trial016 ceph-mon[39544]: osdmap e33: 4 total, 4 up, 4 in 2026-02-24T07:48:57.693 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1280654462' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:48:57.694 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1970412240' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:48:57.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 128 485209 485081 64.2267 59.625 0.0106764 0.0155586 2026-02-24T07:48:58.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:58.042+0000 7f1735967640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:58.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:58.043+0000 7f1735967640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:58.395 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:48:58.677 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1280654462' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:48:58.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:58 trial016 ceph-mon[39544]: osdmap e34: 4 total, 4 up, 4 in 2026-02-24T07:48:58.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:58 trial016 ceph-mon[39544]: pgmap v74: 17 pgs: 17 active+clean; 3.4 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.26k op/s 2026-02-24T07:48:58.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/998718768' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:48:58.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:48:58.943804+0000 min lat: 0.000616464 max lat: 0.0911859 avg lat: 0.0156052 2026-02-24T07:48:58.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:48:58.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 492174 492046 64.063 54.4141 0.0305897 0.0156052 2026-02-24T07:48:59.071 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:48:59.071 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:48:59.101 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:48:59.203 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:59.261 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:48:59.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/998718768' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:48:59.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:59 trial016 ceph-mon[39544]: osdmap e35: 4 total, 4 up, 4 in 2026-02-24T07:48:59.678 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:48:59 trial016 ceph-mon[39544]: 2.4 scrub starts 2026-02-24T07:48:59.738 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:59.735+0000 7f69b1b8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:59.738 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:59.735+0000 7f69b1b8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:59.814 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:59.812+0000 7fb1bd5c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:59.815 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:48:59.813+0000 7fb1bd5c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:48:59.830 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:48:59.830 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:48:59.853 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:48:59.854 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:48:59.867 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:48:59.867 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:48:59.885 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:48:59.885 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:48:59.893 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:48:59.893 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:48:59.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 498677 498549 63.8456 50.8047 0.00229308 0.0156596 2026-02-24T07:48:59.954 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2026-02-24T07:48:59.757369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3966222880,"num_objects":60514,"num_object_clones":0,"num_object_copies":181542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60514,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":484221,"num_write_kb":3874838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15371544,"kb_used_data":11527752,"kb_used_omap":62,"kb_used_meta":3843649,"kb_avail":2920641256,"statfs":{"total":3006477107200,"available":2990736646144,"internally_reserved":0,"allocated":11804418048,"data_stored":11803630373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63772,"internal_metadata":3935897316},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":340647936,"num_objects":5197,"num_object_clones":0,"num_object_copies":15591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41583,"num_write_kb":332664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.370905"},"pg_stats":[{"pgid":"2.f","version":"34'31012","reported_seq":31029,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.750284+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:57.750284+0000","last_peered":"2026-02-24T07:48:57.750284+0000","last_clean":"2026-02-24T07:48:57.750284+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:57.750284+0000","last_undegraded":"2026-02-24T07:48:57.750284+0000","last_fullsized":"2026-02-24T07:48:57.750284+0000","mapping_epoch":29,"log_start":"34'31008","ondisk_log_start":"34'31008","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254050304,"num_objects":3877,"num_object_clones":0,"num_object_copies":11631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31012,"num_write_kb":248096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'30560","reported_seq":30580,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.762188+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:57.762188+0000","last_peered":"2026-02-24T07:48:57.762188+0000","last_clean":"2026-02-24T07:48:57.762188+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:57.762188+0000","last_undegraded":"2026-02-24T07:48:57.762188+0000","last_fullsized":"2026-02-24T07:48:57.762188+0000","mapping_epoch":29,"log_start":"34'30549","ondisk_log_start":"34'30549","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250347520,"num_objects":3820,"num_object_clones":0,"num_object_copies":11460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30560,"num_write_kb":244480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'31168","reported_seq":31174,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795813+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:57.795813+0000","last_peered":"2026-02-24T07:48:57.795813+0000","last_clean":"2026-02-24T07:48:57.795813+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:57.795813+0000","last_undegraded":"2026-02-24T07:48:57.795813+0000","last_fullsized":"2026-02-24T07:48:57.795813+0000","mapping_epoch":29,"log_start":"34'31152","ondisk_log_start":"34'31152","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255328256,"num_objects":3896,"num_object_clones":0,"num_object_copies":11688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31168,"num_write_kb":249344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'30584","reported_seq":30596,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795770+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:57.795770+0000","last_peered":"2026-02-24T07:48:57.795770+0000","last_clean":"2026-02-24T07:48:57.795770+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:57.795770+0000","last_undegraded":"2026-02-24T07:48:57.795770+0000","last_fullsized":"2026-02-24T07:48:57.795770+0000","mapping_epoch":29,"log_start":"34'30568","ondisk_log_start":"34'30568","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30584,"num_write_kb":244672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.391184+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:57.391184+0000","last_peered":"2026-02-24T07:48:57.391184+0000","last_clean":"2026-02-24T07:48:57.391184+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:57.391184+0000","last_undegraded":"2026-02-24T07:48:57.391184+0000","last_fullsized":"2026-02-24T07:48:57.391184+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'30168","reported_seq":30188,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.739939+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:57.739939+0000","last_peered":"2026-02-24T07:48:57.739939+0000","last_clean":"2026-02-24T07:48:57.739939+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:57.739939+0000","last_undegraded":"2026-02-24T07:48:57.739939+0000","last_fullsized":"2026-02-24T07:48:57.739939+0000","mapping_epoch":29,"log_start":"34'30128","ondisk_log_start":"34'30128","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247136256,"num_objects":3771,"num_object_clones":0,"num_object_copies":11313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30168,"num_write_kb":241344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'30282","reported_seq":30300,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760980+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:57.760980+0000","last_peered":"2026-02-24T07:48:57.760980+0000","last_clean":"2026-02-24T07:48:57.760980+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:57.760980+0000","last_undegraded":"2026-02-24T07:48:57.760980+0000","last_fullsized":"2026-02-24T07:48:57.760980+0000","mapping_epoch":29,"log_start":"34'30275","ondisk_log_start":"34'30275","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248070144,"num_objects":3786,"num_object_clones":0,"num_object_copies":11358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30282,"num_write_kb":242256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'30392","reported_seq":30407,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795903+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:57.795903+0000","last_peered":"2026-02-24T07:48:57.795903+0000","last_clean":"2026-02-24T07:48:57.795903+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:57.795903+0000","last_undegraded":"2026-02-24T07:48:57.795903+0000","last_fullsized":"2026-02-24T07:48:57.795903+0000","mapping_epoch":29,"log_start":"34'30384","ondisk_log_start":"34'30384","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248971264,"num_objects":3799,"num_object_clones":0,"num_object_copies":11397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30392,"num_write_kb":243136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'29408","reported_seq":29428,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.713906+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:57.713906+0000","last_peered":"2026-02-24T07:48:57.713906+0000","last_clean":"2026-02-24T07:48:57.713906+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:57.713906+0000","last_undegraded":"2026-02-24T07:48:57.713906+0000","last_fullsized":"2026-02-24T07:48:57.713906+0000","mapping_epoch":29,"log_start":"34'29400","ondisk_log_start":"34'29400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240910336,"num_objects":3676,"num_object_clones":0,"num_object_copies":11028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29408,"num_write_kb":235264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'30360","reported_seq":30380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.761203+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:57.761203+0000","last_peered":"2026-02-24T07:48:57.761203+0000","last_clean":"2026-02-24T07:48:57.761203+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:57.761203+0000","last_undegraded":"2026-02-24T07:48:57.761203+0000","last_fullsized":"2026-02-24T07:48:57.761203+0000","mapping_epoch":29,"log_start":"34'30352","ondisk_log_start":"34'30352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248709120,"num_objects":3795,"num_object_clones":0,"num_object_copies":11385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30360,"num_write_kb":242880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'29360","reported_seq":29380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.724914+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:57.724914+0000","last_peered":"2026-02-24T07:48:57.724914+0000","last_clean":"2026-02-24T07:48:57.724914+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:57.724914+0000","last_undegraded":"2026-02-24T07:48:57.724914+0000","last_fullsized":"2026-02-24T07:48:57.724914+0000","mapping_epoch":29,"log_start":"34'29352","ondisk_log_start":"34'29352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240517120,"num_objects":3670,"num_object_clones":0,"num_object_copies":11010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29360,"num_write_kb":234880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'29752","reported_seq":29772,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.749646+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:57.749646+0000","last_peered":"2026-02-24T07:48:57.749646+0000","last_clean":"2026-02-24T07:48:57.749646+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:57.749646+0000","last_undegraded":"2026-02-24T07:48:57.749646+0000","last_fullsized":"2026-02-24T07:48:57.749646+0000","mapping_epoch":29,"log_start":"34'29744","ondisk_log_start":"34'29744","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243728384,"num_objects":3719,"num_object_clones":0,"num_object_copies":11157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29752,"num_write_kb":238016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'29984","reported_seq":30004,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760186+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:57.760186+0000","last_peered":"2026-02-24T07:48:57.760186+0000","last_clean":"2026-02-24T07:48:57.760186+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:57.760186+0000","last_undegraded":"2026-02-24T07:48:57.760186+0000","last_fullsized":"2026-02-24T07:48:57.760186+0000","mapping_epoch":29,"log_start":"34'29976","ondisk_log_start":"34'29976","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245628928,"num_objects":3748,"num_object_clones":0,"num_object_copies":11244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29984,"num_write_kb":239872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'30736","reported_seq":30752,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757937+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:57.757937+0000","last_peered":"2026-02-24T07:48:57.757937+0000","last_clean":"2026-02-24T07:48:57.757937+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:57.757937+0000","last_undegraded":"2026-02-24T07:48:57.757937+0000","last_fullsized":"2026-02-24T07:48:57.757937+0000","mapping_epoch":29,"log_start":"34'30728","ondisk_log_start":"34'30728","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251789312,"num_objects":3842,"num_object_clones":0,"num_object_copies":11526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30736,"num_write_kb":245888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'30248","reported_seq":30268,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.727840+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:57.727840+0000","last_peered":"2026-02-24T07:48:57.727840+0000","last_clean":"2026-02-24T07:48:57.727840+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:57.727840+0000","last_undegraded":"2026-02-24T07:48:57.727840+0000","last_fullsized":"2026-02-24T07:48:57.727840+0000","mapping_epoch":29,"log_start":"34'30208","ondisk_log_start":"34'30208","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247791616,"num_objects":3781,"num_object_clones":0,"num_object_copies":11343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30248,"num_write_kb":241984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'30432","reported_seq":30452,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.751718+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:57.751718+0000","last_peered":"2026-02-24T07:48:57.751718+0000","last_clean":"2026-02-24T07:48:57.751718+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:57.751718+0000","last_undegraded":"2026-02-24T07:48:57.751718+0000","last_fullsized":"2026-02-24T07:48:57.751718+0000","mapping_epoch":29,"log_start":"34'30416","ondisk_log_start":"34'30416","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249298944,"num_objects":3804,"num_object_clones":0,"num_object_copies":11412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30432,"num_write_kb":243456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'29640","reported_seq":29660,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757827+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:57.757827+0000","last_peered":"2026-02-24T07:48:57.757827+0000","last_clean":"2026-02-24T07:48:57.757827+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:57.757827+0000","last_undegraded":"2026-02-24T07:48:57.757827+0000","last_fullsized":"2026-02-24T07:48:57.757827+0000","mapping_epoch":29,"log_start":"34'29616","ondisk_log_start":"34'29616","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242810880,"num_objects":3705,"num_object_clones":0,"num_object_copies":11115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29640,"num_write_kb":237120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3965632512,"num_objects":60512,"num_object_clones":0,"num_object_copies":181536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484086,"num_write_kb":3872688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11896340480,"data_stored":11896340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215133,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4494212,"kb_used_data":3366320,"kb_used_omap":10,"kb_used_meta":1127861,"kb_avail":729508988,"statfs":{"total":751619276800,"available":747017203712,"internally_reserved":0,"allocated":3447111680,"data_stored":3446915843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10723,"internal_metadata":1154930205},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444062,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3540984,"kb_used_data":2647716,"kb_used_omap":14,"kb_used_meta":893233,"kb_avail":730462216,"statfs":{"total":751619276800,"available":747993309184,"internally_reserved":0,"allocated":2711261184,"data_stored":2711057468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":914670656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3809840,"kb_used_data":2880476,"kb_used_omap":17,"kb_used_meta":929326,"kb_avail":730193360,"statfs":{"total":751619276800,"available":747718000640,"internally_reserved":0,"allocated":2949607424,"data_stored":2949415139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":951630356},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3526508,"kb_used_data":2633240,"kb_used_omap":19,"kb_used_meta":893228,"kb_avail":730476692,"statfs":{"total":751619276800,"available":748008132608,"internally_reserved":0,"allocated":2696437760,"data_stored":2696241923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":914666099},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2738167808,"data_stored":2738167808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2976628736,"data_stored":2976628736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2714746880,"data_stored":2714746880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3466797056,"data_stored":3466797056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:48:59.956 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:00.140 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:00.261 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:00.259+0000 7fb60bf26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:00.261 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:00.259+0000 7fb60bf26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:00.399 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:00.400 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:00.444 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2026-02-24T07:48:59.757369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3966222880,"num_objects":60514,"num_object_clones":0,"num_object_copies":181542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60514,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":484221,"num_write_kb":3874838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15371544,"kb_used_data":11527752,"kb_used_omap":62,"kb_used_meta":3843649,"kb_avail":2920641256,"statfs":{"total":3006477107200,"available":2990736646144,"internally_reserved":0,"allocated":11804418048,"data_stored":11803630373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63772,"internal_metadata":3935897316},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":340647936,"num_objects":5197,"num_object_clones":0,"num_object_copies":15591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41583,"num_write_kb":332664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.370905"},"pg_stats":[{"pgid":"2.f","version":"34'31012","reported_seq":31029,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.750284+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:57.750284+0000","last_peered":"2026-02-24T07:48:57.750284+0000","last_clean":"2026-02-24T07:48:57.750284+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:57.750284+0000","last_undegraded":"2026-02-24T07:48:57.750284+0000","last_fullsized":"2026-02-24T07:48:57.750284+0000","mapping_epoch":29,"log_start":"34'31008","ondisk_log_start":"34'31008","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254050304,"num_objects":3877,"num_object_clones":0,"num_object_copies":11631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31012,"num_write_kb":248096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'30560","reported_seq":30580,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.762188+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:57.762188+0000","last_peered":"2026-02-24T07:48:57.762188+0000","last_clean":"2026-02-24T07:48:57.762188+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:57.762188+0000","last_undegraded":"2026-02-24T07:48:57.762188+0000","last_fullsized":"2026-02-24T07:48:57.762188+0000","mapping_epoch":29,"log_start":"34'30549","ondisk_log_start":"34'30549","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250347520,"num_objects":3820,"num_object_clones":0,"num_object_copies":11460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30560,"num_write_kb":244480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'31168","reported_seq":31174,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795813+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:57.795813+0000","last_peered":"2026-02-24T07:48:57.795813+0000","last_clean":"2026-02-24T07:48:57.795813+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:57.795813+0000","last_undegraded":"2026-02-24T07:48:57.795813+0000","last_fullsized":"2026-02-24T07:48:57.795813+0000","mapping_epoch":29,"log_start":"34'31152","ondisk_log_start":"34'31152","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255328256,"num_objects":3896,"num_object_clones":0,"num_object_copies":11688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31168,"num_write_kb":249344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'30584","reported_seq":30596,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795770+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:57.795770+0000","last_peered":"2026-02-24T07:48:57.795770+0000","last_clean":"2026-02-24T07:48:57.795770+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:57.795770+0000","last_undegraded":"2026-02-24T07:48:57.795770+0000","last_fullsized":"2026-02-24T07:48:57.795770+0000","mapping_epoch":29,"log_start":"34'30568","ondisk_log_start":"34'30568","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30584,"num_write_kb":244672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.391184+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:57.391184+0000","last_peered":"2026-02-24T07:48:57.391184+0000","last_clean":"2026-02-24T07:48:57.391184+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:57.391184+0000","last_undegraded":"2026-02-24T07:48:57.391184+0000","last_fullsized":"2026-02-24T07:48:57.391184+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'30168","reported_seq":30188,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.739939+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:57.739939+0000","last_peered":"2026-02-24T07:48:57.739939+0000","last_clean":"2026-02-24T07:48:57.739939+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:57.739939+0000","last_undegraded":"2026-02-24T07:48:57.739939+0000","last_fullsized":"2026-02-24T07:48:57.739939+0000","mapping_epoch":29,"log_start":"34'30128","ondisk_log_start":"34'30128","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247136256,"num_objects":3771,"num_object_clones":0,"num_object_copies":11313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30168,"num_write_kb":241344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'30282","reported_seq":30300,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760980+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:57.760980+0000","last_peered":"2026-02-24T07:48:57.760980+0000","last_clean":"2026-02-24T07:48:57.760980+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:57.760980+0000","last_undegraded":"2026-02-24T07:48:57.760980+0000","last_fullsized":"2026-02-24T07:48:57.760980+0000","mapping_epoch":29,"log_start":"34'30275","ondisk_log_start":"34'30275","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248070144,"num_objects":3786,"num_object_clones":0,"num_object_copies":11358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30282,"num_write_kb":242256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'30392","reported_seq":30407,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795903+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:57.795903+0000","last_peered":"2026-02-24T07:48:57.795903+0000","last_clean":"2026-02-24T07:48:57.795903+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:57.795903+0000","last_undegraded":"2026-02-24T07:48:57.795903+0000","last_fullsized":"2026-02-24T07:48:57.795903+0000","mapping_epoch":29,"log_start":"34'30384","ondisk_log_start":"34'30384","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248971264,"num_objects":3799,"num_object_clones":0,"num_object_copies":11397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30392,"num_write_kb":243136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'29408","reported_seq":29428,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.713906+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:57.713906+0000","last_peered":"2026-02-24T07:48:57.713906+0000","last_clean":"2026-02-24T07:48:57.713906+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:57.713906+0000","last_undegraded":"2026-02-24T07:48:57.713906+0000","last_fullsized":"2026-02-24T07:48:57.713906+0000","mapping_epoch":29,"log_start":"34'29400","ondisk_log_start":"34'29400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240910336,"num_objects":3676,"num_object_clones":0,"num_object_copies":11028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29408,"num_write_kb":235264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'30360","reported_seq":30380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.761203+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:57.761203+0000","last_peered":"2026-02-24T07:48:57.761203+0000","last_clean":"2026-02-24T07:48:57.761203+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:57.761203+0000","last_undegraded":"2026-02-24T07:48:57.761203+0000","last_fullsized":"2026-02-24T07:48:57.761203+0000","mapping_epoch":29,"log_start":"34'30352","ondisk_log_start":"34'30352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248709120,"num_objects":3795,"num_object_clones":0,"num_object_copies":11385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30360,"num_write_kb":242880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'29360","reported_seq":29380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.724914+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:57.724914+0000","last_peered":"2026-02-24T07:48:57.724914+0000","last_clean":"2026-02-24T07:48:57.724914+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:57.724914+0000","last_undegraded":"2026-02-24T07:48:57.724914+0000","last_fullsized":"2026-02-24T07:48:57.724914+0000","mapping_epoch":29,"log_start":"34'29352","ondisk_log_start":"34'29352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240517120,"num_objects":3670,"num_object_clones":0,"num_object_copies":11010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29360,"num_write_kb":234880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'29752","reported_seq":29772,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.749646+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:57.749646+0000","last_peered":"2026-02-24T07:48:57.749646+0000","last_clean":"2026-02-24T07:48:57.749646+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:57.749646+0000","last_undegraded":"2026-02-24T07:48:57.749646+0000","last_fullsized":"2026-02-24T07:48:57.749646+0000","mapping_epoch":29,"log_start":"34'29744","ondisk_log_start":"34'29744","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243728384,"num_objects":3719,"num_object_clones":0,"num_object_copies":11157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29752,"num_write_kb":238016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'29984","reported_seq":30004,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760186+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:57.760186+0000","last_peered":"2026-02-24T07:48:57.760186+0000","last_clean":"2026-02-24T07:48:57.760186+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:57.760186+0000","last_undegraded":"2026-02-24T07:48:57.760186+0000","last_fullsized":"2026-02-24T07:48:57.760186+0000","mapping_epoch":29,"log_start":"34'29976","ondisk_log_start":"34'29976","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245628928,"num_objects":3748,"num_object_clones":0,"num_object_copies":11244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29984,"num_write_kb":239872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'30736","reported_seq":30752,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757937+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:57.757937+0000","last_peered":"2026-02-24T07:48:57.757937+0000","last_clean":"2026-02-24T07:48:57.757937+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:57.757937+0000","last_undegraded":"2026-02-24T07:48:57.757937+0000","last_fullsized":"2026-02-24T07:48:57.757937+0000","mapping_epoch":29,"log_start":"34'30728","ondisk_log_start":"34'30728","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251789312,"num_objects":3842,"num_object_clones":0,"num_object_copies":11526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30736,"num_write_kb":245888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'30248","reported_seq":30268,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.727840+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:57.727840+0000","last_peered":"2026-02-24T07:48:57.727840+0000","last_clean":"2026-02-24T07:48:57.727840+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:57.727840+0000","last_undegraded":"2026-02-24T07:48:57.727840+0000","last_fullsized":"2026-02-24T07:48:57.727840+0000","mapping_epoch":29,"log_start":"34'30208","ondisk_log_start":"34'30208","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247791616,"num_objects":3781,"num_object_clones":0,"num_object_copies":11343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30248,"num_write_kb":241984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'30432","reported_seq":30452,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.751718+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:57.751718+0000","last_peered":"2026-02-24T07:48:57.751718+0000","last_clean":"2026-02-24T07:48:57.751718+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:57.751718+0000","last_undegraded":"2026-02-24T07:48:57.751718+0000","last_fullsized":"2026-02-24T07:48:57.751718+0000","mapping_epoch":29,"log_start":"34'30416","ondisk_log_start":"34'30416","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249298944,"num_objects":3804,"num_object_clones":0,"num_object_copies":11412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30432,"num_write_kb":243456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'29640","reported_seq":29660,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757827+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:57.757827+0000","last_peered":"2026-02-24T07:48:57.757827+0000","last_clean":"2026-02-24T07:48:57.757827+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:57.757827+0000","last_undegraded":"2026-02-24T07:48:57.757827+0000","last_fullsized":"2026-02-24T07:48:57.757827+0000","mapping_epoch":29,"log_start":"34'29616","ondisk_log_start":"34'29616","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242810880,"num_objects":3705,"num_object_clones":0,"num_object_copies":11115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29640,"num_write_kb":237120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3965632512,"num_objects":60512,"num_object_clones":0,"num_object_copies":181536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484086,"num_write_kb":3872688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11896340480,"data_stored":11896340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215133,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4494212,"kb_used_data":3366320,"kb_used_omap":10,"kb_used_meta":1127861,"kb_avail":729508988,"statfs":{"total":751619276800,"available":747017203712,"internally_reserved":0,"allocated":3447111680,"data_stored":3446915843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10723,"internal_metadata":1154930205},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444062,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3540984,"kb_used_data":2647716,"kb_used_omap":14,"kb_used_meta":893233,"kb_avail":730462216,"statfs":{"total":751619276800,"available":747993309184,"internally_reserved":0,"allocated":2711261184,"data_stored":2711057468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":914670656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3809840,"kb_used_data":2880476,"kb_used_omap":17,"kb_used_meta":929326,"kb_avail":730193360,"statfs":{"total":751619276800,"available":747718000640,"internally_reserved":0,"allocated":2949607424,"data_stored":2949415139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":951630356},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3526508,"kb_used_data":2633240,"kb_used_omap":19,"kb_used_meta":893228,"kb_avail":730476692,"statfs":{"total":751619276800,"available":748008132608,"internally_reserved":0,"allocated":2696437760,"data_stored":2696241923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":914666099},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2738167808,"data_stored":2738167808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2976628736,"data_stored":2976628736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2714746880,"data_stored":2714746880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3466797056,"data_stored":3466797056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:00.446 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:49:00.446 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:00.446 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:49:00.447 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:00.472 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:00 trial016 ceph-mon[39544]: 2.7 scrub starts 2026-02-24T07:49:00.472 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:00 trial016 ceph-mon[39544]: pgmap v76: 17 pgs: 17 active+clean; 3.7 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.51k op/s 2026-02-24T07:49:00.472 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3637498656' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:00.472 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:00 trial016 ceph-mon[39544]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:00.589 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:00.711 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:00.709+0000 7efd66417640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:00.711 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:00.709+0000 7efd66417640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:00.854 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:00.855 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:00.903 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2026-02-24T07:48:59.757369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3966222880,"num_objects":60514,"num_object_clones":0,"num_object_copies":181542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60514,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":484221,"num_write_kb":3874838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15371544,"kb_used_data":11527752,"kb_used_omap":62,"kb_used_meta":3843649,"kb_avail":2920641256,"statfs":{"total":3006477107200,"available":2990736646144,"internally_reserved":0,"allocated":11804418048,"data_stored":11803630373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63772,"internal_metadata":3935897316},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":340647936,"num_objects":5197,"num_object_clones":0,"num_object_copies":15591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41583,"num_write_kb":332664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.370905"},"pg_stats":[{"pgid":"2.f","version":"34'31012","reported_seq":31029,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.750284+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:48:57.750284+0000","last_peered":"2026-02-24T07:48:57.750284+0000","last_clean":"2026-02-24T07:48:57.750284+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:48:57.750284+0000","last_undegraded":"2026-02-24T07:48:57.750284+0000","last_fullsized":"2026-02-24T07:48:57.750284+0000","mapping_epoch":29,"log_start":"34'31008","ondisk_log_start":"34'31008","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254050304,"num_objects":3877,"num_object_clones":0,"num_object_copies":11631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31012,"num_write_kb":248096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'30560","reported_seq":30580,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.762188+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:48:57.762188+0000","last_peered":"2026-02-24T07:48:57.762188+0000","last_clean":"2026-02-24T07:48:57.762188+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:48:57.762188+0000","last_undegraded":"2026-02-24T07:48:57.762188+0000","last_fullsized":"2026-02-24T07:48:57.762188+0000","mapping_epoch":29,"log_start":"34'30549","ondisk_log_start":"34'30549","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250347520,"num_objects":3820,"num_object_clones":0,"num_object_copies":11460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30560,"num_write_kb":244480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'31168","reported_seq":31174,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795813+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:48:57.795813+0000","last_peered":"2026-02-24T07:48:57.795813+0000","last_clean":"2026-02-24T07:48:57.795813+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:48:57.795813+0000","last_undegraded":"2026-02-24T07:48:57.795813+0000","last_fullsized":"2026-02-24T07:48:57.795813+0000","mapping_epoch":29,"log_start":"34'31152","ondisk_log_start":"34'31152","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255328256,"num_objects":3896,"num_object_clones":0,"num_object_copies":11688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31168,"num_write_kb":249344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'30584","reported_seq":30596,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795770+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:48:57.795770+0000","last_peered":"2026-02-24T07:48:57.795770+0000","last_clean":"2026-02-24T07:48:57.795770+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:48:57.795770+0000","last_undegraded":"2026-02-24T07:48:57.795770+0000","last_fullsized":"2026-02-24T07:48:57.795770+0000","mapping_epoch":29,"log_start":"34'30568","ondisk_log_start":"34'30568","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30584,"num_write_kb":244672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.391184+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:57.391184+0000","last_peered":"2026-02-24T07:48:57.391184+0000","last_clean":"2026-02-24T07:48:57.391184+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:57.391184+0000","last_undegraded":"2026-02-24T07:48:57.391184+0000","last_fullsized":"2026-02-24T07:48:57.391184+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'30168","reported_seq":30188,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.739939+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:48:57.739939+0000","last_peered":"2026-02-24T07:48:57.739939+0000","last_clean":"2026-02-24T07:48:57.739939+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:48:57.739939+0000","last_undegraded":"2026-02-24T07:48:57.739939+0000","last_fullsized":"2026-02-24T07:48:57.739939+0000","mapping_epoch":29,"log_start":"34'30128","ondisk_log_start":"34'30128","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247136256,"num_objects":3771,"num_object_clones":0,"num_object_copies":11313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30168,"num_write_kb":241344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'30282","reported_seq":30300,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760980+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:48:57.760980+0000","last_peered":"2026-02-24T07:48:57.760980+0000","last_clean":"2026-02-24T07:48:57.760980+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:48:57.760980+0000","last_undegraded":"2026-02-24T07:48:57.760980+0000","last_fullsized":"2026-02-24T07:48:57.760980+0000","mapping_epoch":29,"log_start":"34'30275","ondisk_log_start":"34'30275","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248070144,"num_objects":3786,"num_object_clones":0,"num_object_copies":11358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30282,"num_write_kb":242256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'30392","reported_seq":30407,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.795903+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:48:57.795903+0000","last_peered":"2026-02-24T07:48:57.795903+0000","last_clean":"2026-02-24T07:48:57.795903+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:48:57.795903+0000","last_undegraded":"2026-02-24T07:48:57.795903+0000","last_fullsized":"2026-02-24T07:48:57.795903+0000","mapping_epoch":29,"log_start":"34'30384","ondisk_log_start":"34'30384","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248971264,"num_objects":3799,"num_object_clones":0,"num_object_copies":11397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30392,"num_write_kb":243136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'29408","reported_seq":29428,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.713906+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:48:57.713906+0000","last_peered":"2026-02-24T07:48:57.713906+0000","last_clean":"2026-02-24T07:48:57.713906+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:48:57.713906+0000","last_undegraded":"2026-02-24T07:48:57.713906+0000","last_fullsized":"2026-02-24T07:48:57.713906+0000","mapping_epoch":29,"log_start":"34'29400","ondisk_log_start":"34'29400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240910336,"num_objects":3676,"num_object_clones":0,"num_object_copies":11028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29408,"num_write_kb":235264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'30360","reported_seq":30380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.761203+0000","last_change":"2026-02-24T07:47:57.848920+0000","last_active":"2026-02-24T07:48:57.761203+0000","last_peered":"2026-02-24T07:48:57.761203+0000","last_clean":"2026-02-24T07:48:57.761203+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:48:57.761203+0000","last_undegraded":"2026-02-24T07:48:57.761203+0000","last_fullsized":"2026-02-24T07:48:57.761203+0000","mapping_epoch":29,"log_start":"34'30352","ondisk_log_start":"34'30352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:57.827492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248709120,"num_objects":3795,"num_object_clones":0,"num_object_copies":11385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30360,"num_write_kb":242880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'29360","reported_seq":29380,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.724914+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:48:57.724914+0000","last_peered":"2026-02-24T07:48:57.724914+0000","last_clean":"2026-02-24T07:48:57.724914+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:48:57.724914+0000","last_undegraded":"2026-02-24T07:48:57.724914+0000","last_fullsized":"2026-02-24T07:48:57.724914+0000","mapping_epoch":29,"log_start":"34'29352","ondisk_log_start":"34'29352","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240517120,"num_objects":3670,"num_object_clones":0,"num_object_copies":11010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29360,"num_write_kb":234880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'29752","reported_seq":29772,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.749646+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:48:57.749646+0000","last_peered":"2026-02-24T07:48:57.749646+0000","last_clean":"2026-02-24T07:48:57.749646+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:48:57.749646+0000","last_undegraded":"2026-02-24T07:48:57.749646+0000","last_fullsized":"2026-02-24T07:48:57.749646+0000","mapping_epoch":29,"log_start":"34'29744","ondisk_log_start":"34'29744","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243728384,"num_objects":3719,"num_object_clones":0,"num_object_copies":11157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29752,"num_write_kb":238016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'29984","reported_seq":30004,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.760186+0000","last_change":"2026-02-24T07:47:57.849929+0000","last_active":"2026-02-24T07:48:57.760186+0000","last_peered":"2026-02-24T07:48:57.760186+0000","last_clean":"2026-02-24T07:48:57.760186+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:48:57.760186+0000","last_undegraded":"2026-02-24T07:48:57.760186+0000","last_fullsized":"2026-02-24T07:48:57.760186+0000","mapping_epoch":29,"log_start":"34'29976","ondisk_log_start":"34'29976","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:59.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245628928,"num_objects":3748,"num_object_clones":0,"num_object_copies":11244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29984,"num_write_kb":239872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'30736","reported_seq":30752,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757937+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:48:57.757937+0000","last_peered":"2026-02-24T07:48:57.757937+0000","last_clean":"2026-02-24T07:48:57.757937+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:48:57.757937+0000","last_undegraded":"2026-02-24T07:48:57.757937+0000","last_fullsized":"2026-02-24T07:48:57.757937+0000","mapping_epoch":29,"log_start":"34'30728","ondisk_log_start":"34'30728","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251789312,"num_objects":3842,"num_object_clones":0,"num_object_copies":11526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30736,"num_write_kb":245888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'30248","reported_seq":30268,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.727840+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:48:57.727840+0000","last_peered":"2026-02-24T07:48:57.727840+0000","last_clean":"2026-02-24T07:48:57.727840+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:48:57.727840+0000","last_undegraded":"2026-02-24T07:48:57.727840+0000","last_fullsized":"2026-02-24T07:48:57.727840+0000","mapping_epoch":29,"log_start":"34'30208","ondisk_log_start":"34'30208","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247791616,"num_objects":3781,"num_object_clones":0,"num_object_copies":11343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30248,"num_write_kb":241984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'30432","reported_seq":30452,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.751718+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:48:57.751718+0000","last_peered":"2026-02-24T07:48:57.751718+0000","last_clean":"2026-02-24T07:48:57.751718+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:48:57.751718+0000","last_undegraded":"2026-02-24T07:48:57.751718+0000","last_fullsized":"2026-02-24T07:48:57.751718+0000","mapping_epoch":29,"log_start":"34'30416","ondisk_log_start":"34'30416","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249298944,"num_objects":3804,"num_object_clones":0,"num_object_copies":11412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30432,"num_write_kb":243456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'29640","reported_seq":29660,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-24T07:48:57.757827+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:48:57.757827+0000","last_peered":"2026-02-24T07:48:57.757827+0000","last_clean":"2026-02-24T07:48:57.757827+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:48:57.757827+0000","last_undegraded":"2026-02-24T07:48:57.757827+0000","last_fullsized":"2026-02-24T07:48:57.757827+0000","mapping_epoch":29,"log_start":"34'29616","ondisk_log_start":"34'29616","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242810880,"num_objects":3705,"num_object_clones":0,"num_object_copies":11115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29640,"num_write_kb":237120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3965632512,"num_objects":60512,"num_object_clones":0,"num_object_copies":181536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484086,"num_write_kb":3872688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11896340480,"data_stored":11896340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215133,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4494212,"kb_used_data":3366320,"kb_used_omap":10,"kb_used_meta":1127861,"kb_avail":729508988,"statfs":{"total":751619276800,"available":747017203712,"internally_reserved":0,"allocated":3447111680,"data_stored":3446915843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10723,"internal_metadata":1154930205},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,5,13,27,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444062,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3540984,"kb_used_data":2647716,"kb_used_omap":14,"kb_used_meta":893233,"kb_avail":730462216,"statfs":{"total":751619276800,"available":747993309184,"internally_reserved":0,"allocated":2711261184,"data_stored":2711057468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":914670656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3809840,"kb_used_data":2880476,"kb_used_omap":17,"kb_used_meta":929326,"kb_avail":730193360,"statfs":{"total":751619276800,"available":747718000640,"internally_reserved":0,"allocated":2949607424,"data_stored":2949415139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":951630356},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3526508,"kb_used_data":2633240,"kb_used_omap":19,"kb_used_meta":893228,"kb_avail":730476692,"statfs":{"total":751619276800,"available":748008132608,"internally_reserved":0,"allocated":2696437760,"data_stored":2696241923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":914666099},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2738167808,"data_stored":2738167808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2976628736,"data_stored":2976628736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2714746880,"data_stored":2714746880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3466797056,"data_stored":3466797056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:00.905 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:49:00.905 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 31 2026-02-24T07:49:00.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 507082 506954 63.8749 65.6641 0.00342911 0.0156523 2026-02-24T07:49:01.081 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:01.209 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:01.206+0000 7fbba81c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:01.209 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:01.207+0000 7fbba81c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:01.350 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:49:01.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:01.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:01 trial016 ceph-mon[39544]: 2.7 scrub ok 2026-02-24T07:49:01.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:01 trial016 ceph-mon[39544]: 2.4 scrub ok 2026-02-24T07:49:01.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:01 trial016 ceph-mon[39544]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:01.816 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:01 trial016 ceph-mon[39544]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:01.817 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/208008668' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "31"} : dispatch 2026-02-24T07:49:01.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 127 515454 515327 63.8992 65.4141 0.0206948 0.015646 2026-02-24T07:49:01.951 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:02.092 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:02.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:02.208+0000 7f31188d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:02.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:02.208+0000 7f31188d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:02.224 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:02.224 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:02.244 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:02.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:02.258 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:02.259 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:02.288 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:02.288 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:02 trial016 ceph-mon[39544]: pgmap v77: 17 pgs: 17 active+clean; 3.7 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.93k op/s 2026-02-24T07:49:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:02 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:49:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:02 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:49:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1171074777' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:02.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 127 524076 523949 63.9532 67.3594 0.0226446 0.0156324 2026-02-24T07:49:03.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 128 533186 533058 64.0641 71.1641 0.0086175 0.0156065 2026-02-24T07:49:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:03 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:49:04.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:03 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:49:04.333 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:04.480 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:04.626 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:04 trial016 ceph-mon[39544]: pgmap v78: 17 pgs: 17 active+clean; 4.0 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.86k op/s 2026-02-24T07:49:04.627 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:04 trial016 ceph-mon[39544]: 2.d scrub starts 2026-02-24T07:49:04.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 540674 540546 63.9797 58.5 0.0146029 0.0156259 2026-02-24T07:49:05.030 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:04.954+0000 7f83cfef1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:05.030 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:04.955+0000 7f83cfef1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:05.030 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:05.030 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:05.030 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:05.031 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:05.031 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:05.031 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:05.031 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:05.031 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:05.309 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:05.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 127 547502 547375 63.821 53.3516 0.0132283 0.0156656 2026-02-24T07:49:06.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1187109400' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:06.395 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:06.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:06.396 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-24T07:49:06.396 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:06.535 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:06.655 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:06.653+0000 7f415a18d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:06.655 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:06.653+0000 7f415a18d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:06.794 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:06.794 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:06 trial016 ceph-mon[39544]: pgmap v79: 17 pgs: 17 active+clean; 4.0 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 75 MiB/s wr, 9.56k op/s 2026-02-24T07:49:06.794 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:06 trial016 ceph-mon[39544]: 2.d scrub ok 2026-02-24T07:49:06.795 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:06.839 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-24T07:49:05.758105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4281008672,"num_objects":65317,"num_object_clones":0,"num_object_copies":195951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65317,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":522647,"num_write_kb":4182246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16663516,"kb_used_data":12476812,"kb_used_omap":67,"kb_used_meta":4186556,"kb_avail":2919349284,"statfs":{"total":3006477107200,"available":2989413666816,"internally_reserved":0,"allocated":12776255488,"data_stored":12775412660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68994,"internal_metadata":4287033982},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,8,21,45,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":655433728,"num_objects":10000,"num_object_clones":0,"num_object_copies":30000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80009,"num_write_kb":640072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.367244"},"pg_stats":[{"pgid":"2.f","version":"35'33336","reported_seq":33358,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.751797+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:49:02.751797+0000","last_peered":"2026-02-24T07:49:02.751797+0000","last_clean":"2026-02-24T07:49:02.751797+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:02.751797+0000","last_undegraded":"2026-02-24T07:49:02.751797+0000","last_fullsized":"2026-02-24T07:49:02.751797+0000","mapping_epoch":29,"log_start":"35'33329","ondisk_log_start":"35'33329","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273088512,"num_objects":4167,"num_object_clones":0,"num_object_copies":12501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33336,"num_write_kb":266688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'33064","reported_seq":33086,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.790958+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:49:02.790958+0000","last_peered":"2026-02-24T07:49:02.790958+0000","last_clean":"2026-02-24T07:49:02.790958+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:02.790958+0000","last_undegraded":"2026-02-24T07:49:02.790958+0000","last_fullsized":"2026-02-24T07:49:02.790958+0000","mapping_epoch":29,"log_start":"35'33060","ondisk_log_start":"35'33060","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270860288,"num_objects":4133,"num_object_clones":0,"num_object_copies":12399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33064,"num_write_kb":264512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'33256","reported_seq":33278,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.792930+0000","last_change":"2026-02-24T07:47:57.851155+0000","last_active":"2026-02-24T07:49:02.792930+0000","last_peered":"2026-02-24T07:49:02.792930+0000","last_clean":"2026-02-24T07:49:02.792930+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:02.792930+0000","last_undegraded":"2026-02-24T07:49:02.792930+0000","last_fullsized":"2026-02-24T07:49:02.792930+0000","mapping_epoch":29,"log_start":"35'33248","ondisk_log_start":"35'33248","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:02.847105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272433152,"num_objects":4157,"num_object_clones":0,"num_object_copies":12471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33256,"num_write_kb":266048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'32920","reported_seq":32942,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.796064+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:49:02.796064+0000","last_peered":"2026-02-24T07:49:02.796064+0000","last_clean":"2026-02-24T07:49:02.796064+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:02.796064+0000","last_undegraded":"2026-02-24T07:49:02.796064+0000","last_fullsized":"2026-02-24T07:49:02.796064+0000","mapping_epoch":29,"log_start":"35'32904","ondisk_log_start":"35'32904","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269680640,"num_objects":4115,"num_object_clones":0,"num_object_copies":12345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32920,"num_write_kb":263360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":208,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:48:58.396531+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:58.396531+0000","last_peered":"2026-02-24T07:48:58.396531+0000","last_clean":"2026-02-24T07:48:58.396531+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:58.396531+0000","last_undegraded":"2026-02-24T07:48:58.396531+0000","last_fullsized":"2026-02-24T07:48:58.396531+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'32592","reported_seq":32614,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.744981+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:49:02.744981+0000","last_peered":"2026-02-24T07:49:02.744981+0000","last_clean":"2026-02-24T07:49:02.744981+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:02.744981+0000","last_undegraded":"2026-02-24T07:49:02.744981+0000","last_fullsized":"2026-02-24T07:49:02.744981+0000","mapping_epoch":29,"log_start":"35'32577","ondisk_log_start":"35'32577","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266993664,"num_objects":4074,"num_object_clones":0,"num_object_copies":12222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4074,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32592,"num_write_kb":260736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'32744","reported_seq":32765,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.757771+0000","last_change":"2026-02-24T07:47:57.849889+0000","last_active":"2026-02-24T07:49:02.757771+0000","last_peered":"2026-02-24T07:49:02.757771+0000","last_clean":"2026-02-24T07:49:02.757771+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:02.757771+0000","last_undegraded":"2026-02-24T07:49:02.757771+0000","last_fullsized":"2026-02-24T07:49:02.757771+0000","mapping_epoch":29,"log_start":"35'32736","ondisk_log_start":"35'32736","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:06.074463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268238848,"num_objects":4093,"num_object_clones":0,"num_object_copies":12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32744,"num_write_kb":261952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'33048","reported_seq":33070,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.793244+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:49:02.793244+0000","last_peered":"2026-02-24T07:49:02.793244+0000","last_clean":"2026-02-24T07:49:02.793244+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:02.793244+0000","last_undegraded":"2026-02-24T07:49:02.793244+0000","last_fullsized":"2026-02-24T07:49:02.793244+0000","mapping_epoch":29,"log_start":"35'33032","ondisk_log_start":"35'33032","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270729216,"num_objects":4131,"num_object_clones":0,"num_object_copies":12393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33048,"num_write_kb":264384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'31461","reported_seq":31478,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.751119+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:49:02.751119+0000","last_peered":"2026-02-24T07:49:02.751119+0000","last_clean":"2026-02-24T07:49:02.751119+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:02.751119+0000","last_undegraded":"2026-02-24T07:49:02.751119+0000","last_fullsized":"2026-02-24T07:49:02.751119+0000","mapping_epoch":29,"log_start":"35'31453","ondisk_log_start":"35'31453","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257728512,"num_objects":3933,"num_object_clones":0,"num_object_copies":11799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31461,"num_write_kb":251688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'32848","reported_seq":32917,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.784662+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:02.784662+0000","last_peered":"2026-02-24T07:49:02.784662+0000","last_clean":"2026-02-24T07:49:02.784662+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:02.784662+0000","last_undegraded":"2026-02-24T07:49:02.784662+0000","last_fullsized":"2026-02-24T07:49:02.784662+0000","mapping_epoch":29,"log_start":"35'32845","ondisk_log_start":"35'32845","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269090816,"num_objects":4106,"num_object_clones":0,"num_object_copies":12318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32848,"num_write_kb":262784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'31711","reported_seq":31732,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.765330+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:49:02.765330+0000","last_peered":"2026-02-24T07:49:02.765330+0000","last_clean":"2026-02-24T07:49:02.765330+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:02.765330+0000","last_undegraded":"2026-02-24T07:49:02.765330+0000","last_fullsized":"2026-02-24T07:49:02.765330+0000","mapping_epoch":29,"log_start":"35'31708","ondisk_log_start":"35'31708","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259776512,"num_objects":3964,"num_object_clones":0,"num_object_copies":11892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31711,"num_write_kb":253688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'32247","reported_seq":32262,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.795185+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:49:02.795185+0000","last_peered":"2026-02-24T07:49:02.795185+0000","last_clean":"2026-02-24T07:49:02.795185+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:02.795185+0000","last_undegraded":"2026-02-24T07:49:02.795185+0000","last_fullsized":"2026-02-24T07:49:02.795185+0000","mapping_epoch":29,"log_start":"35'32239","ondisk_log_start":"35'32239","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264167424,"num_objects":4031,"num_object_clones":0,"num_object_copies":12093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32247,"num_write_kb":257976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'32480","reported_seq":32548,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.746403+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:02.746403+0000","last_peered":"2026-02-24T07:49:02.746403+0000","last_clean":"2026-02-24T07:49:02.746403+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:02.746403+0000","last_undegraded":"2026-02-24T07:49:02.746403+0000","last_fullsized":"2026-02-24T07:49:02.746403+0000","mapping_epoch":29,"log_start":"35'32472","ondisk_log_start":"35'32472","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266076160,"num_objects":4060,"num_object_clones":0,"num_object_copies":12180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32480,"num_write_kb":259840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'33184","reported_seq":33206,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.760445+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:49:02.760445+0000","last_peered":"2026-02-24T07:49:02.760445+0000","last_clean":"2026-02-24T07:49:02.760445+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:02.760445+0000","last_undegraded":"2026-02-24T07:49:02.760445+0000","last_fullsized":"2026-02-24T07:49:02.760445+0000","mapping_epoch":29,"log_start":"35'33160","ondisk_log_start":"35'33160","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271843328,"num_objects":4148,"num_object_clones":0,"num_object_copies":12444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33184,"num_write_kb":265472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'32896","reported_seq":32918,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.793848+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:49:02.793848+0000","last_peered":"2026-02-24T07:49:02.793848+0000","last_clean":"2026-02-24T07:49:02.793848+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:02.793848+0000","last_undegraded":"2026-02-24T07:49:02.793848+0000","last_fullsized":"2026-02-24T07:49:02.793848+0000","mapping_epoch":29,"log_start":"35'32888","ondisk_log_start":"35'32888","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":4112,"num_object_clones":0,"num_object_copies":12336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32896,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'32864","reported_seq":32886,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.795592+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:49:02.795592+0000","last_peered":"2026-02-24T07:49:02.795592+0000","last_clean":"2026-02-24T07:49:02.795592+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:02.795592+0000","last_undegraded":"2026-02-24T07:49:02.795592+0000","last_fullsized":"2026-02-24T07:49:02.795592+0000","mapping_epoch":29,"log_start":"35'32856","ondisk_log_start":"35'32856","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269221888,"num_objects":4108,"num_object_clones":0,"num_object_copies":12324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32864,"num_write_kb":262912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'31861","reported_seq":31882,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:02.764979+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:02.764979+0000","last_peered":"2026-02-24T07:49:02.764979+0000","last_clean":"2026-02-24T07:49:02.764979+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:02.764979+0000","last_undegraded":"2026-02-24T07:49:02.764979+0000","last_fullsized":"2026-02-24T07:49:02.764979+0000","mapping_epoch":29,"log_start":"35'31858","ondisk_log_start":"35'31858","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261005312,"num_objects":3983,"num_object_clones":0,"num_object_copies":11949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31861,"num_write_kb":254888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4280418304,"num_objects":65315,"num_object_clones":0,"num_object_copies":195945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522512,"num_write_kb":4180096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12838936576,"data_stored":12838936576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215134,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4858044,"kb_used_data":3621864,"kb_used_omap":12,"kb_used_meta":1236147,"kb_avail":729145156,"statfs":{"total":751619276800,"available":746644639744,"internally_reserved":0,"allocated":3708788736,"data_stored":3708577141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12690,"internal_metadata":1265815150},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,33],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3806932,"kb_used_data":2859520,"kb_used_omap":15,"kb_used_meta":947376,"kb_avail":730196268,"statfs":{"total":751619276800,"available":747720978432,"internally_reserved":0,"allocated":2928148480,"data_stored":2927936885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":970113461},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4130584,"kb_used_data":3110980,"kb_used_omap":18,"kb_used_meta":1019565,"kb_avail":729872616,"statfs":{"total":751619276800,"available":747389558784,"internally_reserved":0,"allocated":3185643520,"data_stored":3185435477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1044034814},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,8,14,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3867956,"kb_used_data":2884448,"kb_used_omap":20,"kb_used_meta":983467,"kb_avail":730135244,"statfs":{"total":751619276800,"available":747658489856,"internally_reserved":0,"allocated":2953674752,"data_stored":2953463157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1007070557},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2954559488,"data_stored":2954559488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3215622144,"data_stored":3215622144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2929025024,"data_stored":2929025024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3739729920,"data_stored":3739729920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:06.841 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-24T07:49:06.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 127 555675 555548 63.8214 63.8516 0.0315208 0.0156657 2026-02-24T07:49:06.979 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:07.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:07.106+0000 7ff47072f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:07.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:07.106+0000 7ff47072f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:07.243 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:49:07.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:07.739 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:07.879 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:07.905 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:07 trial016 ceph-mon[39544]: 2.0 scrub starts 2026-02-24T07:49:07.905 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:07 trial016 ceph-mon[39544]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:07.905 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1600169072' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T07:49:07.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 563960 563832 63.8343 64.7188 0.00251727 0.0156627 2026-02-24T07:49:08.003 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:08.000+0000 7f625bbae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:08.003 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:08.001+0000 7f625bbae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:08.017 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:08.018 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:08.039 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:08.039 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:08.052 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:08.052 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:08.070 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:08.071 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:08.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 128 573135 573007 63.9463 71.6797 0.0110828 0.0156347 2026-02-24T07:49:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:08 trial016 ceph-mon[39544]: 2.0 scrub ok 2026-02-24T07:49:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:08 trial016 ceph-mon[39544]: pgmap v80: 17 pgs: 17 active+clean; 4.0 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.97k op/s 2026-02-24T07:49:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3220675154' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:09.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 581559 581431 63.9725 65.8125 0.00324546 0.0156277 2026-02-24T07:49:10.113 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:10.255 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:10.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:10.374+0000 7fb43126f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:10.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:10.374+0000 7fb43126f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:10.393 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:10.393 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:10.419 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:10.419 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:10.433 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:10.434 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:10.453 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:10.454 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:10.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 128 589668 589540 63.9638 63.3516 0.0293201 0.0156302 2026-02-24T07:49:11.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:10 trial016 ceph-mon[39544]: 2.5 scrub starts 2026-02-24T07:49:11.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:10 trial016 ceph-mon[39544]: pgmap v81: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.91k op/s 2026-02-24T07:49:11.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:10 trial016 ceph-mon[39544]: 2.5 scrub ok 2026-02-24T07:49:11.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/42687999' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:11.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 597806 597678 63.9585 63.5781 0.0133763 0.0156296 2026-02-24T07:49:12.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:11 trial016 ceph-mon[39544]: 2.e scrub starts 2026-02-24T07:49:12.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:12.286 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:12.286 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:49:12.286 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:12.422 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:12.494 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:12.736 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:12.851 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:12 trial016 ceph-mon[39544]: pgmap v82: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.54k op/s 2026-02-24T07:49:12.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 604658 604530 63.8175 53.5312 0.0634 0.0156653 2026-02-24T07:49:12.962 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:12.909+0000 7f1595ee2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:12.963 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:12.910+0000 7f1595ee2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:13.050 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:13.050 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:13.690 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2026-02-24T07:49:11.758931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4609253920,"num_objects":70327,"num_object_clones":0,"num_object_copies":210981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70327,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":562716,"num_write_kb":4502798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":17933156,"kb_used_data":13439636,"kb_used_omap":68,"kb_used_meta":4493371,"kb_avail":2918079644,"statfs":{"total":3006477107200,"available":2988113555456,"internally_reserved":0,"allocated":13762187264,"data_stored":13761344436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69645,"internal_metadata":4601212915},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":643031040,"num_objects":9813,"num_object_clones":0,"num_object_copies":29439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78495,"num_write_kb":627960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001562"},"pg_stats":[{"pgid":"2.f","version":"35'35664","reported_seq":35686,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.740737+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:49:07.740737+0000","last_peered":"2026-02-24T07:49:07.740737+0000","last_clean":"2026-02-24T07:49:07.740737+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:07.740737+0000","last_undegraded":"2026-02-24T07:49:07.740737+0000","last_fullsized":"2026-02-24T07:49:07.740737+0000","mapping_epoch":29,"log_start":"35'35659","ondisk_log_start":"35'35659","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292159488,"num_objects":4458,"num_object_clones":0,"num_object_copies":13374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35664,"num_write_kb":285312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'35544","reported_seq":35566,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.750548+0000","last_change":"2026-02-24T07:47:57.848870+0000","last_active":"2026-02-24T07:49:07.750548+0000","last_peered":"2026-02-24T07:49:07.750548+0000","last_clean":"2026-02-24T07:49:07.750548+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:07.750548+0000","last_undegraded":"2026-02-24T07:49:07.750548+0000","last_fullsized":"2026-02-24T07:49:07.750548+0000","mapping_epoch":29,"log_start":"35'35534","ondisk_log_start":"35'35534","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:10.992304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'35512","reported_seq":35585,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.796889+0000","last_change":"2026-02-24T07:49:05.821079+0000","last_active":"2026-02-24T07:49:07.796889+0000","last_peered":"2026-02-24T07:49:07.796889+0000","last_clean":"2026-02-24T07:49:07.796889+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:07.796889+0000","last_undegraded":"2026-02-24T07:49:07.796889+0000","last_fullsized":"2026-02-24T07:49:07.796889+0000","mapping_epoch":29,"log_start":"35'35504","ondisk_log_start":"35'35504","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34578","last_scrub_stamp":"2026-02-24T07:49:05.821006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:05.821006+0000","objects_scrubbed":4289,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:17.365510+0000","scrub_duration":1580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290914304,"num_objects":4439,"num_object_clones":0,"num_object_copies":13317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35512,"num_write_kb":284096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'35529","reported_seq":35542,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.799000+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:49:07.799000+0000","last_peered":"2026-02-24T07:49:07.799000+0000","last_clean":"2026-02-24T07:49:07.799000+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:07.799000+0000","last_undegraded":"2026-02-24T07:49:07.799000+0000","last_fullsized":"2026-02-24T07:49:07.799000+0000","mapping_epoch":29,"log_start":"35'35508","ondisk_log_start":"35'35508","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291053568,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35529,"num_write_kb":284232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":208,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:48:58.396531+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:58.396531+0000","last_peered":"2026-02-24T07:48:58.396531+0000","last_clean":"2026-02-24T07:48:58.396531+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:58.396531+0000","last_undegraded":"2026-02-24T07:48:58.396531+0000","last_fullsized":"2026-02-24T07:48:58.396531+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'35347","reported_seq":35366,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.763439+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:49:07.763439+0000","last_peered":"2026-02-24T07:49:07.763439+0000","last_clean":"2026-02-24T07:49:07.763439+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:07.763439+0000","last_undegraded":"2026-02-24T07:49:07.763439+0000","last_fullsized":"2026-02-24T07:49:07.763439+0000","mapping_epoch":29,"log_start":"35'35342","ondisk_log_start":"35'35342","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289562624,"num_objects":4419,"num_object_clones":0,"num_object_copies":13257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35347,"num_write_kb":282776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'35279","reported_seq":35347,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.766753+0000","last_change":"2026-02-24T07:49:07.647295+0000","last_active":"2026-02-24T07:49:07.766753+0000","last_peered":"2026-02-24T07:49:07.766753+0000","last_clean":"2026-02-24T07:49:07.766753+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:07.766753+0000","last_undegraded":"2026-02-24T07:49:07.766753+0000","last_fullsized":"2026-02-24T07:49:07.766753+0000","mapping_epoch":29,"log_start":"35'35267","ondisk_log_start":"35'35267","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35192","last_scrub_stamp":"2026-02-24T07:49:07.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:07.647256+0000","objects_scrubbed":4360,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:14.060702+0000","scrub_duration":1380,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289005568,"num_objects":4410,"num_object_clones":0,"num_object_copies":13230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35279,"num_write_kb":282232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'35544","reported_seq":35566,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.797825+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:49:07.797825+0000","last_peered":"2026-02-24T07:49:07.797825+0000","last_clean":"2026-02-24T07:49:07.797825+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:07.797825+0000","last_undegraded":"2026-02-24T07:49:07.797825+0000","last_fullsized":"2026-02-24T07:49:07.797825+0000","mapping_epoch":29,"log_start":"35'35512","ondisk_log_start":"35'35512","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:11.743393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'33920","reported_seq":33942,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.762455+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:49:07.762455+0000","last_peered":"2026-02-24T07:49:07.762455+0000","last_clean":"2026-02-24T07:49:07.762455+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:07.762455+0000","last_undegraded":"2026-02-24T07:49:07.762455+0000","last_fullsized":"2026-02-24T07:49:07.762455+0000","mapping_epoch":29,"log_start":"35'33912","ondisk_log_start":"35'33912","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":4240,"num_object_clones":0,"num_object_copies":12720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33920,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'35136","reported_seq":35205,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.763562+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:07.763562+0000","last_peered":"2026-02-24T07:49:07.763562+0000","last_clean":"2026-02-24T07:49:07.763562+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:07.763562+0000","last_undegraded":"2026-02-24T07:49:07.763562+0000","last_fullsized":"2026-02-24T07:49:07.763562+0000","mapping_epoch":29,"log_start":"35'35133","ondisk_log_start":"35'35133","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287834112,"num_objects":4392,"num_object_clones":0,"num_object_copies":13176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35136,"num_write_kb":281088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'34378","reported_seq":34398,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.760115+0000","last_change":"2026-02-24T07:47:57.847799+0000","last_active":"2026-02-24T07:49:07.760115+0000","last_peered":"2026-02-24T07:49:07.760115+0000","last_clean":"2026-02-24T07:49:07.760115+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:07.760115+0000","last_undegraded":"2026-02-24T07:49:07.760115+0000","last_fullsized":"2026-02-24T07:49:07.760115+0000","mapping_epoch":29,"log_start":"35'34370","ondisk_log_start":"35'34370","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:08.651181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281624576,"num_objects":4298,"num_object_clones":0,"num_object_copies":12894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34378,"num_write_kb":275024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'34840","reported_seq":34862,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.794912+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:49:07.794912+0000","last_peered":"2026-02-24T07:49:07.794912+0000","last_clean":"2026-02-24T07:49:07.794912+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:07.794912+0000","last_undegraded":"2026-02-24T07:49:07.794912+0000","last_fullsized":"2026-02-24T07:49:07.794912+0000","mapping_epoch":29,"log_start":"35'34824","ondisk_log_start":"35'34824","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285409280,"num_objects":4355,"num_object_clones":0,"num_object_copies":13065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34840,"num_write_kb":278720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'34800","reported_seq":34868,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.761228+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:07.761228+0000","last_peered":"2026-02-24T07:49:07.761228+0000","last_clean":"2026-02-24T07:49:07.761228+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:07.761228+0000","last_undegraded":"2026-02-24T07:49:07.761228+0000","last_fullsized":"2026-02-24T07:49:07.761228+0000","mapping_epoch":29,"log_start":"35'34792","ondisk_log_start":"35'34792","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285081600,"num_objects":4350,"num_object_clones":0,"num_object_copies":13050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34800,"num_write_kb":278400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'35832","reported_seq":35854,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.735824+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:49:07.735824+0000","last_peered":"2026-02-24T07:49:07.735824+0000","last_clean":"2026-02-24T07:49:07.735824+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:07.735824+0000","last_undegraded":"2026-02-24T07:49:07.735824+0000","last_fullsized":"2026-02-24T07:49:07.735824+0000","mapping_epoch":29,"log_start":"35'35824","ondisk_log_start":"35'35824","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293535744,"num_objects":4479,"num_object_clones":0,"num_object_copies":13437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35832,"num_write_kb":286656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'35544","reported_seq":35566,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.773424+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:49:07.773424+0000","last_peered":"2026-02-24T07:49:07.773424+0000","last_clean":"2026-02-24T07:49:07.773424+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:07.773424+0000","last_undegraded":"2026-02-24T07:49:07.773424+0000","last_fullsized":"2026-02-24T07:49:07.773424+0000","mapping_epoch":29,"log_start":"35'35528","ondisk_log_start":"35'35528","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'35224","reported_seq":35246,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.794572+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:49:07.794572+0000","last_peered":"2026-02-24T07:49:07.794572+0000","last_clean":"2026-02-24T07:49:07.794572+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:07.794572+0000","last_undegraded":"2026-02-24T07:49:07.794572+0000","last_fullsized":"2026-02-24T07:49:07.794572+0000","mapping_epoch":29,"log_start":"35'35216","ondisk_log_start":"35'35216","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288555008,"num_objects":4403,"num_object_clones":0,"num_object_copies":13209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35224,"num_write_kb":281792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'34488","reported_seq":34506,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:07.760755+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:07.760755+0000","last_peered":"2026-02-24T07:49:07.760755+0000","last_clean":"2026-02-24T07:49:07.760755+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:07.760755+0000","last_undegraded":"2026-02-24T07:49:07.760755+0000","last_fullsized":"2026-02-24T07:49:07.760755+0000","mapping_epoch":29,"log_start":"35'34481","ondisk_log_start":"35'34481","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282525696,"num_objects":4311,"num_object_clones":0,"num_object_copies":12933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34488,"num_write_kb":275904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4608663552,"num_objects":70325,"num_object_clones":0,"num_object_copies":210975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562581,"num_write_kb":4500648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13824008192,"data_stored":13824008192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215135,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5229540,"kb_used_data":3903120,"kb_used_omap":12,"kb_used_meta":1326387,"kb_avail":728773660,"statfs":{"total":751619276800,"available":746264227840,"internally_reserved":0,"allocated":3996794880,"data_stored":3996583285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12690,"internal_metadata":1358220910},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444064,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4114148,"kb_used_data":3076496,"kb_used_omap":16,"kb_used_meta":1037615,"kb_avail":729889052,"statfs":{"total":751619276800,"available":747406389248,"internally_reserved":0,"allocated":3150331904,"data_stored":3150120309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":1062518570},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4428648,"kb_used_data":3354900,"kb_used_omap":18,"kb_used_meta":1073709,"kb_avail":729574552,"statfs":{"total":751619276800,"available":747084341248,"internally_reserved":0,"allocated":3435417600,"data_stored":3435209557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1099478270},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4160820,"kb_used_data":3105120,"kb_used_omap":20,"kb_used_meta":1055659,"kb_avail":729842380,"statfs":{"total":751619276800,"available":747358597120,"internally_reserved":0,"allocated":3179642880,"data_stored":3179431285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1080995165},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3180716032,"data_stored":3180716032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3459497984,"data_stored":3459497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3154755584,"data_stored":3154755584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4029038592,"data_stored":4029038592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:13.693 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:49:13.693 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 41 2026-02-24T07:49:13.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:13.803+0000 7f1555871640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:13.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:13.803+0000 7f1555871640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:13.826 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:13.826 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:13.843 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:13.848 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:13.848 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:13.861 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:13.861 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:13.876 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:13.876 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:13.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 611554 611426 63.6846 53.875 0.00159491 0.0156995 2026-02-24T07:49:13.962 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:13.959+0000 7f8f38c68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:13.962 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:13.960+0000 7f8f38c68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:14.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:13 trial016 ceph-mon[39544]: 2.e scrub ok 2026-02-24T07:49:14.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3837867307' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:14.101 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:49:14.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:14.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 619885 619757 63.703 65.0859 0.0044371 0.0156948 2026-02-24T07:49:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:14 trial016 ceph-mon[39544]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:14 trial016 ceph-mon[39544]: pgmap v83: 17 pgs: 17 active+clean; 4.6 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 9.97k op/s 2026-02-24T07:49:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3805735166' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "41"} : dispatch 2026-02-24T07:49:15.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:15.923 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:15.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 128 628312 628184 63.7306 65.8359 0.0136875 0.0156879 2026-02-24T07:49:16.060 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:16.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:15 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:49:16.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:15 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:49:16.182 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:16.180+0000 7f46641ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:16.183 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:16.180+0000 7f46641ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:16.196 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:16.197 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:16.224 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:16.224 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:16.237 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:16.238 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:16.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:16.262 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:16.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 127 637099 636972 63.7937 68.6562 0.0216075 0.0156724 2026-02-24T07:49:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:16 trial016 ceph-mon[39544]: pgmap v84: 17 pgs: 17 active+clean; 4.6 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.76k op/s 2026-02-24T07:49:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1426397418' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:17.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 128 645192 645064 63.7864 63.2188 0.00670092 0.0156751 2026-02-24T07:49:18.308 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:17 trial016 ceph-mon[39544]: 2.3 scrub starts 2026-02-24T07:49:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:17 trial016 ceph-mon[39544]: 2.1 scrub starts 2026-02-24T07:49:18.452 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:18.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:18.580+0000 7fc605a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:18.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:18.580+0000 7fc605a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:18.601 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:18.602 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:18.614 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:18.614 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:18.629 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:18.629 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:18.643 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:18.644 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:18.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:49:18.945642+0000 min lat: 0.000616464 max lat: 0.0957385 avg lat: 0.0156619 2026-02-24T07:49:18.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:49:18.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 653904 653776 63.8398 68.0625 0.00902426 0.0156619 2026-02-24T07:49:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:18 trial016 ceph-mon[39544]: 2.3 scrub ok 2026-02-24T07:49:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:18 trial016 ceph-mon[39544]: pgmap v85: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.97k op/s 2026-02-24T07:49:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1235619668' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:19.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:19.145 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:19.145 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:49:19.145 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:19.286 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:19.410 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:19.408+0000 7f36aa74b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:19.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:19.408+0000 7f36aa74b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:19.553 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:19.553 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:19.597 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-24T07:49:17.759701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4966449696,"num_objects":75776,"num_object_clones":0,"num_object_copies":227328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75776,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":606319,"num_write_kb":4851622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19792444,"kb_used_data":14873124,"kb_used_omap":68,"kb_used_meta":4919163,"kb_avail":2916220356,"statfs":{"total":3006477107200,"available":2986209644544,"internally_reserved":0,"allocated":15230078976,"data_stored":15229236148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69645,"internal_metadata":5037223923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,2,19,41,14,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":685441024,"num_objects":10459,"num_object_clones":0,"num_object_copies":31377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83672,"num_write_kb":669376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001596"},"pg_stats":[{"pgid":"2.f","version":"35'40872","reported_seq":40894,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:17.716263+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:49:17.716263+0000","last_peered":"2026-02-24T07:49:17.716263+0000","last_clean":"2026-02-24T07:49:17.716263+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:17.716263+0000","last_undegraded":"2026-02-24T07:49:17.716263+0000","last_fullsized":"2026-02-24T07:49:17.716263+0000","mapping_epoch":29,"log_start":"35'40865","ondisk_log_start":"35'40865","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:22.099517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334823424,"num_objects":5109,"num_object_clones":0,"num_object_copies":15327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40872,"num_write_kb":326976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'38368","reported_seq":38443,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.774340+0000","last_change":"2026-02-24T07:49:12.376119+0000","last_active":"2026-02-24T07:49:12.774340+0000","last_peered":"2026-02-24T07:49:12.774340+0000","last_clean":"2026-02-24T07:49:12.774340+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:12.774340+0000","last_undegraded":"2026-02-24T07:49:12.774340+0000","last_fullsized":"2026-02-24T07:49:12.774340+0000","mapping_epoch":29,"log_start":"35'38360","ondisk_log_start":"35'38360","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38184","last_scrub_stamp":"2026-02-24T07:49:12.376026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:12.376026+0000","objects_scrubbed":4730,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:20.961514+0000","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314310656,"num_objects":4796,"num_object_clones":0,"num_object_copies":14388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38368,"num_write_kb":306944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'38293","reported_seq":38357,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.784258+0000","last_change":"2026-02-24T07:49:05.821079+0000","last_active":"2026-02-24T07:49:12.784258+0000","last_peered":"2026-02-24T07:49:12.784258+0000","last_clean":"2026-02-24T07:49:12.784258+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:12.784258+0000","last_undegraded":"2026-02-24T07:49:12.784258+0000","last_fullsized":"2026-02-24T07:49:12.784258+0000","mapping_epoch":29,"log_start":"35'38283","ondisk_log_start":"35'38283","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34578","last_scrub_stamp":"2026-02-24T07:49:05.821006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:05.821006+0000","objects_scrubbed":4289,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:17.365510+0000","scrub_duration":1580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313696256,"num_objects":4787,"num_object_clones":0,"num_object_copies":14361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38293,"num_write_kb":306344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'38328","reported_seq":38350,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.778054+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:49:12.778054+0000","last_peered":"2026-02-24T07:49:12.778054+0000","last_clean":"2026-02-24T07:49:12.778054+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:12.778054+0000","last_undegraded":"2026-02-24T07:49:12.778054+0000","last_fullsized":"2026-02-24T07:49:12.778054+0000","mapping_epoch":29,"log_start":"35'38320","ondisk_log_start":"35'38320","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313982976,"num_objects":4791,"num_object_clones":0,"num_object_copies":14373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38328,"num_write_kb":306624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":208,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:48:58.396531+0000","last_change":"2026-02-24T07:47:56.540560+0000","last_active":"2026-02-24T07:48:58.396531+0000","last_peered":"2026-02-24T07:48:58.396531+0000","last_clean":"2026-02-24T07:48:58.396531+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:48:58.396531+0000","last_undegraded":"2026-02-24T07:48:58.396531+0000","last_fullsized":"2026-02-24T07:48:58.396531+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:47:56.540523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.540523+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:14.174930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'37963","reported_seq":37982,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.767469+0000","last_change":"2026-02-24T07:47:57.850114+0000","last_active":"2026-02-24T07:49:12.767469+0000","last_peered":"2026-02-24T07:49:12.767469+0000","last_clean":"2026-02-24T07:49:12.767469+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:12.767469+0000","last_undegraded":"2026-02-24T07:49:12.767469+0000","last_fullsized":"2026-02-24T07:49:12.767469+0000","mapping_epoch":29,"log_start":"35'37956","ondisk_log_start":"35'37956","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:16.251495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310992896,"num_objects":4746,"num_object_clones":0,"num_object_copies":14238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37963,"num_write_kb":303704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'37880","reported_seq":37955,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.769216+0000","last_change":"2026-02-24T07:49:07.647295+0000","last_active":"2026-02-24T07:49:12.769216+0000","last_peered":"2026-02-24T07:49:12.769216+0000","last_clean":"2026-02-24T07:49:12.769216+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:12.769216+0000","last_undegraded":"2026-02-24T07:49:12.769216+0000","last_fullsized":"2026-02-24T07:49:12.769216+0000","mapping_epoch":29,"log_start":"35'37872","ondisk_log_start":"35'37872","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35192","last_scrub_stamp":"2026-02-24T07:49:07.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:07.647256+0000","objects_scrubbed":4360,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:14.060702+0000","scrub_duration":1380,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":4735,"num_object_clones":0,"num_object_copies":14205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37880,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'37928","reported_seq":37950,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.782467+0000","last_change":"2026-02-24T07:47:57.848396+0000","last_active":"2026-02-24T07:49:12.782467+0000","last_peered":"2026-02-24T07:49:12.782467+0000","last_clean":"2026-02-24T07:49:12.782467+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:12.782467+0000","last_undegraded":"2026-02-24T07:49:12.782467+0000","last_fullsized":"2026-02-24T07:49:12.782467+0000","mapping_epoch":29,"log_start":"35'37896","ondisk_log_start":"35'37896","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310706176,"num_objects":4741,"num_object_clones":0,"num_object_copies":14223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37928,"num_write_kb":303424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'36488","reported_seq":36510,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.740722+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:49:12.740722+0000","last_peered":"2026-02-24T07:49:12.740722+0000","last_clean":"2026-02-24T07:49:12.740722+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:12.740722+0000","last_undegraded":"2026-02-24T07:49:12.740722+0000","last_fullsized":"2026-02-24T07:49:12.740722+0000","mapping_epoch":29,"log_start":"35'36472","ondisk_log_start":"35'36472","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":4561,"num_object_clones":0,"num_object_copies":13683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36488,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'37552","reported_seq":37614,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.774308+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:12.774308+0000","last_peered":"2026-02-24T07:49:12.774308+0000","last_clean":"2026-02-24T07:49:12.774308+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:12.774308+0000","last_undegraded":"2026-02-24T07:49:12.774308+0000","last_fullsized":"2026-02-24T07:49:12.774308+0000","mapping_epoch":29,"log_start":"35'37536","ondisk_log_start":"35'37536","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307625984,"num_objects":4694,"num_object_clones":0,"num_object_copies":14082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37552,"num_write_kb":300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'36840","reported_seq":36914,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.760243+0000","last_change":"2026-02-24T07:49:09.895808+0000","last_active":"2026-02-24T07:49:12.760243+0000","last_peered":"2026-02-24T07:49:12.760243+0000","last_clean":"2026-02-24T07:49:12.760243+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:12.760243+0000","last_undegraded":"2026-02-24T07:49:12.760243+0000","last_fullsized":"2026-02-24T07:49:12.760243+0000","mapping_epoch":29,"log_start":"35'36836","ondisk_log_start":"35'36836","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35584","last_scrub_stamp":"2026-02-24T07:49:09.895762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:09.895762+0000","objects_scrubbed":4429,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:15.168040+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301793280,"num_objects":4605,"num_object_clones":0,"num_object_copies":13815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36840,"num_write_kb":294720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'37296","reported_seq":37318,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.781854+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:49:12.781854+0000","last_peered":"2026-02-24T07:49:12.781854+0000","last_clean":"2026-02-24T07:49:12.781854+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:12.781854+0000","last_undegraded":"2026-02-24T07:49:12.781854+0000","last_fullsized":"2026-02-24T07:49:12.781854+0000","mapping_epoch":29,"log_start":"35'37272","ondisk_log_start":"35'37272","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:19.092927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305528832,"num_objects":4662,"num_object_clones":0,"num_object_copies":13986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37296,"num_write_kb":298368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'37216","reported_seq":37284,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.768784+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:12.768784+0000","last_peered":"2026-02-24T07:49:12.768784+0000","last_clean":"2026-02-24T07:49:12.768784+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:12.768784+0000","last_undegraded":"2026-02-24T07:49:12.768784+0000","last_fullsized":"2026-02-24T07:49:12.768784+0000","mapping_epoch":29,"log_start":"35'37184","ondisk_log_start":"35'37184","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304873472,"num_objects":4652,"num_object_clones":0,"num_object_copies":13956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37216,"num_write_kb":297728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'38328","reported_seq":38350,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.756590+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:49:12.756590+0000","last_peered":"2026-02-24T07:49:12.756590+0000","last_clean":"2026-02-24T07:49:12.756590+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:12.756590+0000","last_undegraded":"2026-02-24T07:49:12.756590+0000","last_fullsized":"2026-02-24T07:49:12.756590+0000","mapping_epoch":29,"log_start":"35'38312","ondisk_log_start":"35'38312","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:20.296524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313982976,"num_objects":4791,"num_object_clones":0,"num_object_copies":14373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38328,"num_write_kb":306624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'38304","reported_seq":38326,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.755964+0000","last_change":"2026-02-24T07:47:57.850719+0000","last_active":"2026-02-24T07:49:12.755964+0000","last_peered":"2026-02-24T07:49:12.755964+0000","last_clean":"2026-02-24T07:49:12.755964+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:12.755964+0000","last_undegraded":"2026-02-24T07:49:12.755964+0000","last_fullsized":"2026-02-24T07:49:12.755964+0000","mapping_epoch":29,"log_start":"35'38280","ondisk_log_start":"35'38280","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:13.951606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313786368,"num_objects":4788,"num_object_clones":0,"num_object_copies":14364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38304,"num_write_kb":306432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'37704","reported_seq":37726,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.782234+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:49:12.782234+0000","last_peered":"2026-02-24T07:49:12.782234+0000","last_clean":"2026-02-24T07:49:12.782234+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:12.782234+0000","last_undegraded":"2026-02-24T07:49:12.782234+0000","last_fullsized":"2026-02-24T07:49:12.782234+0000","mapping_epoch":29,"log_start":"35'37688","ondisk_log_start":"35'37688","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:17.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308871168,"num_objects":4713,"num_object_clones":0,"num_object_copies":14139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37704,"num_write_kb":301632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'36824","reported_seq":36846,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:12.760671+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:12.760671+0000","last_peered":"2026-02-24T07:49:12.760671+0000","last_clean":"2026-02-24T07:49:12.760671+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:12.760671+0000","last_undegraded":"2026-02-24T07:49:12.760671+0000","last_fullsized":"2026-02-24T07:49:12.760671+0000","mapping_epoch":29,"log_start":"35'36819","ondisk_log_start":"35'36819","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301662208,"num_objects":4603,"num_object_clones":0,"num_object_copies":13809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36824,"num_write_kb":294592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4965859328,"num_objects":75774,"num_object_clones":0,"num_object_copies":227322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606184,"num_write_kb":4849472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15283322880,"data_stored":15283322880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215136,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5611348,"kb_used_data":4202048,"kb_used_omap":12,"kb_used_meta":1409267,"kb_avail":728391852,"statfs":{"total":751619276800,"available":745873256448,"internally_reserved":0,"allocated":4302897152,"data_stored":4302685557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12690,"internal_metadata":1443090030},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,9,6,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444066,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4697524,"kb_used_data":3515488,"kb_used_omap":16,"kb_used_meta":1181999,"kb_avail":729305676,"statfs":{"total":751619276800,"available":746809012224,"internally_reserved":0,"allocated":3599859712,"data_stored":3599648117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":1210367786},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4752352,"kb_used_data":3606404,"kb_used_omap":18,"kb_used_meta":1145901,"kb_avail":729250848,"statfs":{"total":751619276800,"available":746752868352,"internally_reserved":0,"allocated":3692957696,"data_stored":3692749653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1173402878},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,10,35,13],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4731220,"kb_used_data":3549184,"kb_used_omap":20,"kb_used_meta":1181995,"kb_avail":729271980,"statfs":{"total":751619276800,"available":746774507520,"internally_reserved":0,"allocated":3634364416,"data_stored":3634152821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1210363229},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3639869440,"data_stored":3639869440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3714277376,"data_stored":3714277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3606175744,"data_stored":3606175744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4323000320,"data_stored":4323000320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:19.599 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:49:19.599 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 51 2026-02-24T07:49:19.738 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:19.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:19.864+0000 7fd8918c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:19.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:19.865+0000 7fd8918c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:19.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 127 662269 662142 63.8585 65.3594 0.0125732 0.0156569 2026-02-24T07:49:19.999 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:49:20.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:20.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:19 trial016 ceph-mon[39544]: 2.1 scrub ok 2026-02-24T07:49:20.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:19 trial016 ceph-mon[39544]: 2.9 scrub starts 2026-02-24T07:49:20.690 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:20.831 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:20.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 670516 670388 63.8653 64.4219 0.00268406 0.0156549 2026-02-24T07:49:20.956 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:20.954+0000 7f804681f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:20.956 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:20.954+0000 7f804681f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:20.971 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:20.971 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:20.971 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:20 trial016 ceph-mon[39544]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:20.972 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:20 trial016 ceph-mon[39544]: pgmap v86: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 9.92k op/s 2026-02-24T07:49:20.972 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3204276506' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "51"} : dispatch 2026-02-24T07:49:20.984 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:20.984 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:20.998 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:20.998 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:21.017 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:21.017 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:21.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 127 678715 678588 63.8676 64.0625 0.0168477 0.0156542 2026-02-24T07:49:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/799949963' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:21 trial016 ceph-mon[39544]: 2.9 scrub ok 2026-02-24T07:49:22.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 128 686729 686601 63.8525 62.6016 0.0043059 0.0156587 2026-02-24T07:49:23.059 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:23.084 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:22 trial016 ceph-mon[39544]: pgmap v87: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.78k op/s 2026-02-24T07:49:23.203 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:23.322 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:23.320+0000 7f4fa4360640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:23.322 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:23.320+0000 7f4fa4360640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:23.336 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:23.337 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:23.353 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:23.353 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:23.368 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:23.368 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:23.380 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:23.381 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:23.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 694640 694512 63.8283 61.8047 0.00880403 0.0156637 2026-02-24T07:49:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:23 trial016 ceph-mon[39544]: 2.a scrub starts 2026-02-24T07:49:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/610136389' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:24.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 128 702576 702448 63.807 62 0.0065599 0.0156694 2026-02-24T07:49:25.043 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:25.043 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:25.043 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T07:49:25.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:25.186 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:25.212 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:24 trial016 ceph-mon[39544]: 2.f scrub starts 2026-02-24T07:49:25.212 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:24 trial016 ceph-mon[39544]: pgmap v88: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 80 MiB/s wr, 10.23k op/s 2026-02-24T07:49:25.212 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:24 trial016 ceph-mon[39544]: 2.f scrub ok 2026-02-24T07:49:25.212 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:25.310 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.308+0000 7ff9c432f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.310 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.308+0000 7ff9c432f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.423 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:25.451 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:25.451 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:25.498 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2026-02-24T07:49:23.760460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5615313440,"num_objects":85677,"num_object_clones":0,"num_object_copies":257031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85677,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":685526,"num_write_kb":5485278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21900348,"kb_used_data":16388524,"kb_used_omap":68,"kb_used_meta":5511675,"kb_avail":2914112452,"statfs":{"total":3006477107200,"available":2984051150848,"internally_reserved":0,"allocated":16781848576,"data_stored":16781005748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69738,"internal_metadata":5643956118},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,5,20,45],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006059520,"num_objects":15350,"num_object_clones":0,"num_object_copies":46050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122810,"num_write_kb":982480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001529"},"pg_stats":[{"pgid":"2.f","version":"35'43328","reported_seq":43350,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.694005+0000","last_change":"2026-02-24T07:47:57.849223+0000","last_active":"2026-02-24T07:49:22.694005+0000","last_peered":"2026-02-24T07:49:22.694005+0000","last_clean":"2026-02-24T07:49:22.694005+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:22.694005+0000","last_undegraded":"2026-02-24T07:49:22.694005+0000","last_fullsized":"2026-02-24T07:49:22.694005+0000","mapping_epoch":29,"log_start":"35'43323","ondisk_log_start":"35'43323","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354942976,"num_objects":5416,"num_object_clones":0,"num_object_copies":16248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43328,"num_write_kb":346624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'43280","reported_seq":43357,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.814754+0000","last_change":"2026-02-24T07:49:12.376119+0000","last_active":"2026-02-24T07:49:22.814754+0000","last_peered":"2026-02-24T07:49:22.814754+0000","last_clean":"2026-02-24T07:49:22.814754+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:22.814754+0000","last_undegraded":"2026-02-24T07:49:22.814754+0000","last_fullsized":"2026-02-24T07:49:22.814754+0000","mapping_epoch":29,"log_start":"35'43272","ondisk_log_start":"35'43272","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38184","last_scrub_stamp":"2026-02-24T07:49:12.376026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:12.376026+0000","objects_scrubbed":4730,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:20.961514+0000","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354549760,"num_objects":5410,"num_object_clones":0,"num_object_copies":16230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43280,"num_write_kb":346240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'43536","reported_seq":43609,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.794731+0000","last_change":"2026-02-24T07:49:05.821079+0000","last_active":"2026-02-24T07:49:22.794731+0000","last_peered":"2026-02-24T07:49:22.794731+0000","last_clean":"2026-02-24T07:49:22.794731+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:22.794731+0000","last_undegraded":"2026-02-24T07:49:22.794731+0000","last_fullsized":"2026-02-24T07:49:22.794731+0000","mapping_epoch":29,"log_start":"35'43520","ondisk_log_start":"35'43520","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34578","last_scrub_stamp":"2026-02-24T07:49:05.821006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:05.821006+0000","objects_scrubbed":4289,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:17.365510+0000","scrub_duration":1580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356646912,"num_objects":5442,"num_object_clones":0,"num_object_copies":16326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43536,"num_write_kb":348288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'43536","reported_seq":43538,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.819625+0000","last_change":"2026-02-24T07:47:57.850971+0000","last_active":"2026-02-24T07:49:22.819625+0000","last_peered":"2026-02-24T07:49:22.819625+0000","last_clean":"2026-02-24T07:49:22.819625+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:22.819625+0000","last_undegraded":"2026-02-24T07:49:22.819625+0000","last_fullsized":"2026-02-24T07:49:22.819625+0000","mapping_epoch":29,"log_start":"35'43512","ondisk_log_start":"35'43512","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:24.627492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356646912,"num_objects":5442,"num_object_clones":0,"num_object_copies":16326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43536,"num_write_kb":348288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:14.372043+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:14.372043+0000","last_peered":"2026-02-24T07:49:14.372043+0000","last_clean":"2026-02-24T07:49:14.372043+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:14.372043+0000","last_undegraded":"2026-02-24T07:49:14.372043+0000","last_fullsized":"2026-02-24T07:49:14.372043+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'42912","reported_seq":42993,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.748123+0000","last_change":"2026-02-24T07:49:17.730491+0000","last_active":"2026-02-24T07:49:22.748123+0000","last_peered":"2026-02-24T07:49:22.748123+0000","last_clean":"2026-02-24T07:49:22.748123+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:22.748123+0000","last_undegraded":"2026-02-24T07:49:22.748123+0000","last_fullsized":"2026-02-24T07:49:22.748123+0000","mapping_epoch":29,"log_start":"35'42904","ondisk_log_start":"35'42904","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40400","last_scrub_stamp":"2026-02-24T07:49:17.730449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:17.730449+0000","objects_scrubbed":5009,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:19.724025+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351535104,"num_objects":5364,"num_object_clones":0,"num_object_copies":16092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42912,"num_write_kb":343296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'43008","reported_seq":43083,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.751001+0000","last_change":"2026-02-24T07:49:07.647295+0000","last_active":"2026-02-24T07:49:22.751001+0000","last_peered":"2026-02-24T07:49:22.751001+0000","last_clean":"2026-02-24T07:49:22.751001+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:22.751001+0000","last_undegraded":"2026-02-24T07:49:22.751001+0000","last_fullsized":"2026-02-24T07:49:22.751001+0000","mapping_epoch":29,"log_start":"35'43000","ondisk_log_start":"35'43000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35192","last_scrub_stamp":"2026-02-24T07:49:07.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:07.647256+0000","objects_scrubbed":4360,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:14.060702+0000","scrub_duration":1380,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":5376,"num_object_clones":0,"num_object_copies":16128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43008,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'43016","reported_seq":43076,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.796080+0000","last_change":"2026-02-24T07:49:18.906378+0000","last_active":"2026-02-24T07:49:22.796080+0000","last_peered":"2026-02-24T07:49:22.796080+0000","last_clean":"2026-02-24T07:49:22.796080+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:22.796080+0000","last_undegraded":"2026-02-24T07:49:22.796080+0000","last_fullsized":"2026-02-24T07:49:22.796080+0000","mapping_epoch":29,"log_start":"35'42992","ondisk_log_start":"35'42992","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41116","last_scrub_stamp":"2026-02-24T07:49:18.906324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:18.906324+0000","objects_scrubbed":5091,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.829361+0000","scrub_duration":1712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352387072,"num_objects":5377,"num_object_clones":0,"num_object_copies":16131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43016,"num_write_kb":344128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'41928","reported_seq":41939,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.753573+0000","last_change":"2026-02-24T07:47:57.850120+0000","last_active":"2026-02-24T07:49:22.753573+0000","last_peered":"2026-02-24T07:49:22.753573+0000","last_clean":"2026-02-24T07:49:22.753573+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:22.753573+0000","last_undegraded":"2026-02-24T07:49:22.753573+0000","last_fullsized":"2026-02-24T07:49:22.753573+0000","mapping_epoch":29,"log_start":"35'41916","ondisk_log_start":"35'41916","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:23.514654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343474176,"num_objects":5241,"num_object_clones":0,"num_object_copies":15723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41928,"num_write_kb":335424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'42680","reported_seq":42749,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.784164+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:22.784164+0000","last_peered":"2026-02-24T07:49:22.784164+0000","last_clean":"2026-02-24T07:49:22.784164+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:22.784164+0000","last_undegraded":"2026-02-24T07:49:22.784164+0000","last_fullsized":"2026-02-24T07:49:22.784164+0000","mapping_epoch":29,"log_start":"35'42672","ondisk_log_start":"35'42672","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349634560,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42680,"num_write_kb":341440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'41942","reported_seq":42014,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.771707+0000","last_change":"2026-02-24T07:49:09.895808+0000","last_active":"2026-02-24T07:49:22.771707+0000","last_peered":"2026-02-24T07:49:22.771707+0000","last_clean":"2026-02-24T07:49:22.771707+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:22.771707+0000","last_undegraded":"2026-02-24T07:49:22.771707+0000","last_fullsized":"2026-02-24T07:49:22.771707+0000","mapping_epoch":29,"log_start":"35'41937","ondisk_log_start":"35'41937","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35584","last_scrub_stamp":"2026-02-24T07:49:09.895762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:09.895762+0000","objects_scrubbed":4429,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:15.168040+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343588864,"num_objects":5243,"num_object_clones":0,"num_object_copies":15729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41942,"num_write_kb":335536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'42496","reported_seq":42518,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.763392+0000","last_change":"2026-02-24T07:47:57.851415+0000","last_active":"2026-02-24T07:49:22.763392+0000","last_peered":"2026-02-24T07:49:22.763392+0000","last_clean":"2026-02-24T07:49:22.763392+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:22.763392+0000","last_undegraded":"2026-02-24T07:49:22.763392+0000","last_fullsized":"2026-02-24T07:49:22.763392+0000","mapping_epoch":29,"log_start":"35'42488","ondisk_log_start":"35'42488","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":5312,"num_object_clones":0,"num_object_copies":15936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42496,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'42618","reported_seq":42684,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.752827+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:22.752827+0000","last_peered":"2026-02-24T07:49:22.752827+0000","last_clean":"2026-02-24T07:49:22.752827+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:22.752827+0000","last_undegraded":"2026-02-24T07:49:22.752827+0000","last_fullsized":"2026-02-24T07:49:22.752827+0000","mapping_epoch":29,"log_start":"35'42608","ondisk_log_start":"35'42608","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349126656,"num_objects":5328,"num_object_clones":0,"num_object_copies":15984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42618,"num_write_kb":340944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'43216","reported_seq":43238,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.764856+0000","last_change":"2026-02-24T07:47:57.848046+0000","last_active":"2026-02-24T07:49:22.764856+0000","last_peered":"2026-02-24T07:49:22.764856+0000","last_clean":"2026-02-24T07:49:22.764856+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:22.764856+0000","last_undegraded":"2026-02-24T07:49:22.764856+0000","last_fullsized":"2026-02-24T07:49:22.764856+0000","mapping_epoch":29,"log_start":"35'43208","ondisk_log_start":"35'43208","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354025472,"num_objects":5402,"num_object_clones":0,"num_object_copies":16206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43216,"num_write_kb":345728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'43376","reported_seq":43460,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.798979+0000","last_change":"2026-02-24T07:49:21.037080+0000","last_active":"2026-02-24T07:49:22.798979+0000","last_peered":"2026-02-24T07:49:22.798979+0000","last_clean":"2026-02-24T07:49:22.798979+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:22.798979+0000","last_undegraded":"2026-02-24T07:49:22.798979+0000","last_fullsized":"2026-02-24T07:49:22.798979+0000","mapping_epoch":29,"log_start":"35'43356","ondisk_log_start":"35'43356","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'42496","last_scrub_stamp":"2026-02-24T07:49:21.037008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:21.037008+0000","objects_scrubbed":5255,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.516583+0000","scrub_duration":1878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355336192,"num_objects":5422,"num_object_clones":0,"num_object_copies":16266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43376,"num_write_kb":347008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'42736","reported_seq":42742,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.819392+0000","last_change":"2026-02-24T07:47:57.851367+0000","last_active":"2026-02-24T07:49:22.819392+0000","last_peered":"2026-02-24T07:49:22.819392+0000","last_clean":"2026-02-24T07:49:22.819392+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:22.819392+0000","last_undegraded":"2026-02-24T07:49:22.819392+0000","last_fullsized":"2026-02-24T07:49:22.819392+0000","mapping_epoch":29,"log_start":"35'42716","ondisk_log_start":"35'42716","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350093312,"num_objects":5342,"num_object_clones":0,"num_object_copies":16026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42736,"num_write_kb":341888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'41783","reported_seq":41803,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:22.771689+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:22.771689+0000","last_peered":"2026-02-24T07:49:22.771689+0000","last_clean":"2026-02-24T07:49:22.771689+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:22.771689+0000","last_undegraded":"2026-02-24T07:49:22.771689+0000","last_fullsized":"2026-02-24T07:49:22.771689+0000","mapping_epoch":29,"log_start":"35'41778","ondisk_log_start":"35'41778","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:49:25.077503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342286336,"num_objects":5223,"num_object_clones":0,"num_object_copies":15669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41783,"num_write_kb":334264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":5614723072,"num_objects":85675,"num_object_clones":0,"num_object_copies":257025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685391,"num_write_kb":5483128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16841908224,"data_stored":16841908224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215138,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6413516,"kb_used_data":4772664,"kb_used_omap":12,"kb_used_meta":1640819,"kb_avail":727589684,"statfs":{"total":751619276800,"available":745051836416,"internally_reserved":0,"allocated":4887207936,"data_stored":4886996341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12783,"internal_metadata":1680199185},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,5,20,45],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444067,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5019220,"kb_used_data":3746944,"kb_used_omap":16,"kb_used_meta":1272239,"kb_avail":728983980,"statfs":{"total":751619276800,"available":746479595520,"internally_reserved":0,"allocated":3836870656,"data_stored":3836659061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":1302773546},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5401080,"kb_used_data":4092708,"kb_used_omap":18,"kb_used_meta":1308333,"kb_avail":728602120,"statfs":{"total":751619276800,"available":746088570880,"internally_reserved":0,"allocated":4190932992,"data_stored":4190724949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1339733246},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5066532,"kb_used_data":3776208,"kb_used_omap":20,"kb_used_meta":1290283,"kb_avail":728936668,"statfs":{"total":751619276800,"available":746431148032,"internally_reserved":0,"allocated":3866836992,"data_stored":3866625397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1321250141},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3870629888,"data_stored":3870629888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4220977152,"data_stored":4220977152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3840507904,"data_stored":3840507904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4909793280,"data_stored":4909793280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:25.500 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:49:25.501 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 66 2026-02-24T07:49:25.572 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:25.683 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:25.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.699+0000 7fee6eb95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.699+0000 7fee6eb95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.717 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:25.718 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:25.733 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:25.733 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:25.747 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:25.747 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:25.777 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:25.777 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:25.802 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.800+0000 7f86b0a60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.802 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:25.801+0000 7f86b0a60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:25.937 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:49:25.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 710708 710580 63.8038 63.5312 0.0167961 0.0156698 2026-02-24T07:49:25.976 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:25 trial016 ceph-mon[39544]: 2.a scrub ok 2026-02-24T07:49:25.976 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1230614016' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:25.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:26.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 719043 718915 63.8186 65.1172 0.0182643 0.0156666 2026-02-24T07:49:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:26 trial016 ceph-mon[39544]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:26 trial016 ceph-mon[39544]: pgmap v89: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.81k op/s 2026-02-24T07:49:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:26 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2476440661' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T07:49:27.823 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:27.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 727017 726889 63.8015 62.2969 0.00149727 0.0156708 2026-02-24T07:49:27.968 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:28.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:28.095+0000 7fdb21fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:28.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:28.095+0000 7fdb21fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:28.112 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:28.112 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:28.140 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:28.140 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:28.155 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:28.155 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:28.178 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:28.178 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:28.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 42 734998 734956 63.7928 63.0234 0.0198156 0.0156732 2026-02-24T07:49:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:28 trial016 ceph-mon[39544]: pgmap v90: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.01k op/s 2026-02-24T07:49:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3475321824' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:29.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0103 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 734998 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 63.7946 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 5.79314 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 75.6875 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 45.7031 2026-02-24T07:49:29.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 8165 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 741.521 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 9688 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 5850 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0156732 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.00862993 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.0957385 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.00061474 2026-02-24T07:49:29.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:49:30.229 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:30.369 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:30.811+0000 7f339e27c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:30.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:30.812+0000 7f339e27c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:30.901 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:30.901 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:30.901 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:30.901 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:30.979 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:30.980 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:49:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:30 trial016 ceph-mon[39544]: pgmap v91: 17 pgs: 17 active+clean; 5.5 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 9.97k op/s 2026-02-24T07:49:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:30 trial016 ceph-mon[39544]: 2.6 scrub starts 2026-02-24T07:49:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1307489377' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:31.117 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:32.003 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:31.999+0000 7f63f7cae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:32.004 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:31.999+0000 7f63f7cae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:32.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:31 trial016 ceph-mon[39544]: 2.8 scrub starts 2026-02-24T07:49:32.837 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:49:33.108 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:32 trial016 ceph-mon[39544]: 2.2 scrub starts 2026-02-24T07:49:33.109 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:32 trial016 ceph-mon[39544]: 2.8 scrub ok 2026-02-24T07:49:33.109 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:32 trial016 ceph-mon[39544]: pgmap v92: 17 pgs: 17 active+clean; 5.5 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.83k op/s 2026-02-24T07:49:33.109 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:32 trial016 ceph-mon[39544]: 2.c scrub starts 2026-02-24T07:49:33.109 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1762784' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:49:33.418 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:49:33.519 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:33.557 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:33.788 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:33.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:33.897+0000 7fd599ec1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:33.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:33.897+0000 7fd599ec1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:33.935 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:33.932+0000 7f36e2db1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:33.935 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1762784' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:49:33.936 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:33 trial016 ceph-mon[39544]: osdmap e36: 4 total, 4 up, 4 in 2026-02-24T07:49:33.936 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:33.932+0000 7f36e2db1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:33.953 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:33.953 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:33.987 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:33.987 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:33.999 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:33.999 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:34.016 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:34.016 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:34.842 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:49:34.889 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:49:35.022 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:35.096 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:35.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: 2.b scrub starts 2026-02-24T07:49:35.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: 2.6 scrub ok 2026-02-24T07:49:35.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: pgmap v94: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 4.4 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 39 MiB/s wr, 6.92k op/s 2026-02-24T07:49:35.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/210377971' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:35.097 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: 2.b scrub ok 2026-02-24T07:49:35.097 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1234599856' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:49:35.097 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:34 trial016 ceph-mon[39544]: 2.2 scrub ok 2026-02-24T07:49:35.156 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:35.152+0000 7f27d4a62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:35.156 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:35.153+0000 7f27d4a62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:35.846 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:49:35.893 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:49:36.035 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:36.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:35 trial016 ceph-mon[39544]: 2.c scrub ok 2026-02-24T07:49:36.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1234599856' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:49:36.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:35 trial016 ceph-mon[39544]: osdmap e37: 4 total, 4 up, 4 in 2026-02-24T07:49:36.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2771233037' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:49:36.151 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:36.149+0000 7f31e731a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:36.152 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:36.149+0000 7f31e731a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:36.319 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:36.456 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:36.569 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:36.565+0000 7f0c2b5e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:36.569 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:36.565+0000 7f0c2b5e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:36.583 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:36.583 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:36.599 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:36.599 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:36.610 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:36.611 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:36.626 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:36.626 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:36.847 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:49:36.893 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:49:36.893 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:37.030 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:37.098 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:36 trial016 ceph-mon[39544]: pgmap v96: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 4.4 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 46 MiB/s wr, 8.33k op/s 2026-02-24T07:49:37.098 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2771233037' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:49:37.098 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:36 trial016 ceph-mon[39544]: osdmap e38: 4 total, 4 up, 4 in 2026-02-24T07:49:37.098 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2118197325' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:49:37.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2264724440' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:37.145 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:37.143+0000 7f1dec13a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:37.146 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:37.143+0000 7f1dec13a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:37.284 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:37.284 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:37.330 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2026-02-24T07:49:36.846559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4739220024,"num_objects":72309,"num_object_clones":0,"num_object_copies":216927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72309,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":754703,"num_write_kb":5882135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20490792,"kb_used_data":14427160,"kb_used_omap":68,"kb_used_meta":6063419,"kb_avail":2915522008,"statfs":{"total":3006477107200,"available":2985494536192,"internally_reserved":0,"allocated":14773411840,"data_stored":14772556796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69738,"internal_metadata":6208941974},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,8,14,22,15,0,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1207721960,"num_objects":-18428,"num_object_clones":0,"num_object_copies":-55284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18428,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28695,"num_write_kb":73001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.084894"},"pg_stats":[{"pgid":"2.f","version":"35'47671","reported_seq":47756,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.755767+0000","last_change":"2026-02-24T07:49:24.242975+0000","last_active":"2026-02-24T07:49:32.755767+0000","last_peered":"2026-02-24T07:49:32.755767+0000","last_clean":"2026-02-24T07:49:32.755767+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:32.755767+0000","last_undegraded":"2026-02-24T07:49:32.755767+0000","last_fullsized":"2026-02-24T07:49:32.755767+0000","mapping_epoch":29,"log_start":"35'47668","ondisk_log_start":"35'47668","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'44160","last_scrub_stamp":"2026-02-24T07:49:24.242921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:24.242921+0000","objects_scrubbed":5503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:39.756746+0000","scrub_duration":532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299171840,"num_objects":4565,"num_object_clones":0,"num_object_copies":13695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47671,"num_write_kb":371456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'47851","reported_seq":47928,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.822141+0000","last_change":"2026-02-24T07:49:12.376119+0000","last_active":"2026-02-24T07:49:32.822141+0000","last_peered":"2026-02-24T07:49:32.822141+0000","last_clean":"2026-02-24T07:49:32.822141+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:32.822141+0000","last_undegraded":"2026-02-24T07:49:32.822141+0000","last_fullsized":"2026-02-24T07:49:32.822141+0000","mapping_epoch":29,"log_start":"35'47842","ondisk_log_start":"35'47842","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38184","last_scrub_stamp":"2026-02-24T07:49:12.376026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:12.376026+0000","objects_scrubbed":4730,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:20.961514+0000","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297992192,"num_objects":4547,"num_object_clones":0,"num_object_copies":13641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47851,"num_write_kb":372608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'48047","reported_seq":48116,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.810432+0000","last_change":"2026-02-24T07:49:05.821079+0000","last_active":"2026-02-24T07:49:32.810432+0000","last_peered":"2026-02-24T07:49:32.810432+0000","last_clean":"2026-02-24T07:49:32.810432+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:32.810432+0000","last_undegraded":"2026-02-24T07:49:32.810432+0000","last_fullsized":"2026-02-24T07:49:32.810432+0000","mapping_epoch":29,"log_start":"35'48039","ondisk_log_start":"35'48039","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34578","last_scrub_stamp":"2026-02-24T07:49:05.821006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:05.821006+0000","objects_scrubbed":4289,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:17.365510+0000","scrub_duration":1580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300990488,"num_objects":4594,"num_object_clones":0,"num_object_copies":13782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4594,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48047,"num_write_kb":374321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'47978","reported_seq":47998,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.811468+0000","last_change":"2026-02-24T07:49:32.107623+0000","last_active":"2026-02-24T07:49:32.811468+0000","last_peered":"2026-02-24T07:49:32.811468+0000","last_clean":"2026-02-24T07:49:32.811468+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:32.811468+0000","last_undegraded":"2026-02-24T07:49:32.811468+0000","last_fullsized":"2026-02-24T07:49:32.811468+0000","mapping_epoch":29,"log_start":"35'47959","ondisk_log_start":"35'47959","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":1049,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302645248,"num_objects":4618,"num_object_clones":0,"num_object_copies":13854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47978,"num_write_kb":374016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:14.372043+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:14.372043+0000","last_peered":"2026-02-24T07:49:14.372043+0000","last_clean":"2026-02-24T07:49:14.372043+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:14.372043+0000","last_undegraded":"2026-02-24T07:49:14.372043+0000","last_fullsized":"2026-02-24T07:49:14.372043+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'47378","reported_seq":47454,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768275+0000","last_change":"2026-02-24T07:49:17.730491+0000","last_active":"2026-02-24T07:49:32.768275+0000","last_peered":"2026-02-24T07:49:32.768275+0000","last_clean":"2026-02-24T07:49:32.768275+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:32.768275+0000","last_undegraded":"2026-02-24T07:49:32.768275+0000","last_fullsized":"2026-02-24T07:49:32.768275+0000","mapping_epoch":29,"log_start":"35'47366","ondisk_log_start":"35'47366","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40400","last_scrub_stamp":"2026-02-24T07:49:17.730449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:17.730449+0000","objects_scrubbed":5009,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:19.724025+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301858816,"num_objects":4606,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47378,"num_write_kb":369664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'47077","reported_seq":47151,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768821+0000","last_change":"2026-02-24T07:49:07.647295+0000","last_active":"2026-02-24T07:49:32.768821+0000","last_peered":"2026-02-24T07:49:32.768821+0000","last_clean":"2026-02-24T07:49:32.768821+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:32.768821+0000","last_undegraded":"2026-02-24T07:49:32.768821+0000","last_fullsized":"2026-02-24T07:49:32.768821+0000","mapping_epoch":29,"log_start":"35'47074","ondisk_log_start":"35'47074","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35192","last_scrub_stamp":"2026-02-24T07:49:07.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:07.647256+0000","objects_scrubbed":4360,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:14.060702+0000","scrub_duration":1380,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297402368,"num_objects":4538,"num_object_clones":0,"num_object_copies":13614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47077,"num_write_kb":367040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'47631","reported_seq":47710,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.811621+0000","last_change":"2026-02-24T07:49:18.906378+0000","last_active":"2026-02-24T07:49:32.811621+0000","last_peered":"2026-02-24T07:49:32.811621+0000","last_clean":"2026-02-24T07:49:32.811621+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:32.811621+0000","last_undegraded":"2026-02-24T07:49:32.811621+0000","last_fullsized":"2026-02-24T07:49:32.811621+0000","mapping_epoch":29,"log_start":"35'47625","ondisk_log_start":"35'47625","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41116","last_scrub_stamp":"2026-02-24T07:49:18.906324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:18.906324+0000","objects_scrubbed":5091,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.829361+0000","scrub_duration":1712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301203456,"num_objects":4596,"num_object_clones":0,"num_object_copies":13788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47631,"num_write_kb":371392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'46238","reported_seq":46286,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.769530+0000","last_change":"2026-02-24T07:49:31.377121+0000","last_active":"2026-02-24T07:49:32.769530+0000","last_peered":"2026-02-24T07:49:32.769530+0000","last_clean":"2026-02-24T07:49:32.769530+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:32.769530+0000","last_undegraded":"2026-02-24T07:49:32.769530+0000","last_fullsized":"2026-02-24T07:49:32.769530+0000","mapping_epoch":29,"log_start":"35'46232","ondisk_log_start":"35'46232","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":2349,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289275904,"num_objects":4414,"num_object_clones":0,"num_object_copies":13242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46238,"num_write_kb":360192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'46922","reported_seq":46991,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.821703+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:32.821703+0000","last_peered":"2026-02-24T07:49:32.821703+0000","last_clean":"2026-02-24T07:49:32.821703+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:32.821703+0000","last_undegraded":"2026-02-24T07:49:32.821703+0000","last_fullsized":"2026-02-24T07:49:32.821703+0000","mapping_epoch":29,"log_start":"35'46918","ondisk_log_start":"35'46918","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292814848,"num_objects":4468,"num_object_clones":0,"num_object_copies":13404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46922,"num_write_kb":365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'46102","reported_seq":46176,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.759897+0000","last_change":"2026-02-24T07:49:09.895808+0000","last_active":"2026-02-24T07:49:32.759897+0000","last_peered":"2026-02-24T07:49:32.759897+0000","last_clean":"2026-02-24T07:49:32.759897+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:32.759897+0000","last_undegraded":"2026-02-24T07:49:32.759897+0000","last_fullsized":"2026-02-24T07:49:32.759897+0000","mapping_epoch":29,"log_start":"35'46099","ondisk_log_start":"35'46099","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35584","last_scrub_stamp":"2026-02-24T07:49:09.895762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:09.895762+0000","objects_scrubbed":4429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:15.168040+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291700736,"num_objects":4451,"num_object_clones":0,"num_object_copies":13353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46102,"num_write_kb":359488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'46767","reported_seq":46830,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.814505+0000","last_change":"2026-02-24T07:49:30.071976+0000","last_active":"2026-02-24T07:49:32.814505+0000","last_peered":"2026-02-24T07:49:32.814505+0000","last_clean":"2026-02-24T07:49:32.814505+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:32.814505+0000","last_undegraded":"2026-02-24T07:49:32.814505+0000","last_fullsized":"2026-02-24T07:49:32.814505+0000","mapping_epoch":29,"log_start":"35'46756","ondisk_log_start":"35'46756","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":3899,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290586624,"num_objects":4434,"num_object_clones":0,"num_object_copies":13302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46767,"num_write_kb":364096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'46905","reported_seq":46970,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768050+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:32.768050+0000","last_peered":"2026-02-24T07:49:32.768050+0000","last_clean":"2026-02-24T07:49:32.768050+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:32.768050+0000","last_undegraded":"2026-02-24T07:49:32.768050+0000","last_fullsized":"2026-02-24T07:49:32.768050+0000","mapping_epoch":29,"log_start":"35'46900","ondisk_log_start":"35'46900","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":4512,"num_object_clones":0,"num_object_copies":13536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46905,"num_write_kb":365632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'47438","reported_seq":47525,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.762590+0000","last_change":"2026-02-24T07:49:31.647971+0000","last_active":"2026-02-24T07:49:32.762590+0000","last_peered":"2026-02-24T07:49:32.762590+0000","last_clean":"2026-02-24T07:49:32.762590+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:32.762590+0000","last_undegraded":"2026-02-24T07:49:32.762590+0000","last_fullsized":"2026-02-24T07:49:32.762590+0000","mapping_epoch":29,"log_start":"35'47435","ondisk_log_start":"35'47435","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46890","last_scrub_stamp":"2026-02-24T07:49:31.647872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:31.647872+0000","objects_scrubbed":5346,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:54.494634+0000","scrub_duration":1271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299106304,"num_objects":4564,"num_object_clones":0,"num_object_copies":13692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47438,"num_write_kb":369792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'47572","reported_seq":47651,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.811541+0000","last_change":"2026-02-24T07:49:21.037080+0000","last_active":"2026-02-24T07:49:32.811541+0000","last_peered":"2026-02-24T07:49:32.811541+0000","last_clean":"2026-02-24T07:49:32.811541+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:32.811541+0000","last_undegraded":"2026-02-24T07:49:32.811541+0000","last_fullsized":"2026-02-24T07:49:32.811541+0000","mapping_epoch":29,"log_start":"35'47565","ondisk_log_start":"35'47565","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'42496","last_scrub_stamp":"2026-02-24T07:49:21.037008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:21.037008+0000","objects_scrubbed":5255,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.516583+0000","scrub_duration":1878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299171840,"num_objects":4565,"num_object_clones":0,"num_object_copies":13695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47572,"num_write_kb":370752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'46999","reported_seq":47080,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.810240+0000","last_change":"2026-02-24T07:49:24.940206+0000","last_active":"2026-02-24T07:49:32.810240+0000","last_peered":"2026-02-24T07:49:32.810240+0000","last_clean":"2026-02-24T07:49:32.810240+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:32.810240+0000","last_undegraded":"2026-02-24T07:49:32.810240+0000","last_fullsized":"2026-02-24T07:49:32.810240+0000","mapping_epoch":29,"log_start":"35'46993","ondisk_log_start":"35'46993","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43792","last_scrub_stamp":"2026-02-24T07:49:24.940108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:24.940108+0000","objects_scrubbed":5415,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:35.527592+0000","scrub_duration":1769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289538048,"num_objects":4418,"num_object_clones":0,"num_object_copies":13254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46999,"num_write_kb":365632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'45992","reported_seq":46014,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.759966+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:32.759966+0000","last_peered":"2026-02-24T07:49:32.759966+0000","last_clean":"2026-02-24T07:49:32.759966+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:32.759966+0000","last_undegraded":"2026-02-24T07:49:32.759966+0000","last_fullsized":"2026-02-24T07:49:32.759966+0000","mapping_epoch":29,"log_start":"35'45989","ondisk_log_start":"35'45989","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289472512,"num_objects":4417,"num_object_clones":0,"num_object_copies":13251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45992,"num_write_kb":358464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4738629656,"num_objects":72307,"num_object_clones":0,"num_object_copies":216921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72307,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":754568,"num_write_kb":5879985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14244147200,"data_stored":14244134984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215140,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6024648,"kb_used_data":4239348,"kb_used_omap":12,"kb_used_meta":1785203,"kb_avail":727978552,"statfs":{"total":751619276800,"available":745450037248,"internally_reserved":0,"allocated":4341092352,"data_stored":4340876685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12783,"internal_metadata":1828048401},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,6,4,0,0,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444069,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4606484,"kb_used_data":3215680,"kb_used_omap":16,"kb_used_meta":1390767,"kb_avail":729396716,"statfs":{"total":751619276800,"available":746902237184,"internally_reserved":0,"allocated":3292856320,"data_stored":3292644725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":1424146218},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5233732,"kb_used_data":3755056,"kb_used_omap":18,"kb_used_meta":1478637,"kb_avail":728769468,"statfs":{"total":751619276800,"available":746259935232,"internally_reserved":0,"allocated":3845177344,"data_stored":3844965229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1514124542},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,8,8,18,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4625928,"kb_used_data":3217076,"kb_used_omap":20,"kb_used_meta":1408811,"kb_avail":729377272,"statfs":{"total":751619276800,"available":746882326528,"internally_reserved":0,"allocated":3294285824,"data_stored":3294070157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1442622813},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3287011328,"data_stored":3287007256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3549941760,"data_stored":3549937688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3249733632,"data_stored":3249733632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4157460480,"data_stored":4157456408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:37.332 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:37.475 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:37.603 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:37.600+0000 7f9b2e2c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:37.603 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:37.600+0000 7f9b2e2c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:37.746 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:37.747 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:37.808 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2026-02-24T07:49:36.846559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4739220024,"num_objects":72309,"num_object_clones":0,"num_object_copies":216927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72309,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":754703,"num_write_kb":5882135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20490792,"kb_used_data":14427160,"kb_used_omap":68,"kb_used_meta":6063419,"kb_avail":2915522008,"statfs":{"total":3006477107200,"available":2985494536192,"internally_reserved":0,"allocated":14773411840,"data_stored":14772556796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69738,"internal_metadata":6208941974},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,8,14,22,15,0,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1207721960,"num_objects":-18428,"num_object_clones":0,"num_object_copies":-55284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18428,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28695,"num_write_kb":73001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.084894"},"pg_stats":[{"pgid":"2.f","version":"35'47671","reported_seq":47756,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.755767+0000","last_change":"2026-02-24T07:49:24.242975+0000","last_active":"2026-02-24T07:49:32.755767+0000","last_peered":"2026-02-24T07:49:32.755767+0000","last_clean":"2026-02-24T07:49:32.755767+0000","last_became_active":"2026-02-24T07:47:57.848618+0000","last_became_peered":"2026-02-24T07:47:57.848618+0000","last_unstale":"2026-02-24T07:49:32.755767+0000","last_undegraded":"2026-02-24T07:49:32.755767+0000","last_fullsized":"2026-02-24T07:49:32.755767+0000","mapping_epoch":29,"log_start":"35'47668","ondisk_log_start":"35'47668","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'44160","last_scrub_stamp":"2026-02-24T07:49:24.242921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:24.242921+0000","objects_scrubbed":5503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:39.756746+0000","scrub_duration":532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299171840,"num_objects":4565,"num_object_clones":0,"num_object_copies":13695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47671,"num_write_kb":371456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'47851","reported_seq":47928,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.822141+0000","last_change":"2026-02-24T07:49:12.376119+0000","last_active":"2026-02-24T07:49:32.822141+0000","last_peered":"2026-02-24T07:49:32.822141+0000","last_clean":"2026-02-24T07:49:32.822141+0000","last_became_active":"2026-02-24T07:47:57.848669+0000","last_became_peered":"2026-02-24T07:47:57.848669+0000","last_unstale":"2026-02-24T07:49:32.822141+0000","last_undegraded":"2026-02-24T07:49:32.822141+0000","last_fullsized":"2026-02-24T07:49:32.822141+0000","mapping_epoch":29,"log_start":"35'47842","ondisk_log_start":"35'47842","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38184","last_scrub_stamp":"2026-02-24T07:49:12.376026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:12.376026+0000","objects_scrubbed":4730,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:20.961514+0000","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297992192,"num_objects":4547,"num_object_clones":0,"num_object_copies":13641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47851,"num_write_kb":372608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'48047","reported_seq":48116,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.810432+0000","last_change":"2026-02-24T07:49:05.821079+0000","last_active":"2026-02-24T07:49:32.810432+0000","last_peered":"2026-02-24T07:49:32.810432+0000","last_clean":"2026-02-24T07:49:32.810432+0000","last_became_active":"2026-02-24T07:47:57.850808+0000","last_became_peered":"2026-02-24T07:47:57.850808+0000","last_unstale":"2026-02-24T07:49:32.810432+0000","last_undegraded":"2026-02-24T07:49:32.810432+0000","last_fullsized":"2026-02-24T07:49:32.810432+0000","mapping_epoch":29,"log_start":"35'48039","ondisk_log_start":"35'48039","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34578","last_scrub_stamp":"2026-02-24T07:49:05.821006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:05.821006+0000","objects_scrubbed":4289,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:17.365510+0000","scrub_duration":1580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300990488,"num_objects":4594,"num_object_clones":0,"num_object_copies":13782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4594,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48047,"num_write_kb":374321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'47978","reported_seq":47998,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.811468+0000","last_change":"2026-02-24T07:49:32.107623+0000","last_active":"2026-02-24T07:49:32.811468+0000","last_peered":"2026-02-24T07:49:32.811468+0000","last_clean":"2026-02-24T07:49:32.811468+0000","last_became_active":"2026-02-24T07:47:57.850584+0000","last_became_peered":"2026-02-24T07:47:57.850584+0000","last_unstale":"2026-02-24T07:49:32.811468+0000","last_undegraded":"2026-02-24T07:49:32.811468+0000","last_fullsized":"2026-02-24T07:49:32.811468+0000","mapping_epoch":29,"log_start":"35'47959","ondisk_log_start":"35'47959","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":1049,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302645248,"num_objects":4618,"num_object_clones":0,"num_object_copies":13854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47978,"num_write_kb":374016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:14.372043+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:14.372043+0000","last_peered":"2026-02-24T07:49:14.372043+0000","last_clean":"2026-02-24T07:49:14.372043+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:14.372043+0000","last_undegraded":"2026-02-24T07:49:14.372043+0000","last_fullsized":"2026-02-24T07:49:14.372043+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'47378","reported_seq":47454,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768275+0000","last_change":"2026-02-24T07:49:17.730491+0000","last_active":"2026-02-24T07:49:32.768275+0000","last_peered":"2026-02-24T07:49:32.768275+0000","last_clean":"2026-02-24T07:49:32.768275+0000","last_became_active":"2026-02-24T07:47:57.849766+0000","last_became_peered":"2026-02-24T07:47:57.849766+0000","last_unstale":"2026-02-24T07:49:32.768275+0000","last_undegraded":"2026-02-24T07:49:32.768275+0000","last_fullsized":"2026-02-24T07:49:32.768275+0000","mapping_epoch":29,"log_start":"35'47366","ondisk_log_start":"35'47366","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40400","last_scrub_stamp":"2026-02-24T07:49:17.730449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:17.730449+0000","objects_scrubbed":5009,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:19.724025+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301858816,"num_objects":4606,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47378,"num_write_kb":369664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'47077","reported_seq":47151,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768821+0000","last_change":"2026-02-24T07:49:07.647295+0000","last_active":"2026-02-24T07:49:32.768821+0000","last_peered":"2026-02-24T07:49:32.768821+0000","last_clean":"2026-02-24T07:49:32.768821+0000","last_became_active":"2026-02-24T07:47:57.849442+0000","last_became_peered":"2026-02-24T07:47:57.849442+0000","last_unstale":"2026-02-24T07:49:32.768821+0000","last_undegraded":"2026-02-24T07:49:32.768821+0000","last_fullsized":"2026-02-24T07:49:32.768821+0000","mapping_epoch":29,"log_start":"35'47074","ondisk_log_start":"35'47074","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35192","last_scrub_stamp":"2026-02-24T07:49:07.647256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:07.647256+0000","objects_scrubbed":4360,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:14.060702+0000","scrub_duration":1380,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297402368,"num_objects":4538,"num_object_clones":0,"num_object_copies":13614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47077,"num_write_kb":367040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'47631","reported_seq":47710,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.811621+0000","last_change":"2026-02-24T07:49:18.906378+0000","last_active":"2026-02-24T07:49:32.811621+0000","last_peered":"2026-02-24T07:49:32.811621+0000","last_clean":"2026-02-24T07:49:32.811621+0000","last_became_active":"2026-02-24T07:47:57.848112+0000","last_became_peered":"2026-02-24T07:47:57.848112+0000","last_unstale":"2026-02-24T07:49:32.811621+0000","last_undegraded":"2026-02-24T07:49:32.811621+0000","last_fullsized":"2026-02-24T07:49:32.811621+0000","mapping_epoch":29,"log_start":"35'47625","ondisk_log_start":"35'47625","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41116","last_scrub_stamp":"2026-02-24T07:49:18.906324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:18.906324+0000","objects_scrubbed":5091,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.829361+0000","scrub_duration":1712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301203456,"num_objects":4596,"num_object_clones":0,"num_object_copies":13788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47631,"num_write_kb":371392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'46238","reported_seq":46286,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.769530+0000","last_change":"2026-02-24T07:49:31.377121+0000","last_active":"2026-02-24T07:49:32.769530+0000","last_peered":"2026-02-24T07:49:32.769530+0000","last_clean":"2026-02-24T07:49:32.769530+0000","last_became_active":"2026-02-24T07:47:57.849835+0000","last_became_peered":"2026-02-24T07:47:57.849835+0000","last_unstale":"2026-02-24T07:49:32.769530+0000","last_undegraded":"2026-02-24T07:49:32.769530+0000","last_fullsized":"2026-02-24T07:49:32.769530+0000","mapping_epoch":29,"log_start":"35'46232","ondisk_log_start":"35'46232","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":2349,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289275904,"num_objects":4414,"num_object_clones":0,"num_object_copies":13242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46238,"num_write_kb":360192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'46922","reported_seq":46991,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.821703+0000","last_change":"2026-02-24T07:49:00.390539+0000","last_active":"2026-02-24T07:49:32.821703+0000","last_peered":"2026-02-24T07:49:32.821703+0000","last_clean":"2026-02-24T07:49:32.821703+0000","last_became_active":"2026-02-24T07:47:57.848749+0000","last_became_peered":"2026-02-24T07:47:57.848749+0000","last_unstale":"2026-02-24T07:49:32.821703+0000","last_undegraded":"2026-02-24T07:49:32.821703+0000","last_fullsized":"2026-02-24T07:49:32.821703+0000","mapping_epoch":29,"log_start":"35'46918","ondisk_log_start":"35'46918","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31664","last_scrub_stamp":"2026-02-24T07:49:00.390451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.390451+0000","objects_scrubbed":3913,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:03.272588+0000","scrub_duration":1173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292814848,"num_objects":4468,"num_object_clones":0,"num_object_copies":13404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46922,"num_write_kb":365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'46102","reported_seq":46176,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.759897+0000","last_change":"2026-02-24T07:49:09.895808+0000","last_active":"2026-02-24T07:49:32.759897+0000","last_peered":"2026-02-24T07:49:32.759897+0000","last_clean":"2026-02-24T07:49:32.759897+0000","last_became_active":"2026-02-24T07:47:57.847372+0000","last_became_peered":"2026-02-24T07:47:57.847372+0000","last_unstale":"2026-02-24T07:49:32.759897+0000","last_undegraded":"2026-02-24T07:49:32.759897+0000","last_fullsized":"2026-02-24T07:49:32.759897+0000","mapping_epoch":29,"log_start":"35'46099","ondisk_log_start":"35'46099","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'35584","last_scrub_stamp":"2026-02-24T07:49:09.895762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:09.895762+0000","objects_scrubbed":4429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:15.168040+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291700736,"num_objects":4451,"num_object_clones":0,"num_object_copies":13353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46102,"num_write_kb":359488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'46767","reported_seq":46830,"reported_epoch":35,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:49:32.814505+0000","last_change":"2026-02-24T07:49:30.071976+0000","last_active":"2026-02-24T07:49:32.814505+0000","last_peered":"2026-02-24T07:49:32.814505+0000","last_clean":"2026-02-24T07:49:32.814505+0000","last_became_active":"2026-02-24T07:47:57.851182+0000","last_became_peered":"2026-02-24T07:47:57.851182+0000","last_unstale":"2026-02-24T07:49:32.814505+0000","last_undegraded":"2026-02-24T07:49:32.814505+0000","last_fullsized":"2026-02-24T07:49:32.814505+0000","mapping_epoch":29,"log_start":"35'46756","ondisk_log_start":"35'46756","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":3899,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290586624,"num_objects":4434,"num_object_clones":0,"num_object_copies":13302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46767,"num_write_kb":364096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'46905","reported_seq":46970,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.768050+0000","last_change":"2026-02-24T07:49:00.371316+0000","last_active":"2026-02-24T07:49:32.768050+0000","last_peered":"2026-02-24T07:49:32.768050+0000","last_clean":"2026-02-24T07:49:32.768050+0000","last_became_active":"2026-02-24T07:47:57.849604+0000","last_became_peered":"2026-02-24T07:47:57.849604+0000","last_unstale":"2026-02-24T07:49:32.768050+0000","last_undegraded":"2026-02-24T07:49:32.768050+0000","last_fullsized":"2026-02-24T07:49:32.768050+0000","mapping_epoch":29,"log_start":"35'46900","ondisk_log_start":"35'46900","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31250","last_scrub_stamp":"2026-02-24T07:49:00.371242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:00.371242+0000","objects_scrubbed":3871,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:23.330099+0000","scrub_duration":1064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":4512,"num_object_clones":0,"num_object_copies":13536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46905,"num_write_kb":365632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'47438","reported_seq":47525,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.762590+0000","last_change":"2026-02-24T07:49:31.647971+0000","last_active":"2026-02-24T07:49:32.762590+0000","last_peered":"2026-02-24T07:49:32.762590+0000","last_clean":"2026-02-24T07:49:32.762590+0000","last_became_active":"2026-02-24T07:47:57.847488+0000","last_became_peered":"2026-02-24T07:47:57.847488+0000","last_unstale":"2026-02-24T07:49:32.762590+0000","last_undegraded":"2026-02-24T07:49:32.762590+0000","last_fullsized":"2026-02-24T07:49:32.762590+0000","mapping_epoch":29,"log_start":"35'47435","ondisk_log_start":"35'47435","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46890","last_scrub_stamp":"2026-02-24T07:49:31.647872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:31.647872+0000","objects_scrubbed":5346,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:54.494634+0000","scrub_duration":1271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299106304,"num_objects":4564,"num_object_clones":0,"num_object_copies":13692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47438,"num_write_kb":369792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'47572","reported_seq":47651,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.811541+0000","last_change":"2026-02-24T07:49:21.037080+0000","last_active":"2026-02-24T07:49:32.811541+0000","last_peered":"2026-02-24T07:49:32.811541+0000","last_clean":"2026-02-24T07:49:32.811541+0000","last_became_active":"2026-02-24T07:47:57.850387+0000","last_became_peered":"2026-02-24T07:47:57.850387+0000","last_unstale":"2026-02-24T07:49:32.811541+0000","last_undegraded":"2026-02-24T07:49:32.811541+0000","last_fullsized":"2026-02-24T07:49:32.811541+0000","mapping_epoch":29,"log_start":"35'47565","ondisk_log_start":"35'47565","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'42496","last_scrub_stamp":"2026-02-24T07:49:21.037008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:21.037008+0000","objects_scrubbed":5255,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.516583+0000","scrub_duration":1878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299171840,"num_objects":4565,"num_object_clones":0,"num_object_copies":13695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47572,"num_write_kb":370752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'46999","reported_seq":47080,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.810240+0000","last_change":"2026-02-24T07:49:24.940206+0000","last_active":"2026-02-24T07:49:32.810240+0000","last_peered":"2026-02-24T07:49:32.810240+0000","last_clean":"2026-02-24T07:49:32.810240+0000","last_became_active":"2026-02-24T07:47:57.851095+0000","last_became_peered":"2026-02-24T07:47:57.851095+0000","last_unstale":"2026-02-24T07:49:32.810240+0000","last_undegraded":"2026-02-24T07:49:32.810240+0000","last_fullsized":"2026-02-24T07:49:32.810240+0000","mapping_epoch":29,"log_start":"35'46993","ondisk_log_start":"35'46993","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'43792","last_scrub_stamp":"2026-02-24T07:49:24.940108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:49:24.940108+0000","objects_scrubbed":5415,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:35.527592+0000","scrub_duration":1769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289538048,"num_objects":4418,"num_object_clones":0,"num_object_copies":13254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46999,"num_write_kb":365632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'45992","reported_seq":46014,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T07:49:32.759966+0000","last_change":"2026-02-24T07:47:57.848589+0000","last_active":"2026-02-24T07:49:32.759966+0000","last_peered":"2026-02-24T07:49:32.759966+0000","last_clean":"2026-02-24T07:49:32.759966+0000","last_became_active":"2026-02-24T07:47:57.848171+0000","last_became_peered":"2026-02-24T07:47:57.848171+0000","last_unstale":"2026-02-24T07:49:32.759966+0000","last_undegraded":"2026-02-24T07:49:32.759966+0000","last_fullsized":"2026-02-24T07:49:32.759966+0000","mapping_epoch":29,"log_start":"35'45989","ondisk_log_start":"35'45989","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:47:56.837436+0000","last_clean_scrub_stamp":"2026-02-24T07:47:56.837436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289472512,"num_objects":4417,"num_object_clones":0,"num_object_copies":13251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45992,"num_write_kb":358464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4738629656,"num_objects":72307,"num_object_clones":0,"num_object_copies":216921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72307,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":754568,"num_write_kb":5879985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14244147200,"data_stored":14244134984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215140,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6024648,"kb_used_data":4239348,"kb_used_omap":12,"kb_used_meta":1785203,"kb_avail":727978552,"statfs":{"total":751619276800,"available":745450037248,"internally_reserved":0,"allocated":4341092352,"data_stored":4340876685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12783,"internal_metadata":1828048401},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,6,4,0,0,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444069,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4606484,"kb_used_data":3215680,"kb_used_omap":16,"kb_used_meta":1390767,"kb_avail":729396716,"statfs":{"total":751619276800,"available":746902237184,"internally_reserved":0,"allocated":3292856320,"data_stored":3292644725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":1424146218},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5233732,"kb_used_data":3755056,"kb_used_omap":18,"kb_used_meta":1478637,"kb_avail":728769468,"statfs":{"total":751619276800,"available":746259935232,"internally_reserved":0,"allocated":3845177344,"data_stored":3844965229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":1514124542},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,8,8,18,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4625928,"kb_used_data":3217076,"kb_used_omap":20,"kb_used_meta":1408811,"kb_avail":729377272,"statfs":{"total":751619276800,"available":746882326528,"internally_reserved":0,"allocated":3294285824,"data_stored":3294070157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1442622813},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3906,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3287011328,"data_stored":3287007256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3549941760,"data_stored":3549937688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3249733632,"data_stored":3249733632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4157460480,"data_stored":4157456408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:37.810 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:49:37.810 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:37.811 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:49:37.811 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:49:37.952 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:38.012 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2118197325' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:49:38.012 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:37 trial016 ceph-mon[39544]: osdmap e39: 4 total, 4 up, 4 in 2026-02-24T07:49:38.079 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.075+0000 7efe02c82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.079 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.076+0000 7efe02c82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.100 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:49:38.101 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:49:38.102 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:49:38.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:49:38.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:49:38.139 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:49:38.286 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:38.404 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.401+0000 7f739c80f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.404 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.401+0000 7f739c80f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.431 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:49:38.431 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:49:38.431 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:49:38.431 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:49:38.432 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:49:38.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:49:38.465 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:49:38.465 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:49:38.602 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:38.667 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:38.722 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.718+0000 7f2ec89c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.722 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.718+0000 7f2ec89c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:49:38.745 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:49:38.746 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:49:38.746 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:49:38.746 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:49:38.746 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:49:38.746 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:49:38.778 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:49:38.779 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:49:38.780 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:49:38.816 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:38.878 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:38 trial016 ceph-mon[39544]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:38.879 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:38 trial016 ceph-mon[39544]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:38.879 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:38 trial016 ceph-mon[39544]: pgmap v99: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 513 op/s 2026-02-24T07:49:38.922 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:38.939 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.935+0000 7f43bd8be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.939 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:38.935+0000 7f43bd8be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:38.954 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:38.954 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:38.969 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:38.969 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:38.984 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:38.984 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:38.998 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:38.998 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:39.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:39.034+0000 7fd43cf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:39.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:39.035+0000 7fd43cf57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:39.060 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:49:39.061 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:49:39.062 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:49:39.594 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:49:39.595 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:49:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4191537205' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:41.046 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:41.191 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:41.306 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:40 trial016 ceph-mon[39544]: pgmap v100: 17 pgs: 17 active+clean; 2.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.59k op/s 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:41.622+0000 7f67d4dce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:41.622+0000 7f67d4dce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:41.707 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:41.708 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:41.708 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:41.708 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:42.130 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 91875 objects 2026-02-24T07:49:42.131 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :12.1816 2026-02-24T07:49:42.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3479595128' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:42.610 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-24T07:49:42.611 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-24T07:49:42.731 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:42.840 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:42.837+0000 7fea7666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:42.840 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:42.837+0000 7fea7666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:43.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:42 trial016 ceph-mon[39544]: pgmap v101: 17 pgs: 17 active+clean; 2.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.71k op/s 2026-02-24T07:49:43.767 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:43.860 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_0' removed 2026-02-24T07:49:43.888 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:43.899 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:49:43.899 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:49:43.900 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-24T07:49:43.900 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_1 16 2026-02-24T07:49:43.987 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:43.985+0000 7fb93535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:43.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:43.985+0000 7fb93535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:44.000 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:44.000 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:44.010 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:44.011 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:44.021 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:44.021 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:44.023 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:44.032 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:44.032 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:44.045 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2957081801' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:49:44.125 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:44.122+0000 7f5aa109d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:44.125 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:44.122+0000 7f5aa109d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:44.595 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:44.596 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:49:44.714 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:44.813 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:44.811+0000 7f67b8506640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:44.813 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:44.811+0000 7f67b8506640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:44.863 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_1' created 2026-02-24T07:49:44.876 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:44 trial016 ceph-mon[39544]: pgmap v102: 17 pgs: 17 active+clean; 577 KiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.04k op/s 2026-02-24T07:49:44.877 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2957081801' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:49:44.877 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:44 trial016 ceph-mon[39544]: osdmap e40: 4 total, 4 up, 4 in 2026-02-24T07:49:44.877 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2179259736' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:44.877 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3156789778' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16} : dispatch 2026-02-24T07:49:44.913 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-24T07:49:45.033 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:45.145 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:45.142+0000 7f2df0d68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:45.145 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:45.143+0000 7f2df0d68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:45.145 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:45.865 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-24T07:49:45.865 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:49:45.911 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:49:46.065 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:46.076 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:46.118 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3156789778' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2026-02-24T07:49:46.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:45 trial016 ceph-mon[39544]: osdmap e41: 4 total, 4 up, 4 in 2026-02-24T07:49:46.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1174609661' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:49:46.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3279382099' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:49:46.170 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:46.168+0000 7ffac4ca9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:46.171 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:46.168+0000 7ffac4ca9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:46.201 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:46.386 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:46.384+0000 7f166280f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:46.386 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:46.384+0000 7f166280f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:46.398 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:46.399 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:46.409 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:46.409 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:46.421 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:46.421 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:46.431 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:46.432 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:46.870 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:49:46.908 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2026-02-24T07:49:46.910 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:49:46.952 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:49:46.952 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:49:46.998 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:49:46.998 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:49:46.998 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_96271 2026-02-24T07:49:46.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:49:46.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:49:47.092 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:47.118 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: pgmap v105: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:49:47.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1174609661' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:49:47.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3279382099' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:49:47.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: osdmap e42: 4 total, 4 up, 4 in 2026-02-24T07:49:47.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/777891563' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:49:47.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/639160084' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:47.217 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:47.215+0000 7ff221445640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:47.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:47.215+0000 7ff221445640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:47.871 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:49:47.918 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:49:47.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 127 10741 10614 82.915 82.9219 0.00626079 0.0119441 2026-02-24T07:49:48.066 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:48.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/777891563' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:49:48.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:47 trial016 ceph-mon[39544]: osdmap e43: 4 total, 4 up, 4 in 2026-02-24T07:49:48.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:47 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:49:48.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:47 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:49:48.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1328982875' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:49:48.203 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:48.200+0000 7f9772d62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:48.203 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:48.201+0000 7f9772d62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:48.467 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:48.618 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:48.740 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:48.738+0000 7f907fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:48.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:48.738+0000 7f907fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:48.758 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:48.759 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:48.776 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:48.777 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:48.819 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:48.819 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:48.836 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:48.836 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:48.873 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:49:48.921 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:49:48.922 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:48.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 20991 20863 81.4897 80.0703 0.00470142 0.0121868 2026-02-24T07:49:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: pgmap v108: 17 pgs: 10 unknown, 7 active+clean; 24 MiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:49:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1328982875' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:49:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: osdmap e44: 4 total, 4 up, 4 in 2026-02-24T07:49:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:49:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:49:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/468675053' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:49:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3493211090' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:49.111 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:49.238 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:49.236+0000 7faa6c43d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:49.238 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:49.236+0000 7faa6c43d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:49.396 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:49.397 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:49.442 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-02-24T07:49:48.872314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69780000,"num_objects":1059,"num_object_clones":0,"num_object_copies":3177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1059,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":8581,"num_write_kb":69718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6460912,"kb_used_data":90528,"kb_used_omap":86,"kb_used_meta":6370217,"kb_avail":2929551888,"statfs":{"total":3006477107200,"available":2999861133312,"internally_reserved":0,"allocated":92700672,"data_stored":91617540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":88601,"internal_metadata":6523102695},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010238"},"pg_stats":[{"pgid":"3.f","version":"43'498","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.715208+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:47.715208+0000","last_peered":"2026-02-24T07:49:47.715208+0000","last_clean":"2026-02-24T07:49:47.715208+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:47.715208+0000","last_undegraded":"2026-02-24T07:49:47.715208+0000","last_fullsized":"2026-02-24T07:49:47.715208+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":480,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4079616,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":3984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"43'444","reported_seq":450,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.760133+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:47.760133+0000","last_peered":"2026-02-24T07:49:47.760133+0000","last_clean":"2026-02-24T07:49:47.760133+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:47.760133+0000","last_undegraded":"2026-02-24T07:49:47.760133+0000","last_fullsized":"2026-02-24T07:49:47.760133+0000","mapping_epoch":41,"log_start":"43'433","ondisk_log_start":"43'433","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":433,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3637248,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'496","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774237+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:47.774237+0000","last_peered":"2026-02-24T07:49:47.774237+0000","last_clean":"2026-02-24T07:49:47.774237+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:47.774237+0000","last_undegraded":"2026-02-24T07:49:47.774237+0000","last_fullsized":"2026-02-24T07:49:47.774237+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":480,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.765232+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:47.765232+0000","last_peered":"2026-02-24T07:49:47.765232+0000","last_clean":"2026-02-24T07:49:47.765232+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:47.765232+0000","last_undegraded":"2026-02-24T07:49:47.765232+0000","last_fullsized":"2026-02-24T07:49:47.765232+0000","mapping_epoch":41,"log_start":"43'557","ondisk_log_start":"43'557","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":557,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"43'656","reported_seq":662,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.811119+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:47.811119+0000","last_peered":"2026-02-24T07:49:47.811119+0000","last_clean":"2026-02-24T07:49:47.811119+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:47.811119+0000","last_undegraded":"2026-02-24T07:49:47.811119+0000","last_fullsized":"2026-02-24T07:49:47.811119+0000","mapping_epoch":41,"log_start":"43'648","ondisk_log_start":"43'648","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":648,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"43'512","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774244+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:47.774244+0000","last_peered":"2026-02-24T07:49:47.774244+0000","last_clean":"2026-02-24T07:49:47.774244+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:47.774244+0000","last_undegraded":"2026-02-24T07:49:47.774244+0000","last_fullsized":"2026-02-24T07:49:47.774244+0000","mapping_epoch":41,"log_start":"43'496","ondisk_log_start":"43'496","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":496,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"43'616","reported_seq":630,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.756258+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:47.756258+0000","last_peered":"2026-02-24T07:49:47.756258+0000","last_clean":"2026-02-24T07:49:47.756258+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:47.756258+0000","last_undegraded":"2026-02-24T07:49:47.756258+0000","last_fullsized":"2026-02-24T07:49:47.756258+0000","mapping_epoch":41,"log_start":"43'608","ondisk_log_start":"43'608","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":608,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"43'528","reported_seq":542,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.809798+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:47.809798+0000","last_peered":"2026-02-24T07:49:47.809798+0000","last_clean":"2026-02-24T07:49:47.809798+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:47.809798+0000","last_undegraded":"2026-02-24T07:49:47.809798+0000","last_fullsized":"2026-02-24T07:49:47.809798+0000","mapping_epoch":41,"log_start":"43'515","ondisk_log_start":"43'515","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":515,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"43'504","reported_seq":508,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.822570+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:47.822570+0000","last_peered":"2026-02-24T07:49:47.822570+0000","last_clean":"2026-02-24T07:49:47.822570+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:47.822570+0000","last_undegraded":"2026-02-24T07:49:47.822570+0000","last_fullsized":"2026-02-24T07:49:47.822570+0000","mapping_epoch":41,"log_start":"43'494","ondisk_log_start":"43'494","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":494,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"43'440","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.752295+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:47.752295+0000","last_peered":"2026-02-24T07:49:47.752295+0000","last_clean":"2026-02-24T07:49:47.752295+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:47.752295+0000","last_undegraded":"2026-02-24T07:49:47.752295+0000","last_fullsized":"2026-02-24T07:49:47.752295+0000","mapping_epoch":41,"log_start":"43'424","ondisk_log_start":"43'424","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":424,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"43'472","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.753612+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:47.753612+0000","last_peered":"2026-02-24T07:49:47.753612+0000","last_clean":"2026-02-24T07:49:47.753612+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:47.753612+0000","last_undegraded":"2026-02-24T07:49:47.753612+0000","last_fullsized":"2026-02-24T07:49:47.753612+0000","mapping_epoch":41,"log_start":"43'464","ondisk_log_start":"43'464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":464,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"43'568","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.815852+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:47.815852+0000","last_peered":"2026-02-24T07:49:47.815852+0000","last_clean":"2026-02-24T07:49:47.815852+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:47.815852+0000","last_undegraded":"2026-02-24T07:49:47.815852+0000","last_fullsized":"2026-02-24T07:49:47.815852+0000","mapping_epoch":41,"log_start":"43'560","ondisk_log_start":"43'560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":560,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"43'568","reported_seq":582,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.749980+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:47.749980+0000","last_peered":"2026-02-24T07:49:47.749980+0000","last_clean":"2026-02-24T07:49:47.749980+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:47.749980+0000","last_undegraded":"2026-02-24T07:49:47.749980+0000","last_fullsized":"2026-02-24T07:49:47.749980+0000","mapping_epoch":41,"log_start":"43'552","ondisk_log_start":"43'552","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":552,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"43'536","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.725476+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:47.725476+0000","last_peered":"2026-02-24T07:49:47.725476+0000","last_clean":"2026-02-24T07:49:47.725476+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:47.725476+0000","last_undegraded":"2026-02-24T07:49:47.725476+0000","last_fullsized":"2026-02-24T07:49:47.725476+0000","mapping_epoch":41,"log_start":"43'504","ondisk_log_start":"43'504","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":504,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"43'488","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.821012+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:47.821012+0000","last_peered":"2026-02-24T07:49:47.821012+0000","last_clean":"2026-02-24T07:49:47.821012+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:47.821012+0000","last_undegraded":"2026-02-24T07:49:47.821012+0000","last_fullsized":"2026-02-24T07:49:47.821012+0000","mapping_epoch":41,"log_start":"43'478","ondisk_log_start":"43'478","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":478,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.816154+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:47.816154+0000","last_peered":"2026-02-24T07:49:47.816154+0000","last_clean":"2026-02-24T07:49:47.816154+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:47.816154+0000","last_undegraded":"2026-02-24T07:49:47.816154+0000","last_fullsized":"2026-02-24T07:49:47.816154+0000","mapping_epoch":41,"log_start":"43'553","ondisk_log_start":"43'553","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":553,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":233,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.000712+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:47.000712+0000","last_peered":"2026-02-24T07:49:47.000712+0000","last_clean":"2026-02-24T07:49:47.000712+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:47.000712+0000","last_undegraded":"2026-02-24T07:49:47.000712+0000","last_fullsized":"2026-02-24T07:49:47.000712+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215143,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1905716,"kb_used_data":30240,"kb_used_omap":17,"kb_used_meta":1875438,"kb_avail":732097484,"statfs":{"total":751619276800,"available":749667823616,"internally_reserved":0,"allocated":30965760,"data_stored":30692205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17975,"internal_metadata":1920448969},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444072,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1514636,"kb_used_data":51640,"kb_used_omap":21,"kb_used_meta":1462954,"kb_avail":732488564,"statfs":{"total":751619276800,"available":750068289536,"internally_reserved":0,"allocated":52879360,"data_stored":52605805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21806,"internal_metadata":1498065618},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1558536,"kb_used_data":7668,"kb_used_omap":23,"kb_used_meta":1550824,"kb_avail":732444664,"statfs":{"total":751619276800,"available":750023335936,"internally_reserved":0,"allocated":7852032,"data_stored":7582029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1588044593},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1482024,"kb_used_data":980,"kb_used_omap":24,"kb_used_meta":1480999,"kb_avail":732521176,"statfs":{"total":751619276800,"available":750101684224,"internally_reserved":0,"allocated":1003520,"data_stored":737501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25061,"internal_metadata":1516543515},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53755904,"data_stored":53755904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49020928,"data_stored":49020928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58163200,"data_stored":58163200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42401792,"data_stored":42401792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:49.444 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:49.634 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:49.766 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:49.764+0000 7f734f1da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:49.766 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:49.764+0000 7f734f1da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:49.927 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:49.928 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:49.928 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/468675053' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:49:49.928 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:49 trial016 ceph-mon[39544]: osdmap e45: 4 total, 4 up, 4 in 2026-02-24T07:49:49.971 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2026-02-24T07:49:49.764044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69780000,"num_objects":1059,"num_object_clones":0,"num_object_copies":3177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1059,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":8581,"num_write_kb":69718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6460912,"kb_used_data":90528,"kb_used_omap":86,"kb_used_meta":6370217,"kb_avail":2929551888,"statfs":{"total":3006477107200,"available":2999861133312,"internally_reserved":0,"allocated":92700672,"data_stored":91617540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":88601,"internal_metadata":6523102695},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000506"},"pg_stats":[{"pgid":"3.f","version":"43'498","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.715208+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:47.715208+0000","last_peered":"2026-02-24T07:49:47.715208+0000","last_clean":"2026-02-24T07:49:47.715208+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:47.715208+0000","last_undegraded":"2026-02-24T07:49:47.715208+0000","last_fullsized":"2026-02-24T07:49:47.715208+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":480,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4079616,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":3984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"43'444","reported_seq":450,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.760133+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:47.760133+0000","last_peered":"2026-02-24T07:49:47.760133+0000","last_clean":"2026-02-24T07:49:47.760133+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:47.760133+0000","last_undegraded":"2026-02-24T07:49:47.760133+0000","last_fullsized":"2026-02-24T07:49:47.760133+0000","mapping_epoch":41,"log_start":"43'433","ondisk_log_start":"43'433","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":433,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3637248,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'496","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774237+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:47.774237+0000","last_peered":"2026-02-24T07:49:47.774237+0000","last_clean":"2026-02-24T07:49:47.774237+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:47.774237+0000","last_undegraded":"2026-02-24T07:49:47.774237+0000","last_fullsized":"2026-02-24T07:49:47.774237+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":480,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.765232+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:47.765232+0000","last_peered":"2026-02-24T07:49:47.765232+0000","last_clean":"2026-02-24T07:49:47.765232+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:47.765232+0000","last_undegraded":"2026-02-24T07:49:47.765232+0000","last_fullsized":"2026-02-24T07:49:47.765232+0000","mapping_epoch":41,"log_start":"43'557","ondisk_log_start":"43'557","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":557,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"43'656","reported_seq":662,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.811119+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:47.811119+0000","last_peered":"2026-02-24T07:49:47.811119+0000","last_clean":"2026-02-24T07:49:47.811119+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:47.811119+0000","last_undegraded":"2026-02-24T07:49:47.811119+0000","last_fullsized":"2026-02-24T07:49:47.811119+0000","mapping_epoch":41,"log_start":"43'648","ondisk_log_start":"43'648","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":648,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"43'512","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774244+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:47.774244+0000","last_peered":"2026-02-24T07:49:47.774244+0000","last_clean":"2026-02-24T07:49:47.774244+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:47.774244+0000","last_undegraded":"2026-02-24T07:49:47.774244+0000","last_fullsized":"2026-02-24T07:49:47.774244+0000","mapping_epoch":41,"log_start":"43'496","ondisk_log_start":"43'496","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":496,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"43'616","reported_seq":630,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.756258+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:47.756258+0000","last_peered":"2026-02-24T07:49:47.756258+0000","last_clean":"2026-02-24T07:49:47.756258+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:47.756258+0000","last_undegraded":"2026-02-24T07:49:47.756258+0000","last_fullsized":"2026-02-24T07:49:47.756258+0000","mapping_epoch":41,"log_start":"43'608","ondisk_log_start":"43'608","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":608,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"43'528","reported_seq":542,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.809798+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:47.809798+0000","last_peered":"2026-02-24T07:49:47.809798+0000","last_clean":"2026-02-24T07:49:47.809798+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:47.809798+0000","last_undegraded":"2026-02-24T07:49:47.809798+0000","last_fullsized":"2026-02-24T07:49:47.809798+0000","mapping_epoch":41,"log_start":"43'515","ondisk_log_start":"43'515","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":515,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"43'504","reported_seq":508,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.822570+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:47.822570+0000","last_peered":"2026-02-24T07:49:47.822570+0000","last_clean":"2026-02-24T07:49:47.822570+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:47.822570+0000","last_undegraded":"2026-02-24T07:49:47.822570+0000","last_fullsized":"2026-02-24T07:49:47.822570+0000","mapping_epoch":41,"log_start":"43'494","ondisk_log_start":"43'494","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":494,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"43'440","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.752295+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:47.752295+0000","last_peered":"2026-02-24T07:49:47.752295+0000","last_clean":"2026-02-24T07:49:47.752295+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:47.752295+0000","last_undegraded":"2026-02-24T07:49:47.752295+0000","last_fullsized":"2026-02-24T07:49:47.752295+0000","mapping_epoch":41,"log_start":"43'424","ondisk_log_start":"43'424","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":424,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"43'472","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.753612+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:47.753612+0000","last_peered":"2026-02-24T07:49:47.753612+0000","last_clean":"2026-02-24T07:49:47.753612+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:47.753612+0000","last_undegraded":"2026-02-24T07:49:47.753612+0000","last_fullsized":"2026-02-24T07:49:47.753612+0000","mapping_epoch":41,"log_start":"43'464","ondisk_log_start":"43'464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":464,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"43'568","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.815852+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:47.815852+0000","last_peered":"2026-02-24T07:49:47.815852+0000","last_clean":"2026-02-24T07:49:47.815852+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:47.815852+0000","last_undegraded":"2026-02-24T07:49:47.815852+0000","last_fullsized":"2026-02-24T07:49:47.815852+0000","mapping_epoch":41,"log_start":"43'560","ondisk_log_start":"43'560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":560,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"43'568","reported_seq":582,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.749980+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:47.749980+0000","last_peered":"2026-02-24T07:49:47.749980+0000","last_clean":"2026-02-24T07:49:47.749980+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:47.749980+0000","last_undegraded":"2026-02-24T07:49:47.749980+0000","last_fullsized":"2026-02-24T07:49:47.749980+0000","mapping_epoch":41,"log_start":"43'552","ondisk_log_start":"43'552","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":552,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"43'536","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.725476+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:47.725476+0000","last_peered":"2026-02-24T07:49:47.725476+0000","last_clean":"2026-02-24T07:49:47.725476+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:47.725476+0000","last_undegraded":"2026-02-24T07:49:47.725476+0000","last_fullsized":"2026-02-24T07:49:47.725476+0000","mapping_epoch":41,"log_start":"43'504","ondisk_log_start":"43'504","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":504,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"43'488","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.821012+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:47.821012+0000","last_peered":"2026-02-24T07:49:47.821012+0000","last_clean":"2026-02-24T07:49:47.821012+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:47.821012+0000","last_undegraded":"2026-02-24T07:49:47.821012+0000","last_fullsized":"2026-02-24T07:49:47.821012+0000","mapping_epoch":41,"log_start":"43'478","ondisk_log_start":"43'478","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":478,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.816154+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:47.816154+0000","last_peered":"2026-02-24T07:49:47.816154+0000","last_clean":"2026-02-24T07:49:47.816154+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:47.816154+0000","last_undegraded":"2026-02-24T07:49:47.816154+0000","last_fullsized":"2026-02-24T07:49:47.816154+0000","mapping_epoch":41,"log_start":"43'553","ondisk_log_start":"43'553","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":553,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":233,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.000712+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:47.000712+0000","last_peered":"2026-02-24T07:49:47.000712+0000","last_clean":"2026-02-24T07:49:47.000712+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:47.000712+0000","last_undegraded":"2026-02-24T07:49:47.000712+0000","last_fullsized":"2026-02-24T07:49:47.000712+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215143,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1905716,"kb_used_data":30240,"kb_used_omap":17,"kb_used_meta":1875438,"kb_avail":732097484,"statfs":{"total":751619276800,"available":749667823616,"internally_reserved":0,"allocated":30965760,"data_stored":30692205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17975,"internal_metadata":1920448969},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444072,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1514636,"kb_used_data":51640,"kb_used_omap":21,"kb_used_meta":1462954,"kb_avail":732488564,"statfs":{"total":751619276800,"available":750068289536,"internally_reserved":0,"allocated":52879360,"data_stored":52605805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21806,"internal_metadata":1498065618},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1558536,"kb_used_data":7668,"kb_used_omap":23,"kb_used_meta":1550824,"kb_avail":732444664,"statfs":{"total":751619276800,"available":750023335936,"internally_reserved":0,"allocated":7852032,"data_stored":7582029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1588044593},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1482024,"kb_used_data":980,"kb_used_omap":24,"kb_used_meta":1480999,"kb_avail":732521176,"statfs":{"total":751619276800,"available":750101684224,"internally_reserved":0,"allocated":1003520,"data_stored":737501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25061,"internal_metadata":1516543515},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53755904,"data_stored":53755904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49020928,"data_stored":49020928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58163200,"data_stored":58163200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42401792,"data_stored":42401792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:49.973 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:49:49.974 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:49:49.974 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T07:49:49.974 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:49:49.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 128 31643 31515 82.064 83.2188 0.00702828 0.012159 2026-02-24T07:49:50.119 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:50.248 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:50.246+0000 7f4dc46e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:50.249 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:50.246+0000 7f4dc46e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:50.402 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:49:50.402 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:49:50.448 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2026-02-24T07:49:49.764044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69780000,"num_objects":1059,"num_object_clones":0,"num_object_copies":3177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1059,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":8581,"num_write_kb":69718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6460912,"kb_used_data":90528,"kb_used_omap":86,"kb_used_meta":6370217,"kb_avail":2929551888,"statfs":{"total":3006477107200,"available":2999861133312,"internally_reserved":0,"allocated":92700672,"data_stored":91617540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":88601,"internal_metadata":6523102695},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000506"},"pg_stats":[{"pgid":"3.f","version":"43'498","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.715208+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:47.715208+0000","last_peered":"2026-02-24T07:49:47.715208+0000","last_clean":"2026-02-24T07:49:47.715208+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:47.715208+0000","last_undegraded":"2026-02-24T07:49:47.715208+0000","last_fullsized":"2026-02-24T07:49:47.715208+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":480,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4079616,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":3984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"43'444","reported_seq":450,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.760133+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:47.760133+0000","last_peered":"2026-02-24T07:49:47.760133+0000","last_clean":"2026-02-24T07:49:47.760133+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:47.760133+0000","last_undegraded":"2026-02-24T07:49:47.760133+0000","last_fullsized":"2026-02-24T07:49:47.760133+0000","mapping_epoch":41,"log_start":"43'433","ondisk_log_start":"43'433","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":433,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3637248,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'496","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774237+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:47.774237+0000","last_peered":"2026-02-24T07:49:47.774237+0000","last_clean":"2026-02-24T07:49:47.774237+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:47.774237+0000","last_undegraded":"2026-02-24T07:49:47.774237+0000","last_fullsized":"2026-02-24T07:49:47.774237+0000","mapping_epoch":41,"log_start":"43'480","ondisk_log_start":"43'480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":480,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.765232+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:47.765232+0000","last_peered":"2026-02-24T07:49:47.765232+0000","last_clean":"2026-02-24T07:49:47.765232+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:47.765232+0000","last_undegraded":"2026-02-24T07:49:47.765232+0000","last_fullsized":"2026-02-24T07:49:47.765232+0000","mapping_epoch":41,"log_start":"43'557","ondisk_log_start":"43'557","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":557,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"43'656","reported_seq":662,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.811119+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:47.811119+0000","last_peered":"2026-02-24T07:49:47.811119+0000","last_clean":"2026-02-24T07:49:47.811119+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:47.811119+0000","last_undegraded":"2026-02-24T07:49:47.811119+0000","last_fullsized":"2026-02-24T07:49:47.811119+0000","mapping_epoch":41,"log_start":"43'648","ondisk_log_start":"43'648","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":648,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"43'512","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.774244+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:47.774244+0000","last_peered":"2026-02-24T07:49:47.774244+0000","last_clean":"2026-02-24T07:49:47.774244+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:47.774244+0000","last_undegraded":"2026-02-24T07:49:47.774244+0000","last_fullsized":"2026-02-24T07:49:47.774244+0000","mapping_epoch":41,"log_start":"43'496","ondisk_log_start":"43'496","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":496,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"43'616","reported_seq":630,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.756258+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:47.756258+0000","last_peered":"2026-02-24T07:49:47.756258+0000","last_clean":"2026-02-24T07:49:47.756258+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:47.756258+0000","last_undegraded":"2026-02-24T07:49:47.756258+0000","last_fullsized":"2026-02-24T07:49:47.756258+0000","mapping_epoch":41,"log_start":"43'608","ondisk_log_start":"43'608","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":608,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"43'528","reported_seq":542,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.809798+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:47.809798+0000","last_peered":"2026-02-24T07:49:47.809798+0000","last_clean":"2026-02-24T07:49:47.809798+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:47.809798+0000","last_undegraded":"2026-02-24T07:49:47.809798+0000","last_fullsized":"2026-02-24T07:49:47.809798+0000","mapping_epoch":41,"log_start":"43'515","ondisk_log_start":"43'515","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":515,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"43'504","reported_seq":508,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.822570+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:47.822570+0000","last_peered":"2026-02-24T07:49:47.822570+0000","last_clean":"2026-02-24T07:49:47.822570+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:47.822570+0000","last_undegraded":"2026-02-24T07:49:47.822570+0000","last_fullsized":"2026-02-24T07:49:47.822570+0000","mapping_epoch":41,"log_start":"43'494","ondisk_log_start":"43'494","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":494,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"43'440","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.752295+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:47.752295+0000","last_peered":"2026-02-24T07:49:47.752295+0000","last_clean":"2026-02-24T07:49:47.752295+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:47.752295+0000","last_undegraded":"2026-02-24T07:49:47.752295+0000","last_fullsized":"2026-02-24T07:49:47.752295+0000","mapping_epoch":41,"log_start":"43'424","ondisk_log_start":"43'424","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":424,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"43'472","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.753612+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:47.753612+0000","last_peered":"2026-02-24T07:49:47.753612+0000","last_clean":"2026-02-24T07:49:47.753612+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:47.753612+0000","last_undegraded":"2026-02-24T07:49:47.753612+0000","last_fullsized":"2026-02-24T07:49:47.753612+0000","mapping_epoch":41,"log_start":"43'464","ondisk_log_start":"43'464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":464,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"43'568","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.815852+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:47.815852+0000","last_peered":"2026-02-24T07:49:47.815852+0000","last_clean":"2026-02-24T07:49:47.815852+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:47.815852+0000","last_undegraded":"2026-02-24T07:49:47.815852+0000","last_fullsized":"2026-02-24T07:49:47.815852+0000","mapping_epoch":41,"log_start":"43'560","ondisk_log_start":"43'560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":560,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"43'568","reported_seq":582,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.749980+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:47.749980+0000","last_peered":"2026-02-24T07:49:47.749980+0000","last_clean":"2026-02-24T07:49:47.749980+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:47.749980+0000","last_undegraded":"2026-02-24T07:49:47.749980+0000","last_fullsized":"2026-02-24T07:49:47.749980+0000","mapping_epoch":41,"log_start":"43'552","ondisk_log_start":"43'552","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":552,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"43'536","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.725476+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:47.725476+0000","last_peered":"2026-02-24T07:49:47.725476+0000","last_clean":"2026-02-24T07:49:47.725476+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:47.725476+0000","last_undegraded":"2026-02-24T07:49:47.725476+0000","last_fullsized":"2026-02-24T07:49:47.725476+0000","mapping_epoch":41,"log_start":"43'504","ondisk_log_start":"43'504","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":504,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"43'488","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.821012+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:47.821012+0000","last_peered":"2026-02-24T07:49:47.821012+0000","last_clean":"2026-02-24T07:49:47.821012+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:47.821012+0000","last_undegraded":"2026-02-24T07:49:47.821012+0000","last_fullsized":"2026-02-24T07:49:47.821012+0000","mapping_epoch":41,"log_start":"43'478","ondisk_log_start":"43'478","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":478,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'560","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.816154+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:47.816154+0000","last_peered":"2026-02-24T07:49:47.816154+0000","last_clean":"2026-02-24T07:49:47.816154+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:47.816154+0000","last_undegraded":"2026-02-24T07:49:47.816154+0000","last_fullsized":"2026-02-24T07:49:47.816154+0000","mapping_epoch":41,"log_start":"43'553","ondisk_log_start":"43'553","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":553,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":233,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-24T07:49:47.000712+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:47.000712+0000","last_peered":"2026-02-24T07:49:47.000712+0000","last_clean":"2026-02-24T07:49:47.000712+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:47.000712+0000","last_undegraded":"2026-02-24T07:49:47.000712+0000","last_fullsized":"2026-02-24T07:49:47.000712+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":69189632,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":67568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215143,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1905716,"kb_used_data":30240,"kb_used_omap":17,"kb_used_meta":1875438,"kb_avail":732097484,"statfs":{"total":751619276800,"available":749667823616,"internally_reserved":0,"allocated":30965760,"data_stored":30692205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17975,"internal_metadata":1920448969},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444072,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1514636,"kb_used_data":51640,"kb_used_omap":21,"kb_used_meta":1462954,"kb_avail":732488564,"statfs":{"total":751619276800,"available":750068289536,"internally_reserved":0,"allocated":52879360,"data_stored":52605805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21806,"internal_metadata":1498065618},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1558536,"kb_used_data":7668,"kb_used_omap":23,"kb_used_meta":1550824,"kb_avail":732444664,"statfs":{"total":751619276800,"available":750023335936,"internally_reserved":0,"allocated":7852032,"data_stored":7582029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1588044593},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1482024,"kb_used_data":980,"kb_used_omap":24,"kb_used_meta":1480999,"kb_avail":732521176,"statfs":{"total":751619276800,"available":750101684224,"internally_reserved":0,"allocated":1003520,"data_stored":737501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25061,"internal_metadata":1516543515},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4088,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53755904,"data_stored":53755904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49020928,"data_stored":49020928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58163200,"data_stored":58163200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42401792,"data_stored":42401792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:49:50.450 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:49:50.451 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 26 2026-02-24T07:49:50.639 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:50.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:50.761+0000 7fca5ee0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:50.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:50.761+0000 7fca5ee0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:50.905 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:49:50.908 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:50.947 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:50 trial016 ceph-mon[39544]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:50.947 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:50 trial016 ceph-mon[39544]: pgmap v111: 17 pgs: 17 active+clean; 67 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 16 MiB/s wr, 2.11k op/s 2026-02-24T07:49:50.947 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:50 trial016 ceph-mon[39544]: from='client.14627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:50.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:49:50.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 42425 42297 82.6051 84.2344 0.0136729 0.0120736 2026-02-24T07:49:51.062 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:51.179 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:51.176+0000 7f611bd7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:51.179 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:51.176+0000 7f611bd7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:51.194 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:51.194 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:51.209 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:51.209 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:51.237 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:51.238 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:51.263 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:51.263 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:51.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 52943 52815 82.5171 82.1719 0.00512128 0.0120925 2026-02-24T07:49:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:51 trial016 ceph-mon[39544]: from='client.14629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:49:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1485479710' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:49:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1083907582' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:52.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 64108 63980 83.301 87.2266 0.00806938 0.0119909 2026-02-24T07:49:53.309 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:52 trial016 ceph-mon[39544]: pgmap v112: 17 pgs: 17 active+clean; 67 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 11 MiB/s wr, 1.43k op/s 2026-02-24T07:49:53.459 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:53.590 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:53.587+0000 7f1022793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:53.590 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:53.588+0000 7f1022793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:53.606 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:53.606 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:53.621 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:53.621 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:53.637 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:53.637 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:53.650 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:53.650 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:53.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 128 75099 74971 83.6667 85.8672 0.0071268 0.0119383 2026-02-24T07:49:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/856156016' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:54.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 85693 85565 83.5533 82.7656 0.00147326 0.0119587 2026-02-24T07:49:55.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:49:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:49:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:49:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: pgmap v113: 17 pgs: 17 active+clean; 484 MiB data, 6.4 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 8.97k op/s 2026-02-24T07:49:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:49:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:49:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:49:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:49:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:49:55.698 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:49:55.848 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:55.948 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:49:55.949 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:49:55.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:55.978+0000 7fe42f2e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:55.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:55.978+0000 7fe42f2e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:55.996 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:55.997 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:55.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 127 96402 96275 83.5658 83.6719 0.00841352 0.0119551 2026-02-24T07:49:56.017 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:56.018 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:56.040 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:56.040 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:56.055 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:56.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:56.110 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:56.231 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:56.228+0000 7f9782b7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:56.231 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:56.229+0000 7f9782b7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:56.885 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:49:56.937 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:49:56.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 128 106912 106784 83.419 82.1016 0.0103192 0.0119733 2026-02-24T07:49:57.124 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:57.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:56 trial016 ceph-mon[39544]: pgmap v114: 17 pgs: 17 active+clean; 484 MiB data, 6.4 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.36k op/s 2026-02-24T07:49:57.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3459582579' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:57.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2808922578' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:49:57.247 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:57.245+0000 7f7d9118b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:57.247 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:57.245+0000 7f7d9118b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:57.890 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:49:57.940 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:49:57.999 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 127 117531 117404 83.3775 82.9688 0.0181488 0.0119841 2026-02-24T07:49:58.104 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:49:58.124 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:58.148 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2808922578' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:49:58.148 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:57 trial016 ceph-mon[39544]: osdmap e46: 4 total, 4 up, 4 in 2026-02-24T07:49:58.148 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1340519772' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:49:58.249 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:58.250 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:58.248+0000 7f53877f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:58.250 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:58.248+0000 7f53877f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:58.379 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:58.377+0000 7f54b55f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:58.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:58.377+0000 7f54b55f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:58.398 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:49:58.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:49:58.421 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:49:58.422 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:49:58.447 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:49:58.447 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:49:58.461 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:49:58.461 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:49:58.891 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:49:58.941 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:49:59.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 127 128200 128073 83.3748 83.3516 0.00354296 0.0119853 2026-02-24T07:49:59.092 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:49:59.142 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:58 trial016 ceph-mon[39544]: pgmap v116: 17 pgs: 17 active+clean; 640 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.26k op/s 2026-02-24T07:49:59.142 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1340519772' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:49:59.142 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:58 trial016 ceph-mon[39544]: osdmap e47: 4 total, 4 up, 4 in 2026-02-24T07:49:59.142 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1497517448' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:49:59.142 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/420513453' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:49:59.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:59.215+0000 7f7b38d8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:59.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:49:59.216+0000 7f7b38d8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:49:59.896 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:49:59.945 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:49:59.945 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:00.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 139024 138896 83.465 84.5547 0.00698304 0.0119676 2026-02-24T07:50:00.091 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:00.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/420513453' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:50:00.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:59 trial016 ceph-mon[39544]: osdmap e48: 4 total, 4 up, 4 in 2026-02-24T07:50:00.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:49:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2151006069' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:50:00.220 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.217+0000 7f6c6fa74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.220 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.218+0000 7f6c6fa74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.373 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:00.374 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:00.425 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-24T07:49:59.894872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":943874592,"num_objects":14396,"num_object_clones":0,"num_object_copies":43188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14396,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":115282,"num_write_kb":923326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8540732,"kb_used_data":2652644,"kb_used_omap":81,"kb_used_meta":5887918,"kb_avail":2927472068,"statfs":{"total":3006477107200,"available":2997731397632,"internally_reserved":0,"allocated":2716307456,"data_stored":2715122240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83557,"internal_metadata":6029228443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,10,8,30],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":436723712,"num_objects":6663,"num_object_clones":0,"num_object_copies":19989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53311,"num_write_kb":426488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.130058"},"pg_stats":[{"pgid":"3.f","version":"46'7152","reported_seq":7172,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.755737+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:57.755737+0000","last_peered":"2026-02-24T07:49:57.755737+0000","last_clean":"2026-02-24T07:49:57.755737+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:57.755737+0000","last_undegraded":"2026-02-24T07:49:57.755737+0000","last_fullsized":"2026-02-24T07:49:57.755737+0000","mapping_epoch":41,"log_start":"46'7149","ondisk_log_start":"46'7149","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":57216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"46'7600","reported_seq":7620,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.741175+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:57.741175+0000","last_peered":"2026-02-24T07:49:57.741175+0000","last_clean":"2026-02-24T07:49:57.741175+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:57.741175+0000","last_undegraded":"2026-02-24T07:49:57.741175+0000","last_fullsized":"2026-02-24T07:49:57.741175+0000","mapping_epoch":41,"log_start":"46'7592","ondisk_log_start":"46'7592","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62259200,"num_objects":950,"num_object_clones":0,"num_object_copies":2850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7600,"num_write_kb":60800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"46'7288","reported_seq":7308,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.775116+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:57.775116+0000","last_peered":"2026-02-24T07:49:57.775116+0000","last_clean":"2026-02-24T07:49:57.775116+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:57.775116+0000","last_undegraded":"2026-02-24T07:49:57.775116+0000","last_fullsized":"2026-02-24T07:49:57.775116+0000","mapping_epoch":41,"log_start":"46'7280","ondisk_log_start":"46'7280","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7288,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"46'7232","reported_seq":7252,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.773812+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:57.773812+0000","last_peered":"2026-02-24T07:49:57.773812+0000","last_clean":"2026-02-24T07:49:57.773812+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:57.773812+0000","last_undegraded":"2026-02-24T07:49:57.773812+0000","last_fullsized":"2026-02-24T07:49:57.773812+0000","mapping_epoch":41,"log_start":"46'7224","ondisk_log_start":"46'7224","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7232,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.819518+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:57.819518+0000","last_peered":"2026-02-24T07:49:57.819518+0000","last_clean":"2026-02-24T07:49:57.819518+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:57.819518+0000","last_undegraded":"2026-02-24T07:49:57.819518+0000","last_fullsized":"2026-02-24T07:49:57.819518+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'7411","reported_seq":7423,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.776100+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:57.776100+0000","last_peered":"2026-02-24T07:49:57.776100+0000","last_clean":"2026-02-24T07:49:57.776100+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:57.776100+0000","last_undegraded":"2026-02-24T07:49:57.776100+0000","last_fullsized":"2026-02-24T07:49:57.776100+0000","mapping_epoch":41,"log_start":"46'7402","ondisk_log_start":"46'7402","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60710912,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7411,"num_write_kb":59288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.774830+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:57.774830+0000","last_peered":"2026-02-24T07:49:57.774830+0000","last_clean":"2026-02-24T07:49:57.774830+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:57.774830+0000","last_undegraded":"2026-02-24T07:49:57.774830+0000","last_fullsized":"2026-02-24T07:49:57.774830+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"46'7368","reported_seq":7381,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.821644+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:57.821644+0000","last_peered":"2026-02-24T07:49:57.821644+0000","last_clean":"2026-02-24T07:49:57.821644+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:57.821644+0000","last_undegraded":"2026-02-24T07:49:57.821644+0000","last_fullsized":"2026-02-24T07:49:57.821644+0000","mapping_epoch":41,"log_start":"46'7360","ondisk_log_start":"46'7360","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60358656,"num_objects":921,"num_object_clones":0,"num_object_copies":2763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7368,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"46'7240","reported_seq":7260,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.826190+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:57.826190+0000","last_peered":"2026-02-24T07:49:57.826190+0000","last_clean":"2026-02-24T07:49:57.826190+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:57.826190+0000","last_undegraded":"2026-02-24T07:49:57.826190+0000","last_fullsized":"2026-02-24T07:49:57.826190+0000","mapping_epoch":41,"log_start":"46'7232","ondisk_log_start":"46'7232","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59310080,"num_objects":905,"num_object_clones":0,"num_object_copies":2715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7240,"num_write_kb":57920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"46'6960","reported_seq":6980,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719459+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:57.719459+0000","last_peered":"2026-02-24T07:49:57.719459+0000","last_clean":"2026-02-24T07:49:57.719459+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:57.719459+0000","last_undegraded":"2026-02-24T07:49:57.719459+0000","last_fullsized":"2026-02-24T07:49:57.719459+0000","mapping_epoch":41,"log_start":"46'6954","ondisk_log_start":"46'6954","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6960,"num_write_kb":55680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"46'6744","reported_seq":6764,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.751711+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:57.751711+0000","last_peered":"2026-02-24T07:49:57.751711+0000","last_clean":"2026-02-24T07:49:57.751711+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:57.751711+0000","last_undegraded":"2026-02-24T07:49:57.751711+0000","last_fullsized":"2026-02-24T07:49:57.751711+0000","mapping_epoch":41,"log_start":"46'6736","ondisk_log_start":"46'6736","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55246848,"num_objects":843,"num_object_clones":0,"num_object_copies":2529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6744,"num_write_kb":53952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"46'6888","reported_seq":6908,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.809298+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:57.809298+0000","last_peered":"2026-02-24T07:49:57.809298+0000","last_clean":"2026-02-24T07:49:57.809298+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:57.809298+0000","last_undegraded":"2026-02-24T07:49:57.809298+0000","last_fullsized":"2026-02-24T07:49:57.809298+0000","mapping_epoch":41,"log_start":"46'6883","ondisk_log_start":"46'6883","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6888,"num_write_kb":55104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"46'7328","reported_seq":7348,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719454+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:57.719454+0000","last_peered":"2026-02-24T07:49:57.719454+0000","last_clean":"2026-02-24T07:49:57.719454+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:57.719454+0000","last_undegraded":"2026-02-24T07:49:57.719454+0000","last_fullsized":"2026-02-24T07:49:57.719454+0000","mapping_epoch":41,"log_start":"46'7313","ondisk_log_start":"46'7313","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7328,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"46'7136","reported_seq":7156,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.722242+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:57.722242+0000","last_peered":"2026-02-24T07:49:57.722242+0000","last_clean":"2026-02-24T07:49:57.722242+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:57.722242+0000","last_undegraded":"2026-02-24T07:49:57.722242+0000","last_fullsized":"2026-02-24T07:49:57.722242+0000","mapping_epoch":41,"log_start":"46'7128","ondisk_log_start":"46'7128","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7136,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"46'7208","reported_seq":7228,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.815541+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:57.815541+0000","last_peered":"2026-02-24T07:49:57.815541+0000","last_clean":"2026-02-24T07:49:57.815541+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:57.815541+0000","last_undegraded":"2026-02-24T07:49:57.815541+0000","last_fullsized":"2026-02-24T07:49:57.815541+0000","mapping_epoch":41,"log_start":"46'7200","ondisk_log_start":"46'7200","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7208,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'6872","reported_seq":6892,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.827237+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:57.827237+0000","last_peered":"2026-02-24T07:49:57.827237+0000","last_clean":"2026-02-24T07:49:57.827237+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:57.827237+0000","last_undegraded":"2026-02-24T07:49:57.827237+0000","last_fullsized":"2026-02-24T07:49:57.827237+0000","mapping_epoch":41,"log_start":"46'6864","ondisk_log_start":"46'6864","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6872,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":239,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:56.886086+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:56.886086+0000","last_peered":"2026-02-24T07:49:56.886086+0000","last_clean":"2026-02-24T07:49:56.886086+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:56.886086+0000","last_undegraded":"2026-02-24T07:49:56.886086+0000","last_fullsized":"2026-02-24T07:49:56.886086+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":943284224,"num_objects":14394,"num_object_clones":0,"num_object_copies":43182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115147,"num_write_kb":921176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2828943360,"data_stored":2828943360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215145,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1291928,"kb_used_data":571324,"kb_used_omap":4,"kb_used_meta":720571,"kb_avail":732711272,"statfs":{"total":751619276800,"available":750296342528,"internally_reserved":0,"allocated":585035776,"data_stored":584738584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5119,"internal_metadata":737864705},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,8,8,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2492312,"kb_used_data":792196,"kb_used_omap":23,"kb_used_meta":1700072,"kb_avail":731510888,"statfs":{"total":751619276800,"available":749067149312,"internally_reserved":0,"allocated":811208704,"data_stored":810911512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1740874545},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2363404,"kb_used_data":595960,"kb_used_omap":25,"kb_used_meta":1767398,"kb_avail":731639796,"statfs":{"total":751619276800,"available":749199151104,"internally_reserved":0,"allocated":610263040,"data_stored":609969400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1809815813},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,2,0,19],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2393088,"kb_used_data":693164,"kb_used_omap":27,"kb_used_meta":1699876,"kb_avail":731610112,"statfs":{"total":751619276800,"available":749168754688,"internally_reserved":0,"allocated":709799936,"data_stored":709502744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":1740673380},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":761987072,"data_stored":761987072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":651878400,"data_stored":651878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823394304,"data_stored":823394304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":591683584,"data_stored":591683584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:00.427 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:00.505 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:00.582 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:00.662 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:00.722 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.719+0000 7f20fa024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.722 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.720+0000 7f20fa024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.789+0000 7ff9dd8c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.792 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:00.789+0000 7ff9dd8c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:00.810 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:00.810 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:00.834 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:00.834 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:00.847 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:00.848 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:00.865 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:00.866 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:00.881 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:00.881 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:00.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:00 trial016 ceph-mon[39544]: pgmap v119: 17 pgs: 17 active+clean; 900 MiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s wr, 8.88k op/s 2026-02-24T07:50:00.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2151006069' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:50:00.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:00 trial016 ceph-mon[39544]: osdmap e49: 4 total, 4 up, 4 in 2026-02-24T07:50:00.915 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/905950950' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:00.937 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-24T07:49:59.894872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":943874592,"num_objects":14396,"num_object_clones":0,"num_object_copies":43188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14396,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":115282,"num_write_kb":923326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8540732,"kb_used_data":2652644,"kb_used_omap":81,"kb_used_meta":5887918,"kb_avail":2927472068,"statfs":{"total":3006477107200,"available":2997731397632,"internally_reserved":0,"allocated":2716307456,"data_stored":2715122240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83557,"internal_metadata":6029228443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,10,8,30],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":436723712,"num_objects":6663,"num_object_clones":0,"num_object_copies":19989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53311,"num_write_kb":426488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.130058"},"pg_stats":[{"pgid":"3.f","version":"46'7152","reported_seq":7172,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.755737+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:57.755737+0000","last_peered":"2026-02-24T07:49:57.755737+0000","last_clean":"2026-02-24T07:49:57.755737+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:57.755737+0000","last_undegraded":"2026-02-24T07:49:57.755737+0000","last_fullsized":"2026-02-24T07:49:57.755737+0000","mapping_epoch":41,"log_start":"46'7149","ondisk_log_start":"46'7149","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":57216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"46'7600","reported_seq":7620,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.741175+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:57.741175+0000","last_peered":"2026-02-24T07:49:57.741175+0000","last_clean":"2026-02-24T07:49:57.741175+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:57.741175+0000","last_undegraded":"2026-02-24T07:49:57.741175+0000","last_fullsized":"2026-02-24T07:49:57.741175+0000","mapping_epoch":41,"log_start":"46'7592","ondisk_log_start":"46'7592","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62259200,"num_objects":950,"num_object_clones":0,"num_object_copies":2850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7600,"num_write_kb":60800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"46'7288","reported_seq":7308,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.775116+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:57.775116+0000","last_peered":"2026-02-24T07:49:57.775116+0000","last_clean":"2026-02-24T07:49:57.775116+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:57.775116+0000","last_undegraded":"2026-02-24T07:49:57.775116+0000","last_fullsized":"2026-02-24T07:49:57.775116+0000","mapping_epoch":41,"log_start":"46'7280","ondisk_log_start":"46'7280","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7288,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"46'7232","reported_seq":7252,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.773812+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:57.773812+0000","last_peered":"2026-02-24T07:49:57.773812+0000","last_clean":"2026-02-24T07:49:57.773812+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:57.773812+0000","last_undegraded":"2026-02-24T07:49:57.773812+0000","last_fullsized":"2026-02-24T07:49:57.773812+0000","mapping_epoch":41,"log_start":"46'7224","ondisk_log_start":"46'7224","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7232,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.819518+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:57.819518+0000","last_peered":"2026-02-24T07:49:57.819518+0000","last_clean":"2026-02-24T07:49:57.819518+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:57.819518+0000","last_undegraded":"2026-02-24T07:49:57.819518+0000","last_fullsized":"2026-02-24T07:49:57.819518+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'7411","reported_seq":7423,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.776100+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:57.776100+0000","last_peered":"2026-02-24T07:49:57.776100+0000","last_clean":"2026-02-24T07:49:57.776100+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:57.776100+0000","last_undegraded":"2026-02-24T07:49:57.776100+0000","last_fullsized":"2026-02-24T07:49:57.776100+0000","mapping_epoch":41,"log_start":"46'7402","ondisk_log_start":"46'7402","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60710912,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7411,"num_write_kb":59288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.774830+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:57.774830+0000","last_peered":"2026-02-24T07:49:57.774830+0000","last_clean":"2026-02-24T07:49:57.774830+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:57.774830+0000","last_undegraded":"2026-02-24T07:49:57.774830+0000","last_fullsized":"2026-02-24T07:49:57.774830+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"46'7368","reported_seq":7381,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.821644+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:57.821644+0000","last_peered":"2026-02-24T07:49:57.821644+0000","last_clean":"2026-02-24T07:49:57.821644+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:57.821644+0000","last_undegraded":"2026-02-24T07:49:57.821644+0000","last_fullsized":"2026-02-24T07:49:57.821644+0000","mapping_epoch":41,"log_start":"46'7360","ondisk_log_start":"46'7360","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60358656,"num_objects":921,"num_object_clones":0,"num_object_copies":2763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7368,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"46'7240","reported_seq":7260,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.826190+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:57.826190+0000","last_peered":"2026-02-24T07:49:57.826190+0000","last_clean":"2026-02-24T07:49:57.826190+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:57.826190+0000","last_undegraded":"2026-02-24T07:49:57.826190+0000","last_fullsized":"2026-02-24T07:49:57.826190+0000","mapping_epoch":41,"log_start":"46'7232","ondisk_log_start":"46'7232","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59310080,"num_objects":905,"num_object_clones":0,"num_object_copies":2715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7240,"num_write_kb":57920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"46'6960","reported_seq":6980,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719459+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:57.719459+0000","last_peered":"2026-02-24T07:49:57.719459+0000","last_clean":"2026-02-24T07:49:57.719459+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:57.719459+0000","last_undegraded":"2026-02-24T07:49:57.719459+0000","last_fullsized":"2026-02-24T07:49:57.719459+0000","mapping_epoch":41,"log_start":"46'6954","ondisk_log_start":"46'6954","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6960,"num_write_kb":55680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"46'6744","reported_seq":6764,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.751711+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:57.751711+0000","last_peered":"2026-02-24T07:49:57.751711+0000","last_clean":"2026-02-24T07:49:57.751711+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:57.751711+0000","last_undegraded":"2026-02-24T07:49:57.751711+0000","last_fullsized":"2026-02-24T07:49:57.751711+0000","mapping_epoch":41,"log_start":"46'6736","ondisk_log_start":"46'6736","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55246848,"num_objects":843,"num_object_clones":0,"num_object_copies":2529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6744,"num_write_kb":53952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"46'6888","reported_seq":6908,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.809298+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:57.809298+0000","last_peered":"2026-02-24T07:49:57.809298+0000","last_clean":"2026-02-24T07:49:57.809298+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:57.809298+0000","last_undegraded":"2026-02-24T07:49:57.809298+0000","last_fullsized":"2026-02-24T07:49:57.809298+0000","mapping_epoch":41,"log_start":"46'6883","ondisk_log_start":"46'6883","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6888,"num_write_kb":55104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"46'7328","reported_seq":7348,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719454+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:57.719454+0000","last_peered":"2026-02-24T07:49:57.719454+0000","last_clean":"2026-02-24T07:49:57.719454+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:57.719454+0000","last_undegraded":"2026-02-24T07:49:57.719454+0000","last_fullsized":"2026-02-24T07:49:57.719454+0000","mapping_epoch":41,"log_start":"46'7313","ondisk_log_start":"46'7313","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7328,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"46'7136","reported_seq":7156,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.722242+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:57.722242+0000","last_peered":"2026-02-24T07:49:57.722242+0000","last_clean":"2026-02-24T07:49:57.722242+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:57.722242+0000","last_undegraded":"2026-02-24T07:49:57.722242+0000","last_fullsized":"2026-02-24T07:49:57.722242+0000","mapping_epoch":41,"log_start":"46'7128","ondisk_log_start":"46'7128","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7136,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"46'7208","reported_seq":7228,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.815541+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:57.815541+0000","last_peered":"2026-02-24T07:49:57.815541+0000","last_clean":"2026-02-24T07:49:57.815541+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:57.815541+0000","last_undegraded":"2026-02-24T07:49:57.815541+0000","last_fullsized":"2026-02-24T07:49:57.815541+0000","mapping_epoch":41,"log_start":"46'7200","ondisk_log_start":"46'7200","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7208,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'6872","reported_seq":6892,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.827237+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:57.827237+0000","last_peered":"2026-02-24T07:49:57.827237+0000","last_clean":"2026-02-24T07:49:57.827237+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:57.827237+0000","last_undegraded":"2026-02-24T07:49:57.827237+0000","last_fullsized":"2026-02-24T07:49:57.827237+0000","mapping_epoch":41,"log_start":"46'6864","ondisk_log_start":"46'6864","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6872,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":239,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:56.886086+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:56.886086+0000","last_peered":"2026-02-24T07:49:56.886086+0000","last_clean":"2026-02-24T07:49:56.886086+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:56.886086+0000","last_undegraded":"2026-02-24T07:49:56.886086+0000","last_fullsized":"2026-02-24T07:49:56.886086+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":943284224,"num_objects":14394,"num_object_clones":0,"num_object_copies":43182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115147,"num_write_kb":921176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2828943360,"data_stored":2828943360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215145,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1291928,"kb_used_data":571324,"kb_used_omap":4,"kb_used_meta":720571,"kb_avail":732711272,"statfs":{"total":751619276800,"available":750296342528,"internally_reserved":0,"allocated":585035776,"data_stored":584738584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5119,"internal_metadata":737864705},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,8,8,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2492312,"kb_used_data":792196,"kb_used_omap":23,"kb_used_meta":1700072,"kb_avail":731510888,"statfs":{"total":751619276800,"available":749067149312,"internally_reserved":0,"allocated":811208704,"data_stored":810911512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1740874545},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2363404,"kb_used_data":595960,"kb_used_omap":25,"kb_used_meta":1767398,"kb_avail":731639796,"statfs":{"total":751619276800,"available":749199151104,"internally_reserved":0,"allocated":610263040,"data_stored":609969400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1809815813},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,2,0,19],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2393088,"kb_used_data":693164,"kb_used_omap":27,"kb_used_meta":1699876,"kb_avail":731610112,"statfs":{"total":751619276800,"available":749168754688,"internally_reserved":0,"allocated":709799936,"data_stored":709502744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":1740673380},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":761987072,"data_stored":761987072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":651878400,"data_stored":651878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823394304,"data_stored":823394304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":591683584,"data_stored":591683584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:00.939 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:50:00.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:00.940 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T07:50:00.940 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:01.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 127 149891 149764 83.5675 84.9062 0.0174745 0.0119543 2026-02-24T07:50:01.127 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:01.250 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:01.248+0000 7f717b36a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:01.251 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:01.248+0000 7f717b36a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:01.395 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:01.396 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:01.441 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-24T07:49:59.894872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":943874592,"num_objects":14396,"num_object_clones":0,"num_object_copies":43188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14396,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":115282,"num_write_kb":923326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8540732,"kb_used_data":2652644,"kb_used_omap":81,"kb_used_meta":5887918,"kb_avail":2927472068,"statfs":{"total":3006477107200,"available":2997731397632,"internally_reserved":0,"allocated":2716307456,"data_stored":2715122240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83557,"internal_metadata":6029228443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,10,8,30],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":436723712,"num_objects":6663,"num_object_clones":0,"num_object_copies":19989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53311,"num_write_kb":426488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.130058"},"pg_stats":[{"pgid":"3.f","version":"46'7152","reported_seq":7172,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.755737+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:49:57.755737+0000","last_peered":"2026-02-24T07:49:57.755737+0000","last_clean":"2026-02-24T07:49:57.755737+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:49:57.755737+0000","last_undegraded":"2026-02-24T07:49:57.755737+0000","last_fullsized":"2026-02-24T07:49:57.755737+0000","mapping_epoch":41,"log_start":"46'7149","ondisk_log_start":"46'7149","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":57216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"46'7600","reported_seq":7620,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.741175+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:49:57.741175+0000","last_peered":"2026-02-24T07:49:57.741175+0000","last_clean":"2026-02-24T07:49:57.741175+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:49:57.741175+0000","last_undegraded":"2026-02-24T07:49:57.741175+0000","last_fullsized":"2026-02-24T07:49:57.741175+0000","mapping_epoch":41,"log_start":"46'7592","ondisk_log_start":"46'7592","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62259200,"num_objects":950,"num_object_clones":0,"num_object_copies":2850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7600,"num_write_kb":60800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"46'7288","reported_seq":7308,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.775116+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:49:57.775116+0000","last_peered":"2026-02-24T07:49:57.775116+0000","last_clean":"2026-02-24T07:49:57.775116+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:49:57.775116+0000","last_undegraded":"2026-02-24T07:49:57.775116+0000","last_fullsized":"2026-02-24T07:49:57.775116+0000","mapping_epoch":41,"log_start":"46'7280","ondisk_log_start":"46'7280","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7288,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"46'7232","reported_seq":7252,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.773812+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:49:57.773812+0000","last_peered":"2026-02-24T07:49:57.773812+0000","last_clean":"2026-02-24T07:49:57.773812+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:49:57.773812+0000","last_undegraded":"2026-02-24T07:49:57.773812+0000","last_fullsized":"2026-02-24T07:49:57.773812+0000","mapping_epoch":41,"log_start":"46'7224","ondisk_log_start":"46'7224","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7232,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.819518+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:49:57.819518+0000","last_peered":"2026-02-24T07:49:57.819518+0000","last_clean":"2026-02-24T07:49:57.819518+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:49:57.819518+0000","last_undegraded":"2026-02-24T07:49:57.819518+0000","last_fullsized":"2026-02-24T07:49:57.819518+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'7411","reported_seq":7423,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.776100+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:49:57.776100+0000","last_peered":"2026-02-24T07:49:57.776100+0000","last_clean":"2026-02-24T07:49:57.776100+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:49:57.776100+0000","last_undegraded":"2026-02-24T07:49:57.776100+0000","last_fullsized":"2026-02-24T07:49:57.776100+0000","mapping_epoch":41,"log_start":"46'7402","ondisk_log_start":"46'7402","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60710912,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7411,"num_write_kb":59288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"46'7360","reported_seq":7380,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.774830+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:49:57.774830+0000","last_peered":"2026-02-24T07:49:57.774830+0000","last_clean":"2026-02-24T07:49:57.774830+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:49:57.774830+0000","last_undegraded":"2026-02-24T07:49:57.774830+0000","last_fullsized":"2026-02-24T07:49:57.774830+0000","mapping_epoch":41,"log_start":"46'7352","ondisk_log_start":"46'7352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7360,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"46'7368","reported_seq":7381,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.821644+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:49:57.821644+0000","last_peered":"2026-02-24T07:49:57.821644+0000","last_clean":"2026-02-24T07:49:57.821644+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:49:57.821644+0000","last_undegraded":"2026-02-24T07:49:57.821644+0000","last_fullsized":"2026-02-24T07:49:57.821644+0000","mapping_epoch":41,"log_start":"46'7360","ondisk_log_start":"46'7360","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60358656,"num_objects":921,"num_object_clones":0,"num_object_copies":2763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7368,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"46'7240","reported_seq":7260,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.826190+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:49:57.826190+0000","last_peered":"2026-02-24T07:49:57.826190+0000","last_clean":"2026-02-24T07:49:57.826190+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:49:57.826190+0000","last_undegraded":"2026-02-24T07:49:57.826190+0000","last_fullsized":"2026-02-24T07:49:57.826190+0000","mapping_epoch":41,"log_start":"46'7232","ondisk_log_start":"46'7232","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59310080,"num_objects":905,"num_object_clones":0,"num_object_copies":2715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7240,"num_write_kb":57920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"46'6960","reported_seq":6980,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719459+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:49:57.719459+0000","last_peered":"2026-02-24T07:49:57.719459+0000","last_clean":"2026-02-24T07:49:57.719459+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:49:57.719459+0000","last_undegraded":"2026-02-24T07:49:57.719459+0000","last_fullsized":"2026-02-24T07:49:57.719459+0000","mapping_epoch":41,"log_start":"46'6954","ondisk_log_start":"46'6954","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6960,"num_write_kb":55680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"46'6744","reported_seq":6764,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.751711+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:49:57.751711+0000","last_peered":"2026-02-24T07:49:57.751711+0000","last_clean":"2026-02-24T07:49:57.751711+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:49:57.751711+0000","last_undegraded":"2026-02-24T07:49:57.751711+0000","last_fullsized":"2026-02-24T07:49:57.751711+0000","mapping_epoch":41,"log_start":"46'6736","ondisk_log_start":"46'6736","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55246848,"num_objects":843,"num_object_clones":0,"num_object_copies":2529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6744,"num_write_kb":53952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"46'6888","reported_seq":6908,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.809298+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:49:57.809298+0000","last_peered":"2026-02-24T07:49:57.809298+0000","last_clean":"2026-02-24T07:49:57.809298+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:49:57.809298+0000","last_undegraded":"2026-02-24T07:49:57.809298+0000","last_fullsized":"2026-02-24T07:49:57.809298+0000","mapping_epoch":41,"log_start":"46'6883","ondisk_log_start":"46'6883","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6888,"num_write_kb":55104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"46'7328","reported_seq":7348,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.719454+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:49:57.719454+0000","last_peered":"2026-02-24T07:49:57.719454+0000","last_clean":"2026-02-24T07:49:57.719454+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:49:57.719454+0000","last_undegraded":"2026-02-24T07:49:57.719454+0000","last_fullsized":"2026-02-24T07:49:57.719454+0000","mapping_epoch":41,"log_start":"46'7313","ondisk_log_start":"46'7313","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7328,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"46'7136","reported_seq":7156,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.722242+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:49:57.722242+0000","last_peered":"2026-02-24T07:49:57.722242+0000","last_clean":"2026-02-24T07:49:57.722242+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:49:57.722242+0000","last_undegraded":"2026-02-24T07:49:57.722242+0000","last_fullsized":"2026-02-24T07:49:57.722242+0000","mapping_epoch":41,"log_start":"46'7128","ondisk_log_start":"46'7128","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7136,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"46'7208","reported_seq":7228,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.815541+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:49:57.815541+0000","last_peered":"2026-02-24T07:49:57.815541+0000","last_clean":"2026-02-24T07:49:57.815541+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:49:57.815541+0000","last_undegraded":"2026-02-24T07:49:57.815541+0000","last_fullsized":"2026-02-24T07:49:57.815541+0000","mapping_epoch":41,"log_start":"46'7200","ondisk_log_start":"46'7200","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7208,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'6872","reported_seq":6892,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:57.827237+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:49:57.827237+0000","last_peered":"2026-02-24T07:49:57.827237+0000","last_clean":"2026-02-24T07:49:57.827237+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:49:57.827237+0000","last_undegraded":"2026-02-24T07:49:57.827237+0000","last_fullsized":"2026-02-24T07:49:57.827237+0000","mapping_epoch":41,"log_start":"46'6864","ondisk_log_start":"46'6864","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6872,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":239,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-24T07:49:56.886086+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:56.886086+0000","last_peered":"2026-02-24T07:49:56.886086+0000","last_clean":"2026-02-24T07:49:56.886086+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:56.886086+0000","last_undegraded":"2026-02-24T07:49:56.886086+0000","last_fullsized":"2026-02-24T07:49:56.886086+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":943284224,"num_objects":14394,"num_object_clones":0,"num_object_copies":43182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115147,"num_write_kb":921176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2828943360,"data_stored":2828943360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215145,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1291928,"kb_used_data":571324,"kb_used_omap":4,"kb_used_meta":720571,"kb_avail":732711272,"statfs":{"total":751619276800,"available":750296342528,"internally_reserved":0,"allocated":585035776,"data_stored":584738584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5119,"internal_metadata":737864705},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,8,8,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2492312,"kb_used_data":792196,"kb_used_omap":23,"kb_used_meta":1700072,"kb_avail":731510888,"statfs":{"total":751619276800,"available":749067149312,"internally_reserved":0,"allocated":811208704,"data_stored":810911512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1740874545},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2363404,"kb_used_data":595960,"kb_used_omap":25,"kb_used_meta":1767398,"kb_avail":731639796,"statfs":{"total":751619276800,"available":749199151104,"internally_reserved":0,"allocated":610263040,"data_stored":609969400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1809815813},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,2,0,19],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2393088,"kb_used_data":693164,"kb_used_omap":27,"kb_used_meta":1699876,"kb_avail":731610112,"statfs":{"total":751619276800,"available":749168754688,"internally_reserved":0,"allocated":709799936,"data_stored":709502744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":1740673380},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":761987072,"data_stored":761987072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":651878400,"data_stored":651878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823394304,"data_stored":823394304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":591683584,"data_stored":591683584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:01.444 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 26 2026-02-24T07:50:01.630 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:01.765 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:01.762+0000 7f6158b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:01.765 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:01.762+0000 7f6158b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:01.927 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:50:01.945 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:01 trial016 ceph-mon[39544]: from='client.14649 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:01.945 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:01 trial016 ceph-mon[39544]: from='client.14651 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:01.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:02.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 159995 159867 83.2579 78.9297 0.0010871 0.0120014 2026-02-24T07:50:02.921 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:03.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 127 170268 170141 83.0706 80.2656 0.0204664 0.0120293 2026-02-24T07:50:03.069 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:03.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:02 trial016 ceph-mon[39544]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:03.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:02 trial016 ceph-mon[39544]: pgmap v121: 17 pgs: 17 active+clean; 900 MiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.92k op/s 2026-02-24T07:50:03.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3134865145' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T07:50:03.699 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:03.613+0000 7fb351db9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:03.699 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:03.614+0000 7fb351db9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:03.699 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:03.699 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:03.700 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:03.700 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:03.700 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:03.700 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:03.700 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:03.701 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:04.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 178588 178460 82.0068 64.9922 0.0367457 0.0121853 2026-02-24T07:50:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1698442392' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:05.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 127 188094 187967 81.5769 74.2734 0.0196209 0.0122511 2026-02-24T07:50:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:04 trial016 ceph-mon[39544]: pgmap v122: 17 pgs: 17 active+clean; 1.3 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 112 MiB/s wr, 14.37k op/s 2026-02-24T07:50:05.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:06.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 128 198706 198578 81.6461 82.8984 0.0214963 0.0122403 2026-02-24T07:50:06.469 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:06.614 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:06.970 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:06.970 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:06.971 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:07.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:50:06.999555+0000 min lat: 0.000643634 max lat: 0.0736012 avg lat: 0.0123108 2026-02-24T07:50:07.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:50:07.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 127 207723 207596 81.0862 70.4531 0.0354472 0.0123108 2026-02-24T07:50:07.061 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:06 trial016 ceph-mon[39544]: pgmap v123: 17 pgs: 17 active+clean; 1.3 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.72k op/s 2026-02-24T07:50:07.189 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:07.189 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:07.189 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:07.190 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:07.114+0000 7f2f8df30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:07.190 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:07.114+0000 7f2f8df30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:07.190 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:07.190 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:07.190 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:07.197 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:07.197 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:07.852 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:08.000 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 215841 215713 80.2444 63.4141 0.0116393 0.0124534 2026-02-24T07:50:08.178 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2612850057' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:08.614 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:08.558+0000 7fa1440fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:08.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:08.559+0000 7fa1440fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:08.713 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:08.713 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:09.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 127 224030 223903 79.5051 63.9844 0.0087373 0.0125722 2026-02-24T07:50:09.093 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:08 trial016 ceph-mon[39544]: pgmap v124: 17 pgs: 17 active+clean; 1.4 GiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.90k op/s 2026-02-24T07:50:09.420 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2026-02-24T07:50:07.766358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1518666272,"num_objects":23166,"num_object_clones":0,"num_object_copies":69498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23166,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":185447,"num_write_kb":1484646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":239,"ondisk_log_size":239,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8387020,"kb_used_data":4556028,"kb_used_omap":43,"kb_used_meta":3830868,"kb_avail":2927625780,"statfs":{"total":3006477107200,"available":2997888798720,"internally_reserved":0,"allocated":4665372672,"data_stored":4664092908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44294,"internal_metadata":3922809594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,7,15],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":574791680,"num_objects":8770,"num_object_clones":0,"num_object_copies":26310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70165,"num_write_kb":561320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.876254"},"pg_stats":[{"pgid":"3.f","version":"49'13408","reported_seq":13434,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.761113+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:07.761113+0000","last_peered":"2026-02-24T07:50:07.761113+0000","last_clean":"2026-02-24T07:50:07.761113+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:07.761113+0000","last_undegraded":"2026-02-24T07:50:07.761113+0000","last_fullsized":"2026-02-24T07:50:07.761113+0000","mapping_epoch":41,"log_start":"49'13405","ondisk_log_start":"49'13405","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109838336,"num_objects":1676,"num_object_clones":0,"num_object_copies":5028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13408,"num_write_kb":107264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'13544","reported_seq":13561,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.763194+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:07.763194+0000","last_peered":"2026-02-24T07:50:07.763194+0000","last_clean":"2026-02-24T07:50:07.763194+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:07.763194+0000","last_undegraded":"2026-02-24T07:50:07.763194+0000","last_fullsized":"2026-02-24T07:50:07.763194+0000","mapping_epoch":41,"log_start":"49'13512","ondisk_log_start":"49'13512","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110952448,"num_objects":1693,"num_object_clones":0,"num_object_copies":5079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13544,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'10584","reported_seq":10610,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.765081+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:02.765081+0000","last_peered":"2026-02-24T07:50:02.765081+0000","last_clean":"2026-02-24T07:50:02.765081+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:02.765081+0000","last_undegraded":"2026-02-24T07:50:02.765081+0000","last_fullsized":"2026-02-24T07:50:02.765081+0000","mapping_epoch":41,"log_start":"49'10579","ondisk_log_start":"49'10579","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":1323,"num_object_clones":0,"num_object_copies":3969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10584,"num_write_kb":84672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'10600","reported_seq":10622,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.777951+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:02.777951+0000","last_peered":"2026-02-24T07:50:02.777951+0000","last_clean":"2026-02-24T07:50:02.777951+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:02.777951+0000","last_undegraded":"2026-02-24T07:50:02.777951+0000","last_fullsized":"2026-02-24T07:50:02.777951+0000","mapping_epoch":41,"log_start":"49'10592","ondisk_log_start":"49'10592","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86835200,"num_objects":1325,"num_object_clones":0,"num_object_copies":3975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10600,"num_write_kb":84800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'10416","reported_seq":10442,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.826161+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:02.826161+0000","last_peered":"2026-02-24T07:50:02.826161+0000","last_clean":"2026-02-24T07:50:02.826161+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:02.826161+0000","last_undegraded":"2026-02-24T07:50:02.826161+0000","last_fullsized":"2026-02-24T07:50:02.826161+0000","mapping_epoch":41,"log_start":"49'10408","ondisk_log_start":"49'10408","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85327872,"num_objects":1302,"num_object_clones":0,"num_object_copies":3906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10416,"num_write_kb":83328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'10448","reported_seq":10474,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.770748+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:02.770748+0000","last_peered":"2026-02-24T07:50:02.770748+0000","last_clean":"2026-02-24T07:50:02.770748+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:02.770748+0000","last_undegraded":"2026-02-24T07:50:02.770748+0000","last_fullsized":"2026-02-24T07:50:02.770748+0000","mapping_epoch":41,"log_start":"49'10440","ondisk_log_start":"49'10440","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85590016,"num_objects":1306,"num_object_clones":0,"num_object_copies":3918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10448,"num_write_kb":83584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'10648","reported_seq":10674,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.755802+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:02.755802+0000","last_peered":"2026-02-24T07:50:02.755802+0000","last_clean":"2026-02-24T07:50:02.755802+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:02.755802+0000","last_undegraded":"2026-02-24T07:50:02.755802+0000","last_fullsized":"2026-02-24T07:50:02.755802+0000","mapping_epoch":41,"log_start":"49'10642","ondisk_log_start":"49'10642","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87228416,"num_objects":1331,"num_object_clones":0,"num_object_copies":3993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10648,"num_write_kb":85184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'10848","reported_seq":10874,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.828592+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:02.828592+0000","last_peered":"2026-02-24T07:50:02.828592+0000","last_clean":"2026-02-24T07:50:02.828592+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:02.828592+0000","last_undegraded":"2026-02-24T07:50:02.828592+0000","last_fullsized":"2026-02-24T07:50:02.828592+0000","mapping_epoch":41,"log_start":"49'10840","ondisk_log_start":"49'10840","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88866816,"num_objects":1356,"num_object_clones":0,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10848,"num_write_kb":86784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'10848","reported_seq":10874,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.821563+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:02.821563+0000","last_peered":"2026-02-24T07:50:02.821563+0000","last_clean":"2026-02-24T07:50:02.821563+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:02.821563+0000","last_undegraded":"2026-02-24T07:50:02.821563+0000","last_fullsized":"2026-02-24T07:50:02.821563+0000","mapping_epoch":41,"log_start":"49'10832","ondisk_log_start":"49'10832","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88866816,"num_objects":1356,"num_object_clones":0,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10848,"num_write_kb":86784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'13168","reported_seq":13194,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.713920+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:50:07.713920+0000","last_peered":"2026-02-24T07:50:07.713920+0000","last_clean":"2026-02-24T07:50:07.713920+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:07.713920+0000","last_undegraded":"2026-02-24T07:50:07.713920+0000","last_fullsized":"2026-02-24T07:50:07.713920+0000","mapping_epoch":41,"log_start":"49'13160","ondisk_log_start":"49'13160","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107872256,"num_objects":1646,"num_object_clones":0,"num_object_copies":4938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1646,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13168,"num_write_kb":105344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'12952","reported_seq":12977,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.763419+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:07.763419+0000","last_peered":"2026-02-24T07:50:07.763419+0000","last_clean":"2026-02-24T07:50:07.763419+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:07.763419+0000","last_undegraded":"2026-02-24T07:50:07.763419+0000","last_fullsized":"2026-02-24T07:50:07.763419+0000","mapping_epoch":41,"log_start":"49'12949","ondisk_log_start":"49'12949","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106102784,"num_objects":1619,"num_object_clones":0,"num_object_copies":4857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12952,"num_write_kb":103616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'10064","reported_seq":10090,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.806695+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:02.806695+0000","last_peered":"2026-02-24T07:50:02.806695+0000","last_clean":"2026-02-24T07:50:02.806695+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:02.806695+0000","last_undegraded":"2026-02-24T07:50:02.806695+0000","last_fullsized":"2026-02-24T07:50:02.806695+0000","mapping_epoch":41,"log_start":"49'10041","ondisk_log_start":"49'10041","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82444288,"num_objects":1258,"num_object_clones":0,"num_object_copies":3774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10064,"num_write_kb":80512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'13696","reported_seq":13722,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.729859+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:07.729859+0000","last_peered":"2026-02-24T07:50:07.729859+0000","last_clean":"2026-02-24T07:50:07.729859+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:07.729859+0000","last_undegraded":"2026-02-24T07:50:07.729859+0000","last_fullsized":"2026-02-24T07:50:07.729859+0000","mapping_epoch":41,"log_start":"49'13681","ondisk_log_start":"49'13681","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112197632,"num_objects":1712,"num_object_clones":0,"num_object_copies":5136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13696,"num_write_kb":109568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'13296","reported_seq":13322,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:07.716890+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:07.716890+0000","last_peered":"2026-02-24T07:50:07.716890+0000","last_clean":"2026-02-24T07:50:07.716890+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:07.716890+0000","last_undegraded":"2026-02-24T07:50:07.716890+0000","last_fullsized":"2026-02-24T07:50:07.716890+0000","mapping_epoch":41,"log_start":"49'13273","ondisk_log_start":"49'13273","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108920832,"num_objects":1662,"num_object_clones":0,"num_object_copies":4986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13296,"num_write_kb":106368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'10728","reported_seq":10732,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.828718+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:02.828718+0000","last_peered":"2026-02-24T07:50:02.828718+0000","last_clean":"2026-02-24T07:50:02.828718+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:02.828718+0000","last_undegraded":"2026-02-24T07:50:02.828718+0000","last_fullsized":"2026-02-24T07:50:02.828718+0000","mapping_epoch":41,"log_start":"49'10688","ondisk_log_start":"49'10688","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87883776,"num_objects":1341,"num_object_clones":0,"num_object_copies":4023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10728,"num_write_kb":85824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'10064","reported_seq":10074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:02.827232+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:02.827232+0000","last_peered":"2026-02-24T07:50:02.827232+0000","last_clean":"2026-02-24T07:50:02.827232+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:02.827232+0000","last_undegraded":"2026-02-24T07:50:02.827232+0000","last_fullsized":"2026-02-24T07:50:02.827232+0000","mapping_epoch":41,"log_start":"49'10034","ondisk_log_start":"49'10034","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82444288,"num_objects":1258,"num_object_clones":0,"num_object_copies":3774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10064,"num_write_kb":80512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":245,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:49:59.898326+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:59.898326+0000","last_peered":"2026-02-24T07:49:59.898326+0000","last_clean":"2026-02-24T07:49:59.898326+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:59.898326+0000","last_undegraded":"2026-02-24T07:49:59.898326+0000","last_fullsized":"2026-02-24T07:49:59.898326+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1518075904,"num_objects":23164,"num_object_clones":0,"num_object_copies":69492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185312,"num_write_kb":1482496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4761100288,"data_stored":4761100288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215146,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1622700,"kb_used_data":829912,"kb_used_omap":6,"kb_used_meta":792761,"kb_avail":732380500,"statfs":{"total":751619276800,"available":749957632000,"internally_reserved":0,"allocated":849829888,"data_stored":849509059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7075,"internal_metadata":811787357},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444076,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2083100,"kb_used_data":1483720,"kb_used_omap":4,"kb_used_meta":599355,"kb_avail":731920100,"statfs":{"total":751619276800,"available":749486182400,"internally_reserved":0,"allocated":1519329280,"data_stored":1519008451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":613740190},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2728640,"kb_used_data":889004,"kb_used_omap":27,"kb_used_meta":1839588,"kb_avail":731274560,"statfs":{"total":751619276800,"available":748825149440,"internally_reserved":0,"allocated":910340096,"data_stored":910022819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":1883738468},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,7,15],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1952580,"kb_used_data":1353392,"kb_used_omap":4,"kb_used_meta":599163,"kb_avail":732050620,"statfs":{"total":751619276800,"available":749619834880,"internally_reserved":0,"allocated":1385873408,"data_stored":1385552579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":613543579},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1421910016,"data_stored":1421910016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":947347456,"data_stored":947347456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1528602624,"data_stored":1528602624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":863240192,"data_stored":863240192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:10.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 127 233975 233848 79.4261 77.6953 0.00262509 0.0125828 2026-02-24T07:50:10.011 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:10.166 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:10.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:09 trial016 ceph-mon[39544]: from='client.14663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:10.674 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:10.661+0000 7f0e8e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:10.674 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:10.661+0000 7f0e8e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:10.689 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:10.689 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:10.705 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:10.705 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:10.723 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:10.724 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:10.747 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:10.747 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:11.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 128 242739 242611 78.969 68.4609 0.00204415 0.012655 2026-02-24T07:50:11.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:10 trial016 ceph-mon[39544]: pgmap v125: 17 pgs: 17 active+clean; 1.6 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 77 MiB/s wr, 9.88k op/s 2026-02-24T07:50:11.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1315708536' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:12.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 127 252827 252700 78.9628 78.8203 0.00860394 0.0126598 2026-02-24T07:50:13.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 264016 263888 79.2873 87.4062 0.00353815 0.0126078 2026-02-24T07:50:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:12 trial016 ceph-mon[39544]: pgmap v126: 17 pgs: 17 active+clean; 1.6 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.32k op/s 2026-02-24T07:50:13.334 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:13.481 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:13.618 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:13.616+0000 7f2121743640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:13.619 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:13.616+0000 7f2121743640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:13.634 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:13.635 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:13.661 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:13.662 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:13.679 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:13.679 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:13.692 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:13.692 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:14.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 128 274603 274475 79.4139 82.7109 0.0057453 0.0125873 2026-02-24T07:50:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2698023936' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:14.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:14.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:14.424 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:14.574 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:14.704 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:14.701+0000 7f3d25814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:14.704 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:14.702+0000 7f3d25814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:14.852 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:14.853 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:14.901 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2026-02-24T07:50:13.767194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2144682528,"num_objects":32719,"num_object_clones":0,"num_object_copies":98157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32719,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":261865,"num_write_kb":2095990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9199908,"kb_used_data":6162836,"kb_used_omap":19,"kb_used_meta":3036972,"kb_avail":2926812892,"statfs":{"total":3006477107200,"available":2997056401408,"internally_reserved":0,"allocated":6310744064,"data_stored":6309464300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20424,"internal_metadata":3109859384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1200807936,"num_objects":18323,"num_object_clones":0,"num_object_copies":54969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146583,"num_write_kb":1172664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001630"},"pg_stats":[{"pgid":"3.f","version":"49'16528","reported_seq":16554,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.741693+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:12.741693+0000","last_peered":"2026-02-24T07:50:12.741693+0000","last_clean":"2026-02-24T07:50:12.741693+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:12.741693+0000","last_undegraded":"2026-02-24T07:50:12.741693+0000","last_fullsized":"2026-02-24T07:50:12.741693+0000","mapping_epoch":41,"log_start":"49'16521","ondisk_log_start":"49'16521","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135397376,"num_objects":2066,"num_object_clones":0,"num_object_copies":6198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16528,"num_write_kb":132224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'16648","reported_seq":16674,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.744558+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:12.744558+0000","last_peered":"2026-02-24T07:50:12.744558+0000","last_clean":"2026-02-24T07:50:12.744558+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:12.744558+0000","last_undegraded":"2026-02-24T07:50:12.744558+0000","last_fullsized":"2026-02-24T07:50:12.744558+0000","mapping_epoch":41,"log_start":"49'16640","ondisk_log_start":"49'16640","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136380416,"num_objects":2081,"num_object_clones":0,"num_object_copies":6243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16648,"num_write_kb":133184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'16112","reported_seq":16137,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.780715+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:12.780715+0000","last_peered":"2026-02-24T07:50:12.780715+0000","last_clean":"2026-02-24T07:50:12.780715+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:12.780715+0000","last_undegraded":"2026-02-24T07:50:12.780715+0000","last_fullsized":"2026-02-24T07:50:12.780715+0000","mapping_epoch":41,"log_start":"49'16109","ondisk_log_start":"49'16109","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":6042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16112,"num_write_kb":128896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'16400","reported_seq":16426,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.728526+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:12.728526+0000","last_peered":"2026-02-24T07:50:12.728526+0000","last_clean":"2026-02-24T07:50:12.728526+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:12.728526+0000","last_undegraded":"2026-02-24T07:50:12.728526+0000","last_fullsized":"2026-02-24T07:50:12.728526+0000","mapping_epoch":41,"log_start":"49'16384","ondisk_log_start":"49'16384","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":2050,"num_object_clones":0,"num_object_copies":6150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16400,"num_write_kb":131200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'16064","reported_seq":16090,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.817758+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:12.817758+0000","last_peered":"2026-02-24T07:50:12.817758+0000","last_clean":"2026-02-24T07:50:12.817758+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:12.817758+0000","last_undegraded":"2026-02-24T07:50:12.817758+0000","last_fullsized":"2026-02-24T07:50:12.817758+0000","mapping_epoch":41,"log_start":"49'16048","ondisk_log_start":"49'16048","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131596288,"num_objects":2008,"num_object_clones":0,"num_object_copies":6024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16064,"num_write_kb":128512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'16349","reported_seq":16370,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.779696+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:12.779696+0000","last_peered":"2026-02-24T07:50:12.779696+0000","last_clean":"2026-02-24T07:50:12.779696+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:12.779696+0000","last_undegraded":"2026-02-24T07:50:12.779696+0000","last_fullsized":"2026-02-24T07:50:12.779696+0000","mapping_epoch":41,"log_start":"49'16338","ondisk_log_start":"49'16338","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133931008,"num_objects":2044,"num_object_clones":0,"num_object_copies":6132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16349,"num_write_kb":130792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'16336","reported_seq":16362,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.760965+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:12.760965+0000","last_peered":"2026-02-24T07:50:12.760965+0000","last_clean":"2026-02-24T07:50:12.760965+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:12.760965+0000","last_undegraded":"2026-02-24T07:50:12.760965+0000","last_fullsized":"2026-02-24T07:50:12.760965+0000","mapping_epoch":41,"log_start":"49'16330","ondisk_log_start":"49'16330","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133824512,"num_objects":2042,"num_object_clones":0,"num_object_copies":6126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16336,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'16645","reported_seq":16666,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.820280+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:12.820280+0000","last_peered":"2026-02-24T07:50:12.820280+0000","last_clean":"2026-02-24T07:50:12.820280+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:12.820280+0000","last_undegraded":"2026-02-24T07:50:12.820280+0000","last_fullsized":"2026-02-24T07:50:12.820280+0000","mapping_epoch":41,"log_start":"49'16627","ondisk_log_start":"49'16627","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136355840,"num_objects":2081,"num_object_clones":0,"num_object_copies":6243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16645,"num_write_kb":133160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'16800","reported_seq":16819,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.817312+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:12.817312+0000","last_peered":"2026-02-24T07:50:12.817312+0000","last_clean":"2026-02-24T07:50:12.817312+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:12.817312+0000","last_undegraded":"2026-02-24T07:50:12.817312+0000","last_fullsized":"2026-02-24T07:50:12.817312+0000","mapping_epoch":41,"log_start":"49'16792","ondisk_log_start":"49'16792","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137625600,"num_objects":2100,"num_object_clones":0,"num_object_copies":6300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":134400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'16184","reported_seq":16210,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.752003+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:50:12.752003+0000","last_peered":"2026-02-24T07:50:12.752003+0000","last_clean":"2026-02-24T07:50:12.752003+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:12.752003+0000","last_undegraded":"2026-02-24T07:50:12.752003+0000","last_fullsized":"2026-02-24T07:50:12.752003+0000","mapping_epoch":41,"log_start":"49'16168","ondisk_log_start":"49'16168","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132579328,"num_objects":2023,"num_object_clones":0,"num_object_copies":6069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16184,"num_write_kb":129472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'15800","reported_seq":15824,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.764006+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:12.764006+0000","last_peered":"2026-02-24T07:50:12.764006+0000","last_clean":"2026-02-24T07:50:12.764006+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:12.764006+0000","last_undegraded":"2026-02-24T07:50:12.764006+0000","last_fullsized":"2026-02-24T07:50:12.764006+0000","mapping_epoch":41,"log_start":"49'15796","ondisk_log_start":"49'15796","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129433600,"num_objects":1975,"num_object_clones":0,"num_object_copies":5925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15800,"num_write_kb":126400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'16040","reported_seq":16066,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.815457+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:12.815457+0000","last_peered":"2026-02-24T07:50:12.815457+0000","last_clean":"2026-02-24T07:50:12.815457+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:12.815457+0000","last_undegraded":"2026-02-24T07:50:12.815457+0000","last_fullsized":"2026-02-24T07:50:12.815457+0000","mapping_epoch":41,"log_start":"49'16032","ondisk_log_start":"49'16032","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131399680,"num_objects":2005,"num_object_clones":0,"num_object_copies":6015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16040,"num_write_kb":128320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'16488","reported_seq":16514,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.752140+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:12.752140+0000","last_peered":"2026-02-24T07:50:12.752140+0000","last_clean":"2026-02-24T07:50:12.752140+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:12.752140+0000","last_undegraded":"2026-02-24T07:50:12.752140+0000","last_fullsized":"2026-02-24T07:50:12.752140+0000","mapping_epoch":41,"log_start":"49'16480","ondisk_log_start":"49'16480","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135069696,"num_objects":2061,"num_object_clones":0,"num_object_copies":6183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16488,"num_write_kb":131904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'16384","reported_seq":16410,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.734186+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:12.734186+0000","last_peered":"2026-02-24T07:50:12.734186+0000","last_clean":"2026-02-24T07:50:12.734186+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:12.734186+0000","last_undegraded":"2026-02-24T07:50:12.734186+0000","last_fullsized":"2026-02-24T07:50:12.734186+0000","mapping_epoch":41,"log_start":"49'16368","ondisk_log_start":"49'16368","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":2048,"num_object_clones":0,"num_object_copies":6144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16384,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'16800","reported_seq":16826,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.819381+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:12.819381+0000","last_peered":"2026-02-24T07:50:12.819381+0000","last_clean":"2026-02-24T07:50:12.819381+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:12.819381+0000","last_undegraded":"2026-02-24T07:50:12.819381+0000","last_fullsized":"2026-02-24T07:50:12.819381+0000","mapping_epoch":41,"log_start":"49'16792","ondisk_log_start":"49'16792","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137625600,"num_objects":2100,"num_object_clones":0,"num_object_copies":6300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":134400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'16152","reported_seq":16178,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:12.830571+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:12.830571+0000","last_peered":"2026-02-24T07:50:12.830571+0000","last_clean":"2026-02-24T07:50:12.830571+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:12.830571+0000","last_undegraded":"2026-02-24T07:50:12.830571+0000","last_fullsized":"2026-02-24T07:50:12.830571+0000","mapping_epoch":41,"log_start":"49'16144","ondisk_log_start":"49'16144","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132317184,"num_objects":2019,"num_object_clones":0,"num_object_copies":6057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16152,"num_write_kb":129216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":245,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:49:59.898326+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:59.898326+0000","last_peered":"2026-02-24T07:49:59.898326+0000","last_clean":"2026-02-24T07:49:59.898326+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:59.898326+0000","last_undegraded":"2026-02-24T07:49:59.898326+0000","last_fullsized":"2026-02-24T07:49:59.898326+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2144092160,"num_objects":32717,"num_object_clones":0,"num_object_copies":98151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261730,"num_write_kb":2093840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6430097408,"data_stored":6430097408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215148,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2251572,"kb_used_data":1296352,"kb_used_omap":6,"kb_used_meta":955193,"kb_avail":731751628,"statfs":{"total":751619276800,"available":749313667072,"internally_reserved":0,"allocated":1327464448,"data_stored":1327143619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7075,"internal_metadata":978117725},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444077,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2534636,"kb_used_data":1808920,"kb_used_omap":4,"kb_used_meta":725691,"kb_avail":731468564,"statfs":{"total":751619276800,"available":749023809536,"internally_reserved":0,"allocated":1852334080,"data_stored":1852013251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":743108254},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2079784,"kb_used_data":1413076,"kb_used_omap":4,"kb_used_meta":666683,"kb_avail":731923416,"statfs":{"total":751619276800,"available":749489577984,"internally_reserved":0,"allocated":1446989824,"data_stored":1446672547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":682684066},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2333916,"kb_used_data":1644488,"kb_used_omap":4,"kb_used_meta":689403,"kb_avail":731669284,"statfs":{"total":751619276800,"available":749229346816,"internally_reserved":0,"allocated":1683955712,"data_stored":1683634883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":705949339},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1739161600,"data_stored":1739161600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1480204288,"data_stored":1480204288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1870454784,"data_stored":1870454784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1340276736,"data_stored":1340276736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:15.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 285090 284962 79.5035 81.9297 0.0125283 0.012574 2026-02-24T07:50:15.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:14 trial016 ceph-mon[39544]: pgmap v127: 17 pgs: 17 active+clean; 2.0 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s wr, 12.21k op/s 2026-02-24T07:50:15.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:15.739 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:15.888 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:16.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 295493 295365 79.5643 81.2734 0.00429016 0.012563 2026-02-24T07:50:16.021 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:16.018+0000 7f0def32b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:16.021 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:16.018+0000 7f0def32b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:16.021 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:15 trial016 ceph-mon[39544]: from='client.14669 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:16.036 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:16.036 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:16.058 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:16.058 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:16.087 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:16.087 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:16.101 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:16.102 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:17.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 127 306072 305945 79.6672 82.6562 0.0119116 0.012549 2026-02-24T07:50:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:16 trial016 ceph-mon[39544]: pgmap v128: 17 pgs: 17 active+clean; 2.0 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s wr, 7.80k op/s 2026-02-24T07:50:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/932978700' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:18.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 128 316974 316846 79.8443 85.1641 0.00460641 0.0125203 2026-02-24T07:50:18.148 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:18.296 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:18.418 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:18.415+0000 7f3e7e4af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:18.418 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:18.416+0000 7f3e7e4af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:18.434 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:18.434 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:18.452 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:18.452 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:18.488 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:18.488 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:18.503 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:18.503 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:19.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 128 327405 327277 79.8956 81.4922 0.00839563 0.0125107 2026-02-24T07:50:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:18 trial016 ceph-mon[39544]: pgmap v129: 17 pgs: 17 active+clean; 2.0 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.36k op/s 2026-02-24T07:50:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1610347317' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:19.904 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:19.904 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:19.905 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T07:50:19.905 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:20.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 128 338037 337909 79.9914 83.0625 0.00871308 0.0124968 2026-02-24T07:50:20.073 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:20.550 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:20.569 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:20.521+0000 7fe7a29af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:20.570 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:20.521+0000 7fe7a29af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:20.673 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:20.673 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:21.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 346122 345994 79.4963 63.1641 0.00338615 0.0125716 2026-02-24T07:50:21.269 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:20 trial016 ceph-mon[39544]: pgmap v130: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.77k op/s 2026-02-24T07:50:21.292 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2026-02-24T07:50:19.767999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2577564192,"num_objects":39324,"num_object_clones":0,"num_object_copies":117972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39324,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":314707,"num_write_kb":2518726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10813692,"kb_used_data":7433708,"kb_used_omap":19,"kb_used_meta":3379884,"kb_avail":2925199108,"statfs":{"total":3006477107200,"available":2995403886592,"internally_reserved":0,"allocated":7612116992,"data_stored":7610837228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20424,"internal_metadata":3461001272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,32,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1058897920,"num_objects":16158,"num_object_clones":0,"num_object_copies":48474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129260,"num_write_kb":1034080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001640"},"pg_stats":[{"pgid":"3.f","version":"49'19896","reported_seq":19916,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.764001+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:17.764001+0000","last_peered":"2026-02-24T07:50:17.764001+0000","last_clean":"2026-02-24T07:50:17.764001+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:17.764001+0000","last_undegraded":"2026-02-24T07:50:17.764001+0000","last_fullsized":"2026-02-24T07:50:17.764001+0000","mapping_epoch":41,"log_start":"49'19882","ondisk_log_start":"49'19882","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162988032,"num_objects":2487,"num_object_clones":0,"num_object_copies":7461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19896,"num_write_kb":159168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'20055","reported_seq":20074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.753621+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:17.753621+0000","last_peered":"2026-02-24T07:50:17.753621+0000","last_clean":"2026-02-24T07:50:17.753621+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:17.753621+0000","last_undegraded":"2026-02-24T07:50:17.753621+0000","last_fullsized":"2026-02-24T07:50:17.753621+0000","mapping_epoch":41,"log_start":"49'20047","ondisk_log_start":"49'20047","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164290560,"num_objects":2507,"num_object_clones":0,"num_object_copies":7521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20055,"num_write_kb":160440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'19173","reported_seq":19195,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.765316+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:17.765316+0000","last_peered":"2026-02-24T07:50:17.765316+0000","last_clean":"2026-02-24T07:50:17.765316+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:17.765316+0000","last_undegraded":"2026-02-24T07:50:17.765316+0000","last_fullsized":"2026-02-24T07:50:17.765316+0000","mapping_epoch":41,"log_start":"49'19168","ondisk_log_start":"49'19168","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157065216,"num_objects":2397,"num_object_clones":0,"num_object_copies":7191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19173,"num_write_kb":153384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'19688","reported_seq":19707,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.771751+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:17.771751+0000","last_peered":"2026-02-24T07:50:17.771751+0000","last_clean":"2026-02-24T07:50:17.771751+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:17.771751+0000","last_undegraded":"2026-02-24T07:50:17.771751+0000","last_fullsized":"2026-02-24T07:50:17.771751+0000","mapping_epoch":41,"log_start":"49'19680","ondisk_log_start":"49'19680","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161284096,"num_objects":2461,"num_object_clones":0,"num_object_copies":7383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19688,"num_write_kb":157504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'19184","reported_seq":19210,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.829908+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:17.829908+0000","last_peered":"2026-02-24T07:50:17.829908+0000","last_clean":"2026-02-24T07:50:17.829908+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:17.829908+0000","last_undegraded":"2026-02-24T07:50:17.829908+0000","last_fullsized":"2026-02-24T07:50:17.829908+0000","mapping_epoch":41,"log_start":"49'19173","ondisk_log_start":"49'19173","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157155328,"num_objects":2398,"num_object_clones":0,"num_object_copies":7194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19184,"num_write_kb":153472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'19672","reported_seq":19698,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.771828+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:17.771828+0000","last_peered":"2026-02-24T07:50:17.771828+0000","last_clean":"2026-02-24T07:50:17.771828+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:17.771828+0000","last_undegraded":"2026-02-24T07:50:17.771828+0000","last_fullsized":"2026-02-24T07:50:17.771828+0000","mapping_epoch":41,"log_start":"49'19666","ondisk_log_start":"49'19666","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161153024,"num_objects":2459,"num_object_clones":0,"num_object_copies":7377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19672,"num_write_kb":157376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'19648","reported_seq":19674,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.751135+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:17.751135+0000","last_peered":"2026-02-24T07:50:17.751135+0000","last_clean":"2026-02-24T07:50:17.751135+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:17.751135+0000","last_undegraded":"2026-02-24T07:50:17.751135+0000","last_fullsized":"2026-02-24T07:50:17.751135+0000","mapping_epoch":41,"log_start":"49'19630","ondisk_log_start":"49'19630","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160956416,"num_objects":2456,"num_object_clones":0,"num_object_copies":7368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19648,"num_write_kb":157184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'19712","reported_seq":19738,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.828465+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:17.828465+0000","last_peered":"2026-02-24T07:50:17.828465+0000","last_clean":"2026-02-24T07:50:17.828465+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:17.828465+0000","last_undegraded":"2026-02-24T07:50:17.828465+0000","last_fullsized":"2026-02-24T07:50:17.828465+0000","mapping_epoch":41,"log_start":"49'19704","ondisk_log_start":"49'19704","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161480704,"num_objects":2464,"num_object_clones":0,"num_object_copies":7392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19712,"num_write_kb":157696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'20016","reported_seq":20041,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.831836+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:17.831836+0000","last_peered":"2026-02-24T07:50:17.831836+0000","last_clean":"2026-02-24T07:50:17.831836+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:17.831836+0000","last_undegraded":"2026-02-24T07:50:17.831836+0000","last_fullsized":"2026-02-24T07:50:17.831836+0000","mapping_epoch":41,"log_start":"49'20009","ondisk_log_start":"49'20009","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163971072,"num_objects":2502,"num_object_clones":0,"num_object_copies":7506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20016,"num_write_kb":160128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'19384","reported_seq":19410,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.751960+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:50:17.751960+0000","last_peered":"2026-02-24T07:50:17.751960+0000","last_clean":"2026-02-24T07:50:17.751960+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:17.751960+0000","last_undegraded":"2026-02-24T07:50:17.751960+0000","last_fullsized":"2026-02-24T07:50:17.751960+0000","mapping_epoch":41,"log_start":"49'19376","ondisk_log_start":"49'19376","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158793728,"num_objects":2423,"num_object_clones":0,"num_object_copies":7269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19384,"num_write_kb":155072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'19320","reported_seq":19346,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.762856+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:17.762856+0000","last_peered":"2026-02-24T07:50:17.762856+0000","last_clean":"2026-02-24T07:50:17.762856+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:17.762856+0000","last_undegraded":"2026-02-24T07:50:17.762856+0000","last_fullsized":"2026-02-24T07:50:17.762856+0000","mapping_epoch":41,"log_start":"49'19312","ondisk_log_start":"49'19312","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158269440,"num_objects":2415,"num_object_clones":0,"num_object_copies":7245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2415,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19320,"num_write_kb":154560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'19456","reported_seq":19482,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.814420+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:17.814420+0000","last_peered":"2026-02-24T07:50:17.814420+0000","last_clean":"2026-02-24T07:50:17.814420+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:17.814420+0000","last_undegraded":"2026-02-24T07:50:17.814420+0000","last_fullsized":"2026-02-24T07:50:17.814420+0000","mapping_epoch":41,"log_start":"49'19448","ondisk_log_start":"49'19448","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":2432,"num_object_clones":0,"num_object_copies":7296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19456,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'20048","reported_seq":20074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.757921+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:17.757921+0000","last_peered":"2026-02-24T07:50:17.757921+0000","last_clean":"2026-02-24T07:50:17.757921+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:17.757921+0000","last_undegraded":"2026-02-24T07:50:17.757921+0000","last_fullsized":"2026-02-24T07:50:17.757921+0000","mapping_epoch":41,"log_start":"49'20044","ondisk_log_start":"49'20044","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164233216,"num_objects":2506,"num_object_clones":0,"num_object_copies":7518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20048,"num_write_kb":160384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'19904","reported_seq":19930,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.751878+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:17.751878+0000","last_peered":"2026-02-24T07:50:17.751878+0000","last_clean":"2026-02-24T07:50:17.751878+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:17.751878+0000","last_undegraded":"2026-02-24T07:50:17.751878+0000","last_fullsized":"2026-02-24T07:50:17.751878+0000","mapping_epoch":41,"log_start":"49'19896","ondisk_log_start":"49'19896","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163053568,"num_objects":2488,"num_object_clones":0,"num_object_copies":7464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19904,"num_write_kb":159232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'20056","reported_seq":20082,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.824057+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:17.824057+0000","last_peered":"2026-02-24T07:50:17.824057+0000","last_clean":"2026-02-24T07:50:17.824057+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:17.824057+0000","last_undegraded":"2026-02-24T07:50:17.824057+0000","last_fullsized":"2026-02-24T07:50:17.824057+0000","mapping_epoch":41,"log_start":"49'20053","ondisk_log_start":"49'20053","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164298752,"num_objects":2507,"num_object_clones":0,"num_object_copies":7521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20056,"num_write_kb":160448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'19360","reported_seq":19386,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:17.819192+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:17.819192+0000","last_peered":"2026-02-24T07:50:17.819192+0000","last_clean":"2026-02-24T07:50:17.819192+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:17.819192+0000","last_undegraded":"2026-02-24T07:50:17.819192+0000","last_fullsized":"2026-02-24T07:50:17.819192+0000","mapping_epoch":41,"log_start":"49'19352","ondisk_log_start":"49'19352","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19360,"num_write_kb":154880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":245,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:49:59.898326+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:59.898326+0000","last_peered":"2026-02-24T07:49:59.898326+0000","last_clean":"2026-02-24T07:49:59.898326+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:59.898326+0000","last_undegraded":"2026-02-24T07:49:59.898326+0000","last_fullsized":"2026-02-24T07:49:59.898326+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2576973824,"num_objects":39322,"num_object_clones":0,"num_object_copies":117966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314572,"num_write_kb":2516576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7728963584,"data_stored":7728963584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215149,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2587844,"kb_used_data":1560432,"kb_used_omap":6,"kb_used_meta":1027385,"kb_avail":731415356,"statfs":{"total":751619276800,"available":748969324544,"internally_reserved":0,"allocated":1597882368,"data_stored":1597561539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7075,"internal_metadata":1052042333},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,32,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444078,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3011140,"kb_used_data":2177136,"kb_used_omap":4,"kb_used_meta":833979,"kb_avail":730992060,"statfs":{"total":751619276800,"available":748535869440,"internally_reserved":0,"allocated":2229387264,"data_stored":2229066435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":853995166},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2448504,"kb_used_data":1709604,"kb_used_omap":4,"kb_used_meta":738875,"kb_avail":731554696,"statfs":{"total":751619276800,"available":749112008704,"internally_reserved":0,"allocated":1750634496,"data_stored":1750317219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":756608674},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2766204,"kb_used_data":1986536,"kb_used_omap":4,"kb_used_meta":779643,"kb_avail":731236996,"statfs":{"total":751619276800,"available":748786683904,"internally_reserved":0,"allocated":2034212864,"data_stored":2033892035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":798355099},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2090950656,"data_stored":2090950656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1774927872,"data_stored":1774927872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2250121216,"data_stored":2250121216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1612963840,"data_stored":1612963840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:21.294 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:50:21.294 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 36 2026-02-24T07:50:21.338 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:21.522 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:21.903 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:21.903 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:21.903 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:21.904 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:21.823+0000 7fa684f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:21.904 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:21.823+0000 7fa684f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:21.904 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:21.904 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:21.904 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:21.905 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:21.905 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:22.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 353827 353699 78.9447 60.1953 0.00833652 0.012661 2026-02-24T07:50:22.245 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:21 trial016 ceph-mon[39544]: from='client.14675 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:22.245 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3061861441' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:23.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 361189 361061 78.3494 57.5156 0.0444425 0.0127524 2026-02-24T07:50:23.032 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:22.981+0000 7f60f1345640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:23.033 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:22.981+0000 7f60f1345640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:23.138 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:50:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:22 trial016 ceph-mon[39544]: pgmap v131: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.38k op/s 2026-02-24T07:50:23.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:24.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 128 369353 369225 77.9555 63.7812 0.0159195 0.0128237 2026-02-24T07:50:24.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3766424370' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:50:24.836 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:24.993 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:25.001 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 379848 379720 78.0615 81.9922 0.0053663 0.0128059 2026-02-24T07:50:25.127 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:24 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:50:25.127 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:24 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:50:25.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:24 trial016 ceph-mon[39544]: pgmap v132: 17 pgs: 17 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s wr, 12.16k op/s 2026-02-24T07:50:25.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:24 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:50:25.128 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:24 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:50:25.128 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:25.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:25.124+0000 7f27265b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:25.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:25.124+0000 7f27265b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:25.142 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:25.142 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:25.156 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:25.156 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:25.193 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:25.194 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:25.220 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:25.221 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:26.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 128 390534 390406 78.2004 83.4844 0.00779669 0.0127819 2026-02-24T07:50:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2491324767' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:27.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:50:27.001096+0000 min lat: 0.000640208 max lat: 0.0954064 avg lat: 0.0127652 2026-02-24T07:50:27.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:50:27.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 128 401107 400979 78.3103 82.6016 0.00720695 0.0127652 2026-02-24T07:50:27.267 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:27.295 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:26 trial016 ceph-mon[39544]: pgmap v133: 17 pgs: 17 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.19k op/s 2026-02-24T07:50:27.417 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:27.977 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:27.871+0000 7f83208cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:27.871+0000 7f83208cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:27.978 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:28.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 127 410429 410302 78.1766 72.8359 0.0192804 0.0127878 2026-02-24T07:50:28.222 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1597830463' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:28.804 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:28.805 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:28.805 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:50:28.805 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:50:28.952 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:29.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 127 420500 420373 78.1884 78.6797 0.0078054 0.0127852 2026-02-24T07:50:29.083 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.079+0000 7f1b67754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.083 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.079+0000 7f1b67754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:28 trial016 ceph-mon[39544]: pgmap v134: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s wr, 9.15k op/s 2026-02-24T07:50:29.104 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:50:29.105 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:50:29.144 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:50:29.145 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:50:29.145 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:50:29.295 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:29.432 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.428+0000 7f50f238f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.432 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.429+0000 7f50f238f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.458 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:50:29.458 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:50:29.459 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:50:29.499 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:50:29.500 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:50:29.500 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:50:29.651 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:29.779 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.775+0000 7f2e5bf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.779 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:29.776+0000 7f2e5bf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:29.804 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:50:29.804 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:50:29.804 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:50:29.804 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:50:29.805 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:50:30.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 127 430467 430340 78.1808 77.8672 0.00741848 0.0127868 2026-02-24T07:50:30.250 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:30.403 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:30.424 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:50:30.425 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:50:30.425 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:50:30.665 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:30.925 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:30.926 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:30.926 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:30.860+0000 7f93e9440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:30.926 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:30.860+0000 7f93e9440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:30.926 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:30.926 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:30.936 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:30.936 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:30.955 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:30.955 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:31.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 438346 438218 77.8027 61.5469 0.0190739 0.0128494 2026-02-24T07:50:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:30 trial016 ceph-mon[39544]: pgmap v135: 17 pgs: 17 active+clean; 3.1 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s wr, 11.68k op/s 2026-02-24T07:50:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2000169238' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:31.523 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:31.520+0000 7f0c6c0ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:31.523 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:31.520+0000 7f0c6c0ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:31.547 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:50:31.547 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:50:31.547 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:50:31.548 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:50:31.584 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:50:31.584 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:50:32.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 127 447509 447382 77.6646 71.5938 0.010188 0.0128725 2026-02-24T07:50:33.002 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 128 458298 458170 77.8083 84.2812 0.0142097 0.0128483 2026-02-24T07:50:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:32 trial016 ceph-mon[39544]: pgmap v136: 17 pgs: 17 active+clean; 3.1 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s wr, 7.84k op/s 2026-02-24T07:50:33.374 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:33.526 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:34.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 127 467958 467831 77.7586 75.4766 0.0262345 0.0128555 2026-02-24T07:50:34.107 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:34.108 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:34.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:34.035+0000 7f32e2342640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:34.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:34.035+0000 7f32e2342640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:34.108 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:34.108 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:34.113 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:34.113 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:34.142 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:34.142 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:35.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 477326 477198 77.6631 73.1797 0.0141877 0.0128714 2026-02-24T07:50:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:34 trial016 ceph-mon[39544]: pgmap v137: 17 pgs: 17 active+clean; 3.5 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 92 MiB/s wr, 11.78k op/s 2026-02-24T07:50:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1402556494' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:35.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:36.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 127 488151 488024 77.804 84.5781 0.00558315 0.0128501 2026-02-24T07:50:36.377 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:36.528 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:36.586 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:36.586 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:36.586 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T07:50:36.587 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:36.837 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:36.984 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:36 trial016 ceph-mon[39544]: pgmap v138: 17 pgs: 17 active+clean; 3.5 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 8.00k op/s 2026-02-24T07:50:37.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 498212 498084 77.8197 78.5938 0.00762313 0.0128458 2026-02-24T07:50:37.089 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:37.038+0000 7f0a6381d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:37.089 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:37.038+0000 7f0a6381d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:37.089 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:37.089 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:37.090 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:37.090 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:37.099 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:37.099 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:37.112 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:37.113 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:37.955 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:37.953+0000 7fe0e7604640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:37.956 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:37.953+0000 7fe0e7604640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:38.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 505650 505522 77.4331 58.1094 0.0389597 0.0129113 2026-02-24T07:50:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:37 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:50:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:37 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:50:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/106641457' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:38.095 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:38.095 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:38.145 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2026-02-24T07:50:37.770425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3836527136,"num_objects":58537,"num_object_clones":0,"num_object_copies":175611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58537,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":468389,"num_write_kb":3748182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15682540,"kb_used_data":11170844,"kb_used_omap":21,"kb_used_meta":4511594,"kb_avail":2920330260,"statfs":{"total":3006477107200,"available":2990418186240,"internally_reserved":0,"allocated":11438944256,"data_stored":11437664492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21728,"internal_metadata":4619873056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,12,15],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":887013376,"num_objects":13538,"num_object_clones":0,"num_object_copies":40614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108278,"num_write_kb":866224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001553"},"pg_stats":[{"pgid":"3.f","version":"49'31926","reported_seq":31950,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:37.753869+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:37.753869+0000","last_peered":"2026-02-24T07:50:37.753869+0000","last_clean":"2026-02-24T07:50:37.753869+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:37.753869+0000","last_undegraded":"2026-02-24T07:50:37.753869+0000","last_fullsized":"2026-02-24T07:50:37.753869+0000","mapping_epoch":41,"log_start":"49'31922","ondisk_log_start":"49'31922","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261537792,"num_objects":3991,"num_object_clones":0,"num_object_copies":11973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31926,"num_write_kb":255408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'31625","reported_seq":31650,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:37.761094+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:37.761094+0000","last_peered":"2026-02-24T07:50:37.761094+0000","last_clean":"2026-02-24T07:50:37.761094+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:37.761094+0000","last_undegraded":"2026-02-24T07:50:37.761094+0000","last_fullsized":"2026-02-24T07:50:37.761094+0000","mapping_epoch":41,"log_start":"49'31617","ondisk_log_start":"49'31617","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259072000,"num_objects":3954,"num_object_clones":0,"num_object_copies":11862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31625,"num_write_kb":253000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'27792","reported_seq":27818,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.757522+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:32.757522+0000","last_peered":"2026-02-24T07:50:32.757522+0000","last_clean":"2026-02-24T07:50:32.757522+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:32.757522+0000","last_undegraded":"2026-02-24T07:50:32.757522+0000","last_fullsized":"2026-02-24T07:50:32.757522+0000","mapping_epoch":41,"log_start":"49'27783","ondisk_log_start":"49'27783","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227672064,"num_objects":3474,"num_object_clones":0,"num_object_copies":10422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27792,"num_write_kb":222336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'28640","reported_seq":28666,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.774571+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:32.774571+0000","last_peered":"2026-02-24T07:50:32.774571+0000","last_clean":"2026-02-24T07:50:32.774571+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:32.774571+0000","last_undegraded":"2026-02-24T07:50:32.774571+0000","last_fullsized":"2026-02-24T07:50:32.774571+0000","mapping_epoch":41,"log_start":"49'28632","ondisk_log_start":"49'28632","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234618880,"num_objects":3580,"num_object_clones":0,"num_object_copies":10740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28640,"num_write_kb":229120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'28055","reported_seq":28074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.833408+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:32.833408+0000","last_peered":"2026-02-24T07:50:32.833408+0000","last_clean":"2026-02-24T07:50:32.833408+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:32.833408+0000","last_undegraded":"2026-02-24T07:50:32.833408+0000","last_fullsized":"2026-02-24T07:50:32.833408+0000","mapping_epoch":41,"log_start":"49'28047","ondisk_log_start":"49'28047","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229826560,"num_objects":3507,"num_object_clones":0,"num_object_copies":10521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":224440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'28282","reported_seq":28306,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.780011+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:32.780011+0000","last_peered":"2026-02-24T07:50:32.780011+0000","last_clean":"2026-02-24T07:50:32.780011+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:32.780011+0000","last_undegraded":"2026-02-24T07:50:32.780011+0000","last_fullsized":"2026-02-24T07:50:32.780011+0000","mapping_epoch":41,"log_start":"49'28261","ondisk_log_start":"49'28261","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231686144,"num_objects":3536,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28282,"num_write_kb":226256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'28971","reported_seq":28994,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.778542+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:32.778542+0000","last_peered":"2026-02-24T07:50:32.778542+0000","last_clean":"2026-02-24T07:50:32.778542+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:32.778542+0000","last_undegraded":"2026-02-24T07:50:32.778542+0000","last_fullsized":"2026-02-24T07:50:32.778542+0000","mapping_epoch":41,"log_start":"49'28960","ondisk_log_start":"49'28960","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237330432,"num_objects":3622,"num_object_clones":0,"num_object_copies":10866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28971,"num_write_kb":231768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'28640","reported_seq":28666,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.835147+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:32.835147+0000","last_peered":"2026-02-24T07:50:32.835147+0000","last_clean":"2026-02-24T07:50:32.835147+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:32.835147+0000","last_undegraded":"2026-02-24T07:50:32.835147+0000","last_fullsized":"2026-02-24T07:50:32.835147+0000","mapping_epoch":41,"log_start":"49'28632","ondisk_log_start":"49'28632","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234618880,"num_objects":3580,"num_object_clones":0,"num_object_copies":10740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28640,"num_write_kb":229120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'28840","reported_seq":28866,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.830172+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:32.830172+0000","last_peered":"2026-02-24T07:50:32.830172+0000","last_clean":"2026-02-24T07:50:32.830172+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:32.830172+0000","last_undegraded":"2026-02-24T07:50:32.830172+0000","last_fullsized":"2026-02-24T07:50:32.830172+0000","mapping_epoch":41,"log_start":"49'28834","ondisk_log_start":"49'28834","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236257280,"num_objects":3605,"num_object_clones":0,"num_object_copies":10815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28840,"num_write_kb":230720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'28123","reported_seq":28146,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.780659+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:50:32.780659+0000","last_peered":"2026-02-24T07:50:32.780659+0000","last_clean":"2026-02-24T07:50:32.780659+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:32.780659+0000","last_undegraded":"2026-02-24T07:50:32.780659+0000","last_fullsized":"2026-02-24T07:50:32.780659+0000","mapping_epoch":41,"log_start":"49'28113","ondisk_log_start":"49'28113","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230383616,"num_objects":3516,"num_object_clones":0,"num_object_copies":10548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28123,"num_write_kb":224984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'30720","reported_seq":30746,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:37.752711+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:37.752711+0000","last_peered":"2026-02-24T07:50:37.752711+0000","last_clean":"2026-02-24T07:50:37.752711+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:37.752711+0000","last_undegraded":"2026-02-24T07:50:37.752711+0000","last_fullsized":"2026-02-24T07:50:37.752711+0000","mapping_epoch":41,"log_start":"49'30717","ondisk_log_start":"49'30717","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":3840,"num_object_clones":0,"num_object_copies":11520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3840,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30720,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'28528","reported_seq":28554,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.835692+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:32.835692+0000","last_peered":"2026-02-24T07:50:32.835692+0000","last_clean":"2026-02-24T07:50:32.835692+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:32.835692+0000","last_undegraded":"2026-02-24T07:50:32.835692+0000","last_fullsized":"2026-02-24T07:50:32.835692+0000","mapping_epoch":41,"log_start":"49'28520","ondisk_log_start":"49'28520","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233701376,"num_objects":3566,"num_object_clones":0,"num_object_copies":10698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28528,"num_write_kb":228224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'31976","reported_seq":32002,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:37.744113+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:37.744113+0000","last_peered":"2026-02-24T07:50:37.744113+0000","last_clean":"2026-02-24T07:50:37.744113+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:37.744113+0000","last_undegraded":"2026-02-24T07:50:37.744113+0000","last_fullsized":"2026-02-24T07:50:37.744113+0000","mapping_epoch":41,"log_start":"49'31968","ondisk_log_start":"49'31968","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261947392,"num_objects":3997,"num_object_clones":0,"num_object_copies":11991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3997,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31976,"num_write_kb":255808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'28648","reported_seq":28674,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.780149+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:32.780149+0000","last_peered":"2026-02-24T07:50:32.780149+0000","last_clean":"2026-02-24T07:50:32.780149+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:32.780149+0000","last_undegraded":"2026-02-24T07:50:32.780149+0000","last_fullsized":"2026-02-24T07:50:32.780149+0000","mapping_epoch":41,"log_start":"49'28640","ondisk_log_start":"49'28640","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234684416,"num_objects":3581,"num_object_clones":0,"num_object_copies":10743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28648,"num_write_kb":229184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'29056","reported_seq":29082,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.836111+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:32.836111+0000","last_peered":"2026-02-24T07:50:32.836111+0000","last_clean":"2026-02-24T07:50:32.836111+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:32.836111+0000","last_undegraded":"2026-02-24T07:50:32.836111+0000","last_fullsized":"2026-02-24T07:50:32.836111+0000","mapping_epoch":41,"log_start":"49'29025","ondisk_log_start":"49'29025","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":3000,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238026752,"num_objects":3632,"num_object_clones":0,"num_object_copies":10896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29056,"num_write_kb":232448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'28432","reported_seq":28458,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:32.831969+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:32.831969+0000","last_peered":"2026-02-24T07:50:32.831969+0000","last_clean":"2026-02-24T07:50:32.831969+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:32.831969+0000","last_undegraded":"2026-02-24T07:50:32.831969+0000","last_fullsized":"2026-02-24T07:50:32.831969+0000","mapping_epoch":41,"log_start":"49'28424","ondisk_log_start":"49'28424","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232914944,"num_objects":3554,"num_object_clones":0,"num_object_copies":10662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28432,"num_write_kb":227456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":245,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:49:59.898326+0000","last_change":"2026-02-24T07:49:14.372043+0000","last_active":"2026-02-24T07:49:59.898326+0000","last_peered":"2026-02-24T07:49:59.898326+0000","last_clean":"2026-02-24T07:49:59.898326+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:49:59.898326+0000","last_undegraded":"2026-02-24T07:49:59.898326+0000","last_fullsized":"2026-02-24T07:49:59.898326+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:49:14.371995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:49:14.371995+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:31.733460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3835936768,"num_objects":58535,"num_object_clones":0,"num_object_copies":175605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468254,"num_write_kb":3746032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11550875648,"data_stored":11550875648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215152,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3517884,"kb_used_data":2255848,"kb_used_omap":7,"kb_used_meta":1262008,"kb_avail":730485316,"statfs":{"total":751619276800,"available":748016963584,"internally_reserved":0,"allocated":2309988352,"data_stored":2309667523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7727,"internal_metadata":1292296657},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444082,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4664500,"kb_used_data":3510944,"kb_used_omap":4,"kb_used_meta":1153531,"kb_avail":729338700,"statfs":{"total":751619276800,"available":746842828800,"internally_reserved":0,"allocated":3595206656,"data_stored":3594885827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5102,"internal_metadata":1181215762},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3476136,"kb_used_data":2484564,"kb_used_omap":4,"kb_used_meta":991547,"kb_avail":730527064,"statfs":{"total":751619276800,"available":748059713536,"internally_reserved":0,"allocated":2544193536,"data_stored":2543876259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":1015344802},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,12,15],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4024020,"kb_used_data":2919488,"kb_used_omap":4,"kb_used_meta":1104507,"kb_avail":729979180,"statfs":{"total":751619276800,"available":747498680320,"internally_reserved":0,"allocated":2989555712,"data_stored":2989234883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":1131015835},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1694,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3036823552,"data_stored":3036823552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2570878976,"data_stored":2570878976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3609116672,"data_stored":3609116672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2334056448,"data_stored":2334056448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:38.147 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:50:38.148 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 46 2026-02-24T07:50:38.299 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:38.427 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:38.424+0000 7ff846da0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:38.427 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:38.425+0000 7ff846da0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:38.579 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:50:38.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:39.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 127 516144 516017 77.5207 81.9922 0.012583 0.0128965 2026-02-24T07:50:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:38 trial016 ceph-mon[39544]: pgmap v139: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 9.02k op/s 2026-02-24T07:50:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/806205865' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T07:50:39.894 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:40.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 127 526696 526569 77.6133 82.4375 0.018241 0.0128817 2026-02-24T07:50:40.045 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:40.173 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:40.171+0000 7f4ef5a25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:40.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:39 trial016 ceph-mon[39544]: from='client.14699 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:40.174 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:40.171+0000 7f4ef5a25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:40.189 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:40.190 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:40.207 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:40.208 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:40.247 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:40.247 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:40.260 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:40.260 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:41.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 127 538007 537880 77.8123 88.3672 0.00121586 0.0128485 2026-02-24T07:50:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:40 trial016 ceph-mon[39544]: pgmap v140: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.04k op/s 2026-02-24T07:50:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4255872671' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:42.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 548018 547890 77.8193 78.2031 0.0126929 0.0128474 2026-02-24T07:50:42.307 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:42.458 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:42.582 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:42.579+0000 7f20a1335640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:42.582 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:42.580+0000 7f20a1335640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:42.597 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:42.597 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:42.624 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:42.624 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:42.638 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:42.638 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:42.653 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:42.653 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:43.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 558630 558502 77.91 82.9062 0.006678 0.0128321 2026-02-24T07:50:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:42 trial016 ceph-mon[39544]: pgmap v141: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.95k op/s 2026-02-24T07:50:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1005082984' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:43.623 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:43.623 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:43.623 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T07:50:43.623 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:43.771 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:43.903 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:43.900+0000 7f30248da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:43.903 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:43.900+0000 7f30248da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:44.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 128 569178 569050 77.9888 82.4062 0.00586932 0.0128181 2026-02-24T07:50:44.053 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:44.053 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:44.100 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2026-02-24T07:50:43.771222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4559462944,"num_objects":69566,"num_object_clones":0,"num_object_copies":208698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69566,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":556638,"num_write_kb":4454174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18290788,"kb_used_data":13230348,"kb_used_omap":21,"kb_used_meta":5060330,"kb_avail":2917722012,"statfs":{"total":3006477107200,"available":2987747340288,"internally_reserved":0,"allocated":13547876352,"data_stored":13546596588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21786,"internal_metadata":5181778662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1211105280,"num_objects":18479,"num_object_clones":0,"num_object_copies":55437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147840,"num_write_kb":1182720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001578"},"pg_stats":[{"pgid":"3.f","version":"49'35348","reported_seq":35367,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.769159+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:42.769159+0000","last_peered":"2026-02-24T07:50:42.769159+0000","last_clean":"2026-02-24T07:50:42.769159+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:42.769159+0000","last_undegraded":"2026-02-24T07:50:42.769159+0000","last_fullsized":"2026-02-24T07:50:42.769159+0000","mapping_epoch":41,"log_start":"49'35338","ondisk_log_start":"49'35338","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289570816,"num_objects":4419,"num_object_clones":0,"num_object_copies":13257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35348,"num_write_kb":282784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'34992","reported_seq":35018,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.755296+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:42.755296+0000","last_peered":"2026-02-24T07:50:42.755296+0000","last_clean":"2026-02-24T07:50:42.755296+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:42.755296+0000","last_undegraded":"2026-02-24T07:50:42.755296+0000","last_fullsized":"2026-02-24T07:50:42.755296+0000","mapping_epoch":41,"log_start":"49'34984","ondisk_log_start":"49'34984","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286654464,"num_objects":4374,"num_object_clones":0,"num_object_copies":13122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4374,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34992,"num_write_kb":279936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'34072","reported_seq":34098,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.755863+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:42.755863+0000","last_peered":"2026-02-24T07:50:42.755863+0000","last_clean":"2026-02-24T07:50:42.755863+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:42.755863+0000","last_undegraded":"2026-02-24T07:50:42.755863+0000","last_fullsized":"2026-02-24T07:50:42.755863+0000","mapping_epoch":41,"log_start":"49'34064","ondisk_log_start":"49'34064","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279117824,"num_objects":4259,"num_object_clones":0,"num_object_copies":12777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34072,"num_write_kb":272576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'35024","reported_seq":35046,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.784356+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:42.784356+0000","last_peered":"2026-02-24T07:50:42.784356+0000","last_clean":"2026-02-24T07:50:42.784356+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:42.784356+0000","last_undegraded":"2026-02-24T07:50:42.784356+0000","last_fullsized":"2026-02-24T07:50:42.784356+0000","mapping_epoch":41,"log_start":"49'35016","ondisk_log_start":"49'35016","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286916608,"num_objects":4378,"num_object_clones":0,"num_object_copies":13134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35024,"num_write_kb":280192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'33900","reported_seq":33920,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.861815+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:42.861815+0000","last_peered":"2026-02-24T07:50:42.861815+0000","last_clean":"2026-02-24T07:50:42.861815+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:42.861815+0000","last_undegraded":"2026-02-24T07:50:42.861815+0000","last_fullsized":"2026-02-24T07:50:42.861815+0000","mapping_epoch":41,"log_start":"49'33889","ondisk_log_start":"49'33889","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277708800,"num_objects":4238,"num_object_clones":0,"num_object_copies":12714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33900,"num_write_kb":271200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'34664","reported_seq":34690,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.781922+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:42.781922+0000","last_peered":"2026-02-24T07:50:42.781922+0000","last_clean":"2026-02-24T07:50:42.781922+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:42.781922+0000","last_undegraded":"2026-02-24T07:50:42.781922+0000","last_fullsized":"2026-02-24T07:50:42.781922+0000","mapping_epoch":41,"log_start":"49'34632","ondisk_log_start":"49'34632","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283967488,"num_objects":4333,"num_object_clones":0,"num_object_copies":12999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34664,"num_write_kb":277312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'35296","reported_seq":35322,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.751038+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:42.751038+0000","last_peered":"2026-02-24T07:50:42.751038+0000","last_clean":"2026-02-24T07:50:42.751038+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:42.751038+0000","last_undegraded":"2026-02-24T07:50:42.751038+0000","last_fullsized":"2026-02-24T07:50:42.751038+0000","mapping_epoch":41,"log_start":"49'35288","ondisk_log_start":"49'35288","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289144832,"num_objects":4412,"num_object_clones":0,"num_object_copies":13236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35296,"num_write_kb":282368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'34599","reported_seq":34618,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.860770+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:42.860770+0000","last_peered":"2026-02-24T07:50:42.860770+0000","last_clean":"2026-02-24T07:50:42.860770+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:42.860770+0000","last_undegraded":"2026-02-24T07:50:42.860770+0000","last_fullsized":"2026-02-24T07:50:42.860770+0000","mapping_epoch":41,"log_start":"49'34591","ondisk_log_start":"49'34591","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283435008,"num_objects":4325,"num_object_clones":0,"num_object_copies":12975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34599,"num_write_kb":276792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'35072","reported_seq":35098,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.861836+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:42.861836+0000","last_peered":"2026-02-24T07:50:42.861836+0000","last_clean":"2026-02-24T07:50:42.861836+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:42.861836+0000","last_undegraded":"2026-02-24T07:50:42.861836+0000","last_fullsized":"2026-02-24T07:50:42.861836+0000","mapping_epoch":41,"log_start":"49'35056","ondisk_log_start":"49'35056","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287309824,"num_objects":4384,"num_object_clones":0,"num_object_copies":13152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4384,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35072,"num_write_kb":280576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'34384","reported_seq":34410,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.756649+0000","last_change":"2026-02-24T07:49:45.869304+0000","last_active":"2026-02-24T07:50:42.756649+0000","last_peered":"2026-02-24T07:50:42.756649+0000","last_clean":"2026-02-24T07:50:42.756649+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:42.756649+0000","last_undegraded":"2026-02-24T07:50:42.756649+0000","last_fullsized":"2026-02-24T07:50:42.756649+0000","mapping_epoch":41,"log_start":"49'34376","ondisk_log_start":"49'34376","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:44.979809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281673728,"num_objects":4298,"num_object_clones":0,"num_object_copies":12894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34384,"num_write_kb":275072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'33632","reported_seq":33650,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.768935+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:42.768935+0000","last_peered":"2026-02-24T07:50:42.768935+0000","last_clean":"2026-02-24T07:50:42.768935+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:42.768935+0000","last_undegraded":"2026-02-24T07:50:42.768935+0000","last_fullsized":"2026-02-24T07:50:42.768935+0000","mapping_epoch":41,"log_start":"49'33621","ondisk_log_start":"49'33621","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275513344,"num_objects":4204,"num_object_clones":0,"num_object_copies":12612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33632,"num_write_kb":269056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'35000","reported_seq":35026,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.828466+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:42.828466+0000","last_peered":"2026-02-24T07:50:42.828466+0000","last_clean":"2026-02-24T07:50:42.828466+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:42.828466+0000","last_undegraded":"2026-02-24T07:50:42.828466+0000","last_fullsized":"2026-02-24T07:50:42.828466+0000","mapping_epoch":41,"log_start":"49'34992","ondisk_log_start":"49'34992","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286720000,"num_objects":4375,"num_object_clones":0,"num_object_copies":13125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35000,"num_write_kb":280000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'35296","reported_seq":35319,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.768432+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:42.768432+0000","last_peered":"2026-02-24T07:50:42.768432+0000","last_clean":"2026-02-24T07:50:42.768432+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:42.768432+0000","last_undegraded":"2026-02-24T07:50:42.768432+0000","last_fullsized":"2026-02-24T07:50:42.768432+0000","mapping_epoch":41,"log_start":"49'35288","ondisk_log_start":"49'35288","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289144832,"num_objects":4412,"num_object_clones":0,"num_object_copies":13236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35296,"num_write_kb":282368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'35048","reported_seq":35074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.778897+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:42.778897+0000","last_peered":"2026-02-24T07:50:42.778897+0000","last_clean":"2026-02-24T07:50:42.778897+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:42.778897+0000","last_undegraded":"2026-02-24T07:50:42.778897+0000","last_fullsized":"2026-02-24T07:50:42.778897+0000","mapping_epoch":41,"log_start":"49'35025","ondisk_log_start":"49'35025","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287113216,"num_objects":4381,"num_object_clones":0,"num_object_copies":13143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35048,"num_write_kb":280384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'35472","reported_seq":35492,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.861407+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:42.861407+0000","last_peered":"2026-02-24T07:50:42.861407+0000","last_clean":"2026-02-24T07:50:42.861407+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:42.861407+0000","last_undegraded":"2026-02-24T07:50:42.861407+0000","last_fullsized":"2026-02-24T07:50:42.861407+0000","mapping_epoch":41,"log_start":"49'35451","ondisk_log_start":"49'35451","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290586624,"num_objects":4434,"num_object_clones":0,"num_object_copies":13302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35472,"num_write_kb":283776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'34704","reported_seq":34730,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:42.860462+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:42.860462+0000","last_peered":"2026-02-24T07:50:42.860462+0000","last_clean":"2026-02-24T07:50:42.860462+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:42.860462+0000","last_undegraded":"2026-02-24T07:50:42.860462+0000","last_fullsized":"2026-02-24T07:50:42.860462+0000","mapping_epoch":41,"log_start":"49'34688","ondisk_log_start":"49'34688","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284295168,"num_objects":4338,"num_object_clones":0,"num_object_copies":13014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34704,"num_write_kb":277632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":253,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:36.300120+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:50:36.300120+0000","last_peered":"2026-02-24T07:50:36.300120+0000","last_clean":"2026-02-24T07:50:36.300120+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:50:36.300120+0000","last_undegraded":"2026-02-24T07:50:36.300120+0000","last_fullsized":"2026-02-24T07:50:36.300120+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":4558872576,"num_objects":69564,"num_object_clones":0,"num_object_copies":208692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556503,"num_write_kb":4452024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13674356736,"data_stored":13674356736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4154428,"kb_used_data":2753448,"kb_used_omap":7,"kb_used_meta":1400952,"kb_avail":729848772,"statfs":{"total":751619276800,"available":747365142528,"internally_reserved":0,"allocated":2819530752,"data_stored":2819209923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7785,"internal_metadata":1434575255},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444083,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5147412,"kb_used_data":3867520,"kb_used_omap":4,"kb_used_meta":1279867,"kb_avail":728855788,"statfs":{"total":751619276800,"available":746348326912,"internally_reserved":0,"allocated":3960340480,"data_stored":3960019651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5102,"internal_metadata":1310583826},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4227728,"kb_used_data":3037500,"kb_used_omap":4,"kb_used_meta":1190203,"kb_avail":729775472,"statfs":{"total":751619276800,"available":747290083328,"internally_reserved":0,"allocated":3110400000,"data_stored":3110082723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":1218768546},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4761220,"kb_used_data":3571880,"kb_used_omap":4,"kb_used_meta":1189307,"kb_avail":729241980,"statfs":{"total":751619276800,"available":746743787520,"internally_reserved":0,"allocated":3657605120,"data_stored":3657284291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":1217851035},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3702603776,"data_stored":3702603776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3138674688,"data_stored":3138674688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3982082048,"data_stored":3982082048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2850996224,"data_stored":2850996224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:44.103 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 46 2026-02-24T07:50:44.260 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:44.396 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:44.393+0000 7fa591892640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:44.396 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:44.393+0000 7fa591892640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:44.550 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:50:44.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:44.703 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:44.857 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:44.986 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:44.983+0000 7f95d392a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:44.986 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:44.983+0000 7f95d392a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:45.002 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:45.003 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:45.003 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 128 579882 579754 78.0859 83.625 0.0207873 0.0128026 2026-02-24T07:50:45.020 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:45.020 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:45.041 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:45.041 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:45.055 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:45.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:44 trial016 ceph-mon[39544]: pgmap v142: 17 pgs: 17 active+clean; 4.2 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s wr, 12.32k op/s 2026-02-24T07:50:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/143323787' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T07:50:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:46.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 128 590413 590285 78.1568 82.2734 0.0101691 0.0127922 2026-02-24T07:50:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:45 trial016 ceph-mon[39544]: from='client.14707 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2498011317' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:47.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:50:47.002672+0000 min lat: 0.000613999 max lat: 0.0954064 avg lat: 0.012778 2026-02-24T07:50:47.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:50:47.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 601059 600931 78.2402 83.1719 0.00748721 0.012778 2026-02-24T07:50:47.104 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:47.253 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:47.279 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:46 trial016 ceph-mon[39544]: pgmap v143: 17 pgs: 17 active+clean; 4.2 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.38k op/s 2026-02-24T07:50:47.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:47.369+0000 7f4df544c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:47.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:47.369+0000 7f4df544c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:47.387 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:47.387 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:47.411 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:47.411 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:47.426 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:47.426 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:47.440 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:47.440 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:48.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 611527 611399 78.2982 81.7812 0.014136 0.0127689 2026-02-24T07:50:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:47 trial016 ceph-mon[39544]: 3.6 scrub starts 2026-02-24T07:50:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1757373036' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:49.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 621640 621512 78.3095 79.0078 0.00162063 0.0127663 2026-02-24T07:50:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:48 trial016 ceph-mon[39544]: pgmap v144: 17 pgs: 17 active+clean; 4.2 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.38k op/s 2026-02-24T07:50:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:48 trial016 ceph-mon[39544]: 3.6 scrub ok 2026-02-24T07:50:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:48 trial016 ceph-mon[39544]: 3.e scrub starts 2026-02-24T07:50:49.491 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:49.594 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:49.594 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:49.594 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T07:50:49.595 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:49.644 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:49.747 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:49.774 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:49.772+0000 7f7a01ec6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:49.774 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:49.772+0000 7f7a01ec6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:49.791 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:49.791 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:49.814 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:49.815 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:49.844 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:49.844 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:49.855 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:49.855 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:50.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 631675 631547 78.3108 78.3984 0.00397118 0.0127662 2026-02-24T07:50:50.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4149121712' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:50.839 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:50.807+0000 7f013789a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:50.839 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:50.807+0000 7f013789a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:50.965 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:50.966 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:51.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 128 639696 639568 78.0663 62.6641 0.00468814 0.0128074 2026-02-24T07:50:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:50 trial016 ceph-mon[39544]: pgmap v145: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 92 MiB/s wr, 11.75k op/s 2026-02-24T07:50:51.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:50 trial016 ceph-mon[39544]: 3.e scrub ok 2026-02-24T07:50:51.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:50 trial016 ceph-mon[39544]: 3.f scrub starts 2026-02-24T07:50:51.666 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2026-02-24T07:50:49.772077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4991566368,"num_objects":76160,"num_object_clones":0,"num_object_copies":228480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76160,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":609385,"num_write_kb":4876150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19906916,"kb_used_data":14503572,"kb_used_omap":21,"kb_used_meta":5403242,"kb_avail":2916105884,"statfs":{"total":3006477107200,"available":2986092425216,"internally_reserved":0,"allocated":14851657728,"data_stored":14850377964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21786,"internal_metadata":5532920550},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,9,8,28,12,25],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1155039232,"num_objects":17623,"num_object_clones":0,"num_object_copies":52869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140996,"num_write_kb":1127968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001651"},"pg_stats":[{"pgid":"3.f","version":"49'38640","reported_seq":38666,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.766092+0000","last_change":"2026-02-24T07:49:45.868658+0000","last_active":"2026-02-24T07:50:47.766092+0000","last_peered":"2026-02-24T07:50:47.766092+0000","last_clean":"2026-02-24T07:50:47.766092+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:47.766092+0000","last_undegraded":"2026-02-24T07:50:47.766092+0000","last_fullsized":"2026-02-24T07:50:47.766092+0000","mapping_epoch":41,"log_start":"49'38632","ondisk_log_start":"49'38632","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.821620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316538880,"num_objects":4830,"num_object_clones":0,"num_object_copies":14490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38640,"num_write_kb":309120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'38232","reported_seq":38258,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.768925+0000","last_change":"2026-02-24T07:49:45.867660+0000","last_active":"2026-02-24T07:50:47.768925+0000","last_peered":"2026-02-24T07:50:47.768925+0000","last_clean":"2026-02-24T07:50:47.768925+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:47.768925+0000","last_undegraded":"2026-02-24T07:50:47.768925+0000","last_fullsized":"2026-02-24T07:50:47.768925+0000","mapping_epoch":41,"log_start":"49'38224","ondisk_log_start":"49'38224","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:47.875629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313196544,"num_objects":4779,"num_object_clones":0,"num_object_copies":14337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38232,"num_write_kb":305856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'37496","reported_seq":37522,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.763940+0000","last_change":"2026-02-24T07:49:45.869417+0000","last_active":"2026-02-24T07:50:47.763940+0000","last_peered":"2026-02-24T07:50:47.763940+0000","last_clean":"2026-02-24T07:50:47.763940+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:47.763940+0000","last_undegraded":"2026-02-24T07:50:47.763940+0000","last_fullsized":"2026-02-24T07:50:47.763940+0000","mapping_epoch":41,"log_start":"49'37492","ondisk_log_start":"49'37492","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:48.460537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307167232,"num_objects":4687,"num_object_clones":0,"num_object_copies":14061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37496,"num_write_kb":299968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'38122","reported_seq":38131,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.776773+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:47.776773+0000","last_peered":"2026-02-24T07:50:47.776773+0000","last_clean":"2026-02-24T07:50:47.776773+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:47.776773+0000","last_undegraded":"2026-02-24T07:50:47.776773+0000","last_fullsized":"2026-02-24T07:50:47.776773+0000","mapping_epoch":41,"log_start":"49'38104","ondisk_log_start":"49'38104","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312295424,"num_objects":4766,"num_object_clones":0,"num_object_copies":14298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38122,"num_write_kb":304976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'37168","reported_seq":37194,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.861184+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:47.861184+0000","last_peered":"2026-02-24T07:50:47.861184+0000","last_clean":"2026-02-24T07:50:47.861184+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:47.861184+0000","last_undegraded":"2026-02-24T07:50:47.861184+0000","last_fullsized":"2026-02-24T07:50:47.861184+0000","mapping_epoch":41,"log_start":"49'37160","ondisk_log_start":"49'37160","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304480256,"num_objects":4646,"num_object_clones":0,"num_object_copies":13938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4646,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37168,"num_write_kb":297344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'37928","reported_seq":37954,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.775819+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:47.775819+0000","last_peered":"2026-02-24T07:50:47.775819+0000","last_clean":"2026-02-24T07:50:47.775819+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:47.775819+0000","last_undegraded":"2026-02-24T07:50:47.775819+0000","last_fullsized":"2026-02-24T07:50:47.775819+0000","mapping_epoch":41,"log_start":"49'37912","ondisk_log_start":"49'37912","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.649257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310706176,"num_objects":4741,"num_object_clones":0,"num_object_copies":14223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37928,"num_write_kb":303424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'38312","reported_seq":38338,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.756878+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:47.756878+0000","last_peered":"2026-02-24T07:50:47.756878+0000","last_clean":"2026-02-24T07:50:47.756878+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:47.756878+0000","last_undegraded":"2026-02-24T07:50:47.756878+0000","last_fullsized":"2026-02-24T07:50:47.756878+0000","mapping_epoch":41,"log_start":"49'38307","ondisk_log_start":"49'38307","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313851904,"num_objects":4789,"num_object_clones":0,"num_object_copies":14367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38312,"num_write_kb":306496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'38048","reported_seq":38074,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.861613+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:47.861613+0000","last_peered":"2026-02-24T07:50:47.861613+0000","last_clean":"2026-02-24T07:50:47.861613+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:47.861613+0000","last_undegraded":"2026-02-24T07:50:47.861613+0000","last_fullsized":"2026-02-24T07:50:47.861613+0000","mapping_epoch":41,"log_start":"49'38032","ondisk_log_start":"49'38032","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311689216,"num_objects":4756,"num_object_clones":0,"num_object_copies":14268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38048,"num_write_kb":304384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'38280","reported_seq":38306,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.844676+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:47.844676+0000","last_peered":"2026-02-24T07:50:47.844676+0000","last_clean":"2026-02-24T07:50:47.844676+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:47.844676+0000","last_undegraded":"2026-02-24T07:50:47.844676+0000","last_fullsized":"2026-02-24T07:50:47.844676+0000","mapping_epoch":41,"log_start":"49'38272","ondisk_log_start":"49'38272","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:52.298472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313589760,"num_objects":4785,"num_object_clones":0,"num_object_copies":14355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38280,"num_write_kb":306240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'37808","reported_seq":37874,"reported_epoch":49,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:50:47.788926+0000","last_change":"2026-02-24T07:50:47.116266+0000","last_active":"2026-02-24T07:50:47.788926+0000","last_peered":"2026-02-24T07:50:47.788926+0000","last_clean":"2026-02-24T07:50:47.788926+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:47.788926+0000","last_undegraded":"2026-02-24T07:50:47.788926+0000","last_fullsized":"2026-02-24T07:50:47.788926+0000","mapping_epoch":41,"log_start":"49'37800","ondisk_log_start":"49'37800","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":3549,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309723136,"num_objects":4726,"num_object_clones":0,"num_object_copies":14178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37808,"num_write_kb":302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'36858","reported_seq":36884,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.772583+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:47.772583+0000","last_peered":"2026-02-24T07:50:47.772583+0000","last_clean":"2026-02-24T07:50:47.772583+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:47.772583+0000","last_undegraded":"2026-02-24T07:50:47.772583+0000","last_fullsized":"2026-02-24T07:50:47.772583+0000","mapping_epoch":41,"log_start":"49'36855","ondisk_log_start":"49'36855","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301940736,"num_objects":4608,"num_object_clones":0,"num_object_copies":13824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36858,"num_write_kb":294864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'38334","reported_seq":38356,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.864094+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:47.864094+0000","last_peered":"2026-02-24T07:50:47.864094+0000","last_clean":"2026-02-24T07:50:47.864094+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:47.864094+0000","last_undegraded":"2026-02-24T07:50:47.864094+0000","last_fullsized":"2026-02-24T07:50:47.864094+0000","mapping_epoch":41,"log_start":"49'38328","ondisk_log_start":"49'38328","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314032128,"num_objects":4792,"num_object_clones":0,"num_object_copies":14376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38334,"num_write_kb":306672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'38608","reported_seq":38634,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.771638+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:47.771638+0000","last_peered":"2026-02-24T07:50:47.771638+0000","last_clean":"2026-02-24T07:50:47.771638+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:47.771638+0000","last_undegraded":"2026-02-24T07:50:47.771638+0000","last_fullsized":"2026-02-24T07:50:47.771638+0000","mapping_epoch":41,"log_start":"49'38605","ondisk_log_start":"49'38605","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316276736,"num_objects":4826,"num_object_clones":0,"num_object_copies":14478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38608,"num_write_kb":308864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'38528","reported_seq":38554,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.769951+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:47.769951+0000","last_peered":"2026-02-24T07:50:47.769951+0000","last_clean":"2026-02-24T07:50:47.769951+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:47.769951+0000","last_undegraded":"2026-02-24T07:50:47.769951+0000","last_fullsized":"2026-02-24T07:50:47.769951+0000","mapping_epoch":41,"log_start":"49'38520","ondisk_log_start":"49'38520","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315621376,"num_objects":4816,"num_object_clones":0,"num_object_copies":14448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38528,"num_write_kb":308224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'38912","reported_seq":38938,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.845864+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:47.845864+0000","last_peered":"2026-02-24T07:50:47.845864+0000","last_clean":"2026-02-24T07:50:47.845864+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:47.845864+0000","last_undegraded":"2026-02-24T07:50:47.845864+0000","last_fullsized":"2026-02-24T07:50:47.845864+0000","mapping_epoch":41,"log_start":"49'38904","ondisk_log_start":"49'38904","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":4864,"num_object_clones":0,"num_object_copies":14592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38912,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'37976","reported_seq":38002,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:47.830897+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:47.830897+0000","last_peered":"2026-02-24T07:50:47.830897+0000","last_clean":"2026-02-24T07:50:47.830897+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:47.830897+0000","last_undegraded":"2026-02-24T07:50:47.830897+0000","last_fullsized":"2026-02-24T07:50:47.830897+0000","mapping_epoch":41,"log_start":"49'37968","ondisk_log_start":"49'37968","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311099392,"num_objects":4747,"num_object_clones":0,"num_object_copies":14241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37976,"num_write_kb":303808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":253,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:36.300120+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:50:36.300120+0000","last_peered":"2026-02-24T07:50:36.300120+0000","last_clean":"2026-02-24T07:50:36.300120+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:50:36.300120+0000","last_undegraded":"2026-02-24T07:50:36.300120+0000","last_fullsized":"2026-02-24T07:50:36.300120+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":4990976000,"num_objects":76158,"num_object_clones":0,"num_object_copies":228474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609250,"num_write_kb":4874000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14971731968,"data_stored":14971731968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215155,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4472188,"kb_used_data":3017064,"kb_used_omap":7,"kb_used_meta":1455096,"kb_avail":729531012,"statfs":{"total":751619276800,"available":747039756288,"internally_reserved":0,"allocated":3089473536,"data_stored":3089152707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7785,"internal_metadata":1490018711},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444084,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5629900,"kb_used_data":4241720,"kb_used_omap":4,"kb_used_meta":1388155,"kb_avail":728373300,"statfs":{"total":751619276800,"available":745854259200,"internally_reserved":0,"allocated":4343521280,"data_stored":4343200451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5102,"internal_metadata":1421470738},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4591552,"kb_used_data":3329132,"kb_used_omap":4,"kb_used_meta":1262395,"kb_avail":729411648,"statfs":{"total":751619276800,"available":746917527552,"internally_reserved":0,"allocated":3409031168,"data_stored":3408713891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":1292693154},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,9,8,28,12,25],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5213276,"kb_used_data":3915656,"kb_used_omap":4,"kb_used_meta":1297595,"kb_avail":728789924,"statfs":{"total":751619276800,"available":746280882176,"internally_reserved":0,"allocated":4009631744,"data_stored":4009310915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":1328737947},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4054654976,"data_stored":4054654976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3437658112,"data_stored":3437658112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4362706944,"data_stored":4362706944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3116711936,"data_stored":3116711936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:51.668 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 46 2026-02-24T07:50:51.818 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:52.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 127 647918 647791 77.8535 64.2422 0.00550507 0.0128424 2026-02-24T07:50:52.254 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:51 trial016 ceph-mon[39544]: from='client.14717 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:50:52.254 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:51 trial016 ceph-mon[39544]: 3.f scrub ok 2026-02-24T07:50:52.355 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:52.309+0000 7f0f41e13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:52.356 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:52.309+0000 7f0f41e13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:52.460 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:50:52.638 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:52.860 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:52.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:52.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:52.989+0000 7f4987740640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:52.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:52.989+0000 7f4987740640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:53.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 656712 656584 77.7147 68.6953 0.00593801 0.0128652 2026-02-24T07:50:53.007 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:53.007 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:53.028 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:53.029 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:53.046 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:53.046 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:53.065 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:53.065 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:52 trial016 ceph-mon[39544]: pgmap v146: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.77k op/s 2026-02-24T07:50:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:52 trial016 ceph-mon[39544]: 3.d scrub starts 2026-02-24T07:50:53.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4243978498' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T07:50:54.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 127 667178 667051 77.7752 81.7734 0.0136917 0.0128549 2026-02-24T07:50:54.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:53 trial016 ceph-mon[39544]: 3.d scrub ok 2026-02-24T07:50:54.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/407146388' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:54.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:53 trial016 ceph-mon[39544]: 3.a scrub starts 2026-02-24T07:50:55.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 127 677219 677092 77.7849 78.4453 0.00199409 0.0128525 2026-02-24T07:50:55.114 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:50:55.266 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:54 trial016 ceph-mon[39544]: 3.7 scrub starts 2026-02-24T07:50:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:54 trial016 ceph-mon[39544]: pgmap v147: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 98 MiB/s wr, 12.56k op/s 2026-02-24T07:50:55.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:54 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:50:55.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:50:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:50:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:50:55.711 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:55.712 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:55.670+0000 7f2fe3c44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:55.712 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:55.670+0000 7f2fe3c44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:55.712 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:55.721 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:55.721 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:55.734 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:55.735 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:55.752 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:55.752 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:56.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 685802 685674 77.6292 67.0469 0.00423614 0.0128787 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: 3.a scrub ok 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: 3.7 scrub ok 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:50:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3396231066' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:57.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 128 694437 694309 77.4839 67.4609 0.0137599 0.0129034 2026-02-24T07:50:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:56 trial016 ceph-mon[39544]: pgmap v148: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.19k op/s 2026-02-24T07:50:57.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:50:57.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:50:57.875 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T07:50:57.875 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:50:58.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 704967 704839 77.5512 82.2656 0.00626462 0.0128923 2026-02-24T07:50:58.027 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:58.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.157+0000 7f52005eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.157+0000 7f52005eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.299 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:50:58.300 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:50:58.348 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2026-02-24T07:50:57.773139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5364261408,"num_objects":81846,"num_object_clones":0,"num_object_copies":245538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81846,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":654880,"num_write_kb":5240110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21363580,"kb_used_data":15612524,"kb_used_omap":21,"kb_used_meta":5750954,"kb_avail":2914649220,"statfs":{"total":3006477107200,"available":2984600801280,"internally_reserved":0,"allocated":15987224576,"data_stored":15985944812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21786,"internal_metadata":5888977638},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,0,0,9,27,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":804798464,"num_objects":12280,"num_object_clones":0,"num_object_copies":36840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98242,"num_write_kb":785936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001582"},"pg_stats":[{"pgid":"3.f","version":"49'41568","reported_seq":41653,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.760436+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:50:52.760436+0000","last_peered":"2026-02-24T07:50:52.760436+0000","last_clean":"2026-02-24T07:50:52.760436+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:50:52.760436+0000","last_undegraded":"2026-02-24T07:50:52.760436+0000","last_fullsized":"2026-02-24T07:50:52.760436+0000","mapping_epoch":41,"log_start":"49'41536","ondisk_log_start":"49'41536","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340525056,"num_objects":5196,"num_object_clones":0,"num_object_copies":15588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41568,"num_write_kb":332544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'41264","reported_seq":41347,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.766165+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:50:52.766165+0000","last_peered":"2026-02-24T07:50:52.766165+0000","last_clean":"2026-02-24T07:50:52.766165+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:50:52.766165+0000","last_undegraded":"2026-02-24T07:50:52.766165+0000","last_fullsized":"2026-02-24T07:50:52.766165+0000","mapping_epoch":41,"log_start":"49'41256","ondisk_log_start":"49'41256","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338034688,"num_objects":5158,"num_object_clones":0,"num_object_copies":15474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41264,"num_write_kb":330112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'40272","reported_seq":40339,"reported_epoch":49,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:50:52.782822+0000","last_change":"2026-02-24T07:50:52.135105+0000","last_active":"2026-02-24T07:50:52.782822+0000","last_peered":"2026-02-24T07:50:52.782822+0000","last_clean":"2026-02-24T07:50:52.782822+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:50:52.782822+0000","last_undegraded":"2026-02-24T07:50:52.782822+0000","last_fullsized":"2026-02-24T07:50:52.782822+0000","mapping_epoch":41,"log_start":"49'40264","ondisk_log_start":"49'40264","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":3649,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329908224,"num_objects":5034,"num_object_clones":0,"num_object_copies":15102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40272,"num_write_kb":322176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'40984","reported_seq":41010,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.767521+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:50:52.767521+0000","last_peered":"2026-02-24T07:50:52.767521+0000","last_clean":"2026-02-24T07:50:52.767521+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:50:52.767521+0000","last_undegraded":"2026-02-24T07:50:52.767521+0000","last_fullsized":"2026-02-24T07:50:52.767521+0000","mapping_epoch":41,"log_start":"49'40976","ondisk_log_start":"49'40976","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335740928,"num_objects":5123,"num_object_clones":0,"num_object_copies":15369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40984,"num_write_kb":327872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'39768","reported_seq":39789,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.866033+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:50:52.866033+0000","last_peered":"2026-02-24T07:50:52.866033+0000","last_clean":"2026-02-24T07:50:52.866033+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:50:52.866033+0000","last_undegraded":"2026-02-24T07:50:52.866033+0000","last_fullsized":"2026-02-24T07:50:52.866033+0000","mapping_epoch":41,"log_start":"49'39748","ondisk_log_start":"49'39748","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:56.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325779456,"num_objects":4971,"num_object_clones":0,"num_object_copies":14913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39768,"num_write_kb":318144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'40872","reported_seq":40898,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.768199+0000","last_change":"2026-02-24T07:49:45.869743+0000","last_active":"2026-02-24T07:50:52.768199+0000","last_peered":"2026-02-24T07:50:52.768199+0000","last_clean":"2026-02-24T07:50:52.768199+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:50:52.768199+0000","last_undegraded":"2026-02-24T07:50:52.768199+0000","last_fullsized":"2026-02-24T07:50:52.768199+0000","mapping_epoch":41,"log_start":"49'40864","ondisk_log_start":"49'40864","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334823424,"num_objects":5109,"num_object_clones":0,"num_object_copies":15327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40872,"num_write_kb":326976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'41352","reported_seq":41378,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.778017+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:50:52.778017+0000","last_peered":"2026-02-24T07:50:52.778017+0000","last_clean":"2026-02-24T07:50:52.778017+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:50:52.778017+0000","last_undegraded":"2026-02-24T07:50:52.778017+0000","last_fullsized":"2026-02-24T07:50:52.778017+0000","mapping_epoch":41,"log_start":"49'41340","ondisk_log_start":"49'41340","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338755584,"num_objects":5169,"num_object_clones":0,"num_object_copies":15507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41352,"num_write_kb":330816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'41032","reported_seq":41058,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.857115+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:50:52.857115+0000","last_peered":"2026-02-24T07:50:52.857115+0000","last_clean":"2026-02-24T07:50:52.857115+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:50:52.857115+0000","last_undegraded":"2026-02-24T07:50:52.857115+0000","last_fullsized":"2026-02-24T07:50:52.857115+0000","mapping_epoch":41,"log_start":"49'41028","ondisk_log_start":"49'41028","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336134144,"num_objects":5129,"num_object_clones":0,"num_object_copies":15387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41032,"num_write_kb":328256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'41056","reported_seq":41082,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.859002+0000","last_change":"2026-02-24T07:49:45.868992+0000","last_active":"2026-02-24T07:50:52.859002+0000","last_peered":"2026-02-24T07:50:52.859002+0000","last_clean":"2026-02-24T07:50:52.859002+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:50:52.859002+0000","last_undegraded":"2026-02-24T07:50:52.859002+0000","last_fullsized":"2026-02-24T07:50:52.859002+0000","mapping_epoch":41,"log_start":"49'41025","ondisk_log_start":"49'41025","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":3000,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336330752,"num_objects":5132,"num_object_clones":0,"num_object_copies":15396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41056,"num_write_kb":328448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'40557","reported_seq":40640,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.785675+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:50:52.785675+0000","last_peered":"2026-02-24T07:50:52.785675+0000","last_clean":"2026-02-24T07:50:52.785675+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:50:52.785675+0000","last_undegraded":"2026-02-24T07:50:52.785675+0000","last_fullsized":"2026-02-24T07:50:52.785675+0000","mapping_epoch":41,"log_start":"49'40536","ondisk_log_start":"49'40536","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332242944,"num_objects":5070,"num_object_clones":0,"num_object_copies":15210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40557,"num_write_kb":324456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'39732","reported_seq":39753,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.773530+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:50:52.773530+0000","last_peered":"2026-02-24T07:50:52.773530+0000","last_clean":"2026-02-24T07:50:52.773530+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:50:52.773530+0000","last_undegraded":"2026-02-24T07:50:52.773530+0000","last_fullsized":"2026-02-24T07:50:52.773530+0000","mapping_epoch":41,"log_start":"49'39713","ondisk_log_start":"49'39713","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325484544,"num_objects":4967,"num_object_clones":0,"num_object_copies":14901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39732,"num_write_kb":317856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'41224","reported_seq":41243,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.845962+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:50:52.845962+0000","last_peered":"2026-02-24T07:50:52.845962+0000","last_clean":"2026-02-24T07:50:52.845962+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:50:52.845962+0000","last_undegraded":"2026-02-24T07:50:52.845962+0000","last_fullsized":"2026-02-24T07:50:52.845962+0000","mapping_epoch":41,"log_start":"49'41216","ondisk_log_start":"49'41216","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:00.044453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337707008,"num_objects":5153,"num_object_clones":0,"num_object_copies":15459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41224,"num_write_kb":329792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'41408","reported_seq":41432,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.772658+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:50:52.772658+0000","last_peered":"2026-02-24T07:50:52.772658+0000","last_clean":"2026-02-24T07:50:52.772658+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:50:52.772658+0000","last_undegraded":"2026-02-24T07:50:52.772658+0000","last_fullsized":"2026-02-24T07:50:52.772658+0000","mapping_epoch":41,"log_start":"49'41400","ondisk_log_start":"49'41400","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:59.499898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339214336,"num_objects":5176,"num_object_clones":0,"num_object_copies":15528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41408,"num_write_kb":331264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'41240","reported_seq":41266,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.785350+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:50:52.785350+0000","last_peered":"2026-02-24T07:50:52.785350+0000","last_clean":"2026-02-24T07:50:52.785350+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:50:52.785350+0000","last_undegraded":"2026-02-24T07:50:52.785350+0000","last_fullsized":"2026-02-24T07:50:52.785350+0000","mapping_epoch":41,"log_start":"49'41224","ondisk_log_start":"49'41224","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:01.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337838080,"num_objects":5155,"num_object_clones":0,"num_object_copies":15465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41240,"num_write_kb":329920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'41608","reported_seq":41634,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.837708+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:50:52.837708+0000","last_peered":"2026-02-24T07:50:52.837708+0000","last_clean":"2026-02-24T07:50:52.837708+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:50:52.837708+0000","last_undegraded":"2026-02-24T07:50:52.837708+0000","last_fullsized":"2026-02-24T07:50:52.837708+0000","mapping_epoch":41,"log_start":"49'41600","ondisk_log_start":"49'41600","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340852736,"num_objects":5201,"num_object_clones":0,"num_object_copies":15603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41608,"num_write_kb":332864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'40808","reported_seq":40834,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:52.844724+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:50:52.844724+0000","last_peered":"2026-02-24T07:50:52.844724+0000","last_clean":"2026-02-24T07:50:52.844724+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:50:52.844724+0000","last_undegraded":"2026-02-24T07:50:52.844724+0000","last_fullsized":"2026-02-24T07:50:52.844724+0000","mapping_epoch":41,"log_start":"49'40779","ondisk_log_start":"49'40779","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334299136,"num_objects":5101,"num_object_clones":0,"num_object_copies":15303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40808,"num_write_kb":326464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":253,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:36.300120+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:50:36.300120+0000","last_peered":"2026-02-24T07:50:36.300120+0000","last_clean":"2026-02-24T07:50:36.300120+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:50:36.300120+0000","last_undegraded":"2026-02-24T07:50:36.300120+0000","last_fullsized":"2026-02-24T07:50:36.300120+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":5363671040,"num_objects":81844,"num_object_clones":0,"num_object_copies":245532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654745,"num_write_kb":5237960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16088178688,"data_stored":16088178688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215156,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4774052,"kb_used_data":3246736,"kb_used_omap":7,"kb_used_meta":1527288,"kb_avail":729229148,"statfs":{"total":751619276800,"available":746730647552,"internally_reserved":0,"allocated":3324657664,"data_stored":3324336835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7785,"internal_metadata":1563943319},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444085,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6034380,"kb_used_data":4564152,"kb_used_omap":4,"kb_used_meta":1470203,"kb_avail":727968820,"statfs":{"total":751619276800,"available":745440071680,"internally_reserved":0,"allocated":4673691648,"data_stored":4673370819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5102,"internal_metadata":1505487890},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,0,0,9,27,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4946984,"kb_used_data":3581332,"kb_used_omap":4,"kb_used_meta":1365627,"kb_avail":729056216,"statfs":{"total":751619276800,"available":746553565184,"internally_reserved":0,"allocated":3667283968,"data_stored":3666966691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":1398402722},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5608164,"kb_used_data":4220304,"kb_used_omap":4,"kb_used_meta":1387835,"kb_avail":728395036,"statfs":{"total":751619276800,"available":745876516864,"internally_reserved":0,"allocated":4321591296,"data_stored":4321270467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":1421143707},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4354834432,"data_stored":4354834432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3692003328,"data_stored":3692003328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4688896000,"data_stored":4688896000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3352444928,"data_stored":3352444928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:50:58.350 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:50:58.350 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 56 2026-02-24T07:50:58.490 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:50:58.498 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:58.642 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.639+0000 7faf27ad0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.642 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.639+0000 7faf27ad0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.644 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:50:58.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.779+0000 7f2214834640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:50:58.779+0000 7f2214834640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:50:58.799 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:50:58.800 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:50:58.800 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:50:58.822 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:50:58.822 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:50:58.835 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:50:58.836 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:50:58.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:50:58.851 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:50:58.852 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:50:59.004 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 127 715578 715451 77.6255 82.9062 0.0108345 0.0128789 2026-02-24T07:50:59.056 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:58 trial016 ceph-mon[39544]: pgmap v149: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.19k op/s 2026-02-24T07:50:59.056 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2435649643' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:50:59.056 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/180757679' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T07:51:00.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 127 726669 726542 77.749 86.6484 0.0144825 0.0128597 2026-02-24T07:51:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:50:59 trial016 ceph-mon[39544]: from='client.14725 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:00.899 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:01.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 737144 737016 77.804 81.8281 0.00141385 0.0128499 2026-02-24T07:51:01.044 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:01.183 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:01.180+0000 7fe7c32f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:01.183 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:00 trial016 ceph-mon[39544]: pgmap v150: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s wr, 12.20k op/s 2026-02-24T07:51:01.183 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:01.180+0000 7fe7c32f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:01.201 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:01.202 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:01.221 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:01.221 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:01.237 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:01.237 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:01.251 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:01.251 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:02.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 127 747706 747579 77.8669 82.5234 0.00472271 0.0128394 2026-02-24T07:51:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/896715149' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:03.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 758058 757930 77.9063 80.8672 0.0163839 0.0128338 2026-02-24T07:51:03.296 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:02 trial016 ceph-mon[39544]: pgmap v151: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s wr, 7.80k op/s 2026-02-24T07:51:03.454 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:03.844 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:03.845 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:03.845 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T07:51:03.845 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:03.916 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:03.879+0000 7feb28b03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:03.917 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:03.879+0000 7feb28b03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:03.917 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:03.917 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:03.932 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:03.933 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:03.954 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:03.954 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:03.968 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:03.969 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:04.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 127 766656 766529 77.7669 67.1797 0.0258993 0.0128562 2026-02-24T07:51:04.222 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3791997240' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:04.724 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:05.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 127 774052 773925 77.5106 57.7812 0.00694518 0.0128991 2026-02-24T07:51:05.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:05.086+0000 7f48c1952640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:05.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:05.086+0000 7f48c1952640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:05.241 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:05.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:04 trial016 ceph-mon[39544]: pgmap v152: 17 pgs: 17 active+clean; 5.8 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s wr, 12.23k op/s 2026-02-24T07:51:05.243 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:05.243 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:05.289 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2026-02-24T07:51:03.773893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6194496032,"num_objects":94514,"num_object_clones":0,"num_object_copies":283542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94514,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":756227,"num_write_kb":6050886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23299508,"kb_used_data":18029476,"kb_used_omap":21,"kb_used_meta":5269930,"kb_avail":2912713292,"statfs":{"total":3006477107200,"available":2982618411008,"internally_reserved":0,"allocated":18462183424,"data_stored":18460903660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21786,"internal_metadata":5396409062},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,23,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1202929664,"num_objects":18354,"num_object_clones":0,"num_object_copies":55062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146842,"num_write_kb":1174736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001509"},"pg_stats":[{"pgid":"3.f","version":"49'47760","reported_seq":47845,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.748422+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:02.748422+0000","last_peered":"2026-02-24T07:51:02.748422+0000","last_clean":"2026-02-24T07:51:02.748422+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:02.748422+0000","last_undegraded":"2026-02-24T07:51:02.748422+0000","last_fullsized":"2026-02-24T07:51:02.748422+0000","mapping_epoch":41,"log_start":"49'47750","ondisk_log_start":"49'47750","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":391249920,"num_objects":5970,"num_object_clones":0,"num_object_copies":17910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47760,"num_write_kb":382080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'47608","reported_seq":47691,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.770779+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:02.770779+0000","last_peered":"2026-02-24T07:51:02.770779+0000","last_clean":"2026-02-24T07:51:02.770779+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:02.770779+0000","last_undegraded":"2026-02-24T07:51:02.770779+0000","last_fullsized":"2026-02-24T07:51:02.770779+0000","mapping_epoch":41,"log_start":"49'47583","ondisk_log_start":"49'47583","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390004736,"num_objects":5951,"num_object_clones":0,"num_object_copies":17853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47608,"num_write_kb":380864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'46536","reported_seq":46621,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.787796+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:02.787796+0000","last_peered":"2026-02-24T07:51:02.787796+0000","last_clean":"2026-02-24T07:51:02.787796+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:02.787796+0000","last_undegraded":"2026-02-24T07:51:02.787796+0000","last_fullsized":"2026-02-24T07:51:02.787796+0000","mapping_epoch":41,"log_start":"49'46530","ondisk_log_start":"49'46530","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381222912,"num_objects":5817,"num_object_clones":0,"num_object_copies":17451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46536,"num_write_kb":372288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'47680","reported_seq":47706,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.789029+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:51:02.789029+0000","last_peered":"2026-02-24T07:51:02.789029+0000","last_clean":"2026-02-24T07:51:02.789029+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:02.789029+0000","last_undegraded":"2026-02-24T07:51:02.789029+0000","last_fullsized":"2026-02-24T07:51:02.789029+0000","mapping_epoch":41,"log_start":"49'47664","ondisk_log_start":"49'47664","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:12.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390594560,"num_objects":5960,"num_object_clones":0,"num_object_copies":17880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47680,"num_write_kb":381440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'46212","reported_seq":46234,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.857127+0000","last_change":"2026-02-24T07:49:45.868818+0000","last_active":"2026-02-24T07:51:02.857127+0000","last_peered":"2026-02-24T07:51:02.857127+0000","last_clean":"2026-02-24T07:51:02.857127+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:02.857127+0000","last_undegraded":"2026-02-24T07:51:02.857127+0000","last_fullsized":"2026-02-24T07:51:02.857127+0000","mapping_epoch":41,"log_start":"49'46207","ondisk_log_start":"49'46207","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378568704,"num_objects":5777,"num_object_clones":0,"num_object_copies":17331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46212,"num_write_kb":369696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'47192","reported_seq":47279,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.774142+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:02.774142+0000","last_peered":"2026-02-24T07:51:02.774142+0000","last_clean":"2026-02-24T07:51:02.774142+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:02.774142+0000","last_undegraded":"2026-02-24T07:51:02.774142+0000","last_fullsized":"2026-02-24T07:51:02.774142+0000","mapping_epoch":41,"log_start":"49'47180","ondisk_log_start":"49'47180","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386596864,"num_objects":5899,"num_object_clones":0,"num_object_copies":17697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5899,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47192,"num_write_kb":377536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'47696","reported_seq":47722,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.773833+0000","last_change":"2026-02-24T07:49:45.868955+0000","last_active":"2026-02-24T07:51:02.773833+0000","last_peered":"2026-02-24T07:51:02.773833+0000","last_clean":"2026-02-24T07:51:02.773833+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:02.773833+0000","last_undegraded":"2026-02-24T07:51:02.773833+0000","last_fullsized":"2026-02-24T07:51:02.773833+0000","mapping_epoch":41,"log_start":"49'47688","ondisk_log_start":"49'47688","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390725632,"num_objects":5962,"num_object_clones":0,"num_object_copies":17886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47696,"num_write_kb":381568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'47272","reported_seq":47290,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.858412+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:51:02.858412+0000","last_peered":"2026-02-24T07:51:02.858412+0000","last_clean":"2026-02-24T07:51:02.858412+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:02.858412+0000","last_undegraded":"2026-02-24T07:51:02.858412+0000","last_fullsized":"2026-02-24T07:51:02.858412+0000","mapping_epoch":41,"log_start":"49'47256","ondisk_log_start":"49'47256","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387252224,"num_objects":5909,"num_object_clones":0,"num_object_copies":17727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47272,"num_write_kb":378176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'47160","reported_seq":47246,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.857645+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:02.857645+0000","last_peered":"2026-02-24T07:51:02.857645+0000","last_clean":"2026-02-24T07:51:02.857645+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:02.857645+0000","last_undegraded":"2026-02-24T07:51:02.857645+0000","last_fullsized":"2026-02-24T07:51:02.857645+0000","mapping_epoch":41,"log_start":"49'47152","ondisk_log_start":"49'47152","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386334720,"num_objects":5895,"num_object_clones":0,"num_object_copies":17685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47160,"num_write_kb":377280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'46672","reported_seq":46755,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.775943+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:02.775943+0000","last_peered":"2026-02-24T07:51:02.775943+0000","last_clean":"2026-02-24T07:51:02.775943+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:02.775943+0000","last_undegraded":"2026-02-24T07:51:02.775943+0000","last_fullsized":"2026-02-24T07:51:02.775943+0000","mapping_epoch":41,"log_start":"49'46664","ondisk_log_start":"49'46664","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382337024,"num_objects":5834,"num_object_clones":0,"num_object_copies":17502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5834,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46672,"num_write_kb":373376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'46024","reported_seq":46048,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.774038+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:51:02.774038+0000","last_peered":"2026-02-24T07:51:02.774038+0000","last_clean":"2026-02-24T07:51:02.774038+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:02.774038+0000","last_undegraded":"2026-02-24T07:51:02.774038+0000","last_fullsized":"2026-02-24T07:51:02.774038+0000","mapping_epoch":41,"log_start":"49'46008","ondisk_log_start":"49'46008","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377028608,"num_objects":5753,"num_object_clones":0,"num_object_copies":17259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46024,"num_write_kb":368192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'48208","reported_seq":48234,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.857333+0000","last_change":"2026-02-24T07:49:45.868841+0000","last_active":"2026-02-24T07:51:02.857333+0000","last_peered":"2026-02-24T07:51:02.857333+0000","last_clean":"2026-02-24T07:51:02.857333+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:02.857333+0000","last_undegraded":"2026-02-24T07:51:02.857333+0000","last_fullsized":"2026-02-24T07:51:02.857333+0000","mapping_epoch":41,"log_start":"49'48200","ondisk_log_start":"49'48200","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394919936,"num_objects":6026,"num_object_clones":0,"num_object_copies":18078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48208,"num_write_kb":385664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'47576","reported_seq":47602,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.773274+0000","last_change":"2026-02-24T07:49:45.868584+0000","last_active":"2026-02-24T07:51:02.773274+0000","last_peered":"2026-02-24T07:51:02.773274+0000","last_clean":"2026-02-24T07:51:02.773274+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:02.773274+0000","last_undegraded":"2026-02-24T07:51:02.773274+0000","last_fullsized":"2026-02-24T07:51:02.773274+0000","mapping_epoch":41,"log_start":"49'47568","ondisk_log_start":"49'47568","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389742592,"num_objects":5947,"num_object_clones":0,"num_object_copies":17841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5947,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47576,"num_write_kb":380608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'47472","reported_seq":47498,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.780873+0000","last_change":"2026-02-24T07:49:45.869073+0000","last_active":"2026-02-24T07:51:02.780873+0000","last_peered":"2026-02-24T07:51:02.780873+0000","last_clean":"2026-02-24T07:51:02.780873+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:02.780873+0000","last_undegraded":"2026-02-24T07:51:02.780873+0000","last_fullsized":"2026-02-24T07:51:02.780873+0000","mapping_epoch":41,"log_start":"49'47464","ondisk_log_start":"49'47464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388890624,"num_objects":5934,"num_object_clones":0,"num_object_copies":17802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47472,"num_write_kb":379776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'48152","reported_seq":48178,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.860159+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:51:02.860159+0000","last_peered":"2026-02-24T07:51:02.860159+0000","last_clean":"2026-02-24T07:51:02.860159+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:02.860159+0000","last_undegraded":"2026-02-24T07:51:02.860159+0000","last_fullsized":"2026-02-24T07:51:02.860159+0000","mapping_epoch":41,"log_start":"49'48125","ondisk_log_start":"49'48125","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":3000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394461184,"num_objects":6019,"num_object_clones":0,"num_object_copies":18057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48152,"num_write_kb":385216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'46872","reported_seq":46898,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:51:02.789474+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:51:02.789474+0000","last_peered":"2026-02-24T07:51:02.789474+0000","last_clean":"2026-02-24T07:51:02.789474+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:02.789474+0000","last_undegraded":"2026-02-24T07:51:02.789474+0000","last_fullsized":"2026-02-24T07:51:02.789474+0000","mapping_epoch":41,"log_start":"49'46864","ondisk_log_start":"49'46864","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:04.858546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383975424,"num_objects":5859,"num_object_clones":0,"num_object_copies":17577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46872,"num_write_kb":374976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":253,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T07:50:36.300120+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:50:36.300120+0000","last_peered":"2026-02-24T07:50:36.300120+0000","last_clean":"2026-02-24T07:50:36.300120+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:50:36.300120+0000","last_undegraded":"2026-02-24T07:50:36.300120+0000","last_fullsized":"2026-02-24T07:50:36.300120+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":6193905664,"num_objects":94512,"num_object_clones":0,"num_object_copies":283536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756092,"num_write_kb":6048736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18580045824,"data_stored":18580045824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215158,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4980708,"kb_used_data":3743760,"kb_used_omap":7,"kb_used_meta":1236920,"kb_avail":729022492,"statfs":{"total":751619276800,"available":746519031808,"internally_reserved":0,"allocated":3833610240,"data_stored":3833289411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7785,"internal_metadata":1266606487},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,23,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444087,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6600764,"kb_used_data":5269992,"kb_used_omap":4,"kb_used_meta":1330747,"kb_avail":727402436,"statfs":{"total":751619276800,"available":744860094464,"internally_reserved":0,"allocated":5396471808,"data_stored":5396150979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5102,"internal_metadata":1362684946},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5641104,"kb_used_data":4142908,"kb_used_omap":4,"kb_used_meta":1498171,"kb_avail":728362096,"statfs":{"total":751619276800,"available":745842786304,"internally_reserved":0,"allocated":4242337792,"data_stored":4242020515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":1534127778},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6076932,"kb_used_data":4872816,"kb_used_omap":4,"kb_used_meta":1204091,"kb_avail":727926268,"statfs":{"total":751619276800,"available":745396498432,"internally_reserved":0,"allocated":4989763584,"data_stored":4989442755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4453,"internal_metadata":1232989851},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2642,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5031567360,"data_stored":5031567360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4266303488,"data_stored":4266303488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5414920192,"data_stored":5414920192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3867254784,"data_stored":3867254784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:05.292 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 56 2026-02-24T07:51:05.441 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:05.572 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:05.570+0000 7f68af282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:05.573 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:05.570+0000 7f68af282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:05.728 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:51:05.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:06.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 127 784472 784345 77.5595 81.4062 0.0213182 0.012891 2026-02-24T07:51:06.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:05 trial016 ceph-mon[39544]: 3.1 scrub starts 2026-02-24T07:51:06.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3787176699' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T07:51:06.669 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:06.819 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:06.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:06.943+0000 7f46eaa0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:06.946 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:06.943+0000 7f46eaa0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:06.962 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:06.963 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:06.978 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:06.978 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:07.005 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:51:07.004520+0000 min lat: 0.000613999 max lat: 0.0954064 avg lat: 0.0128812 2026-02-24T07:51:07.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:51:07.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 794981 794853 77.6161 82.0938 0.0025881 0.0128812 2026-02-24T07:51:07.015 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:07.016 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:07.043 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:07.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:07.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:06 trial016 ceph-mon[39544]: from='client.14735 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:06 trial016 ceph-mon[39544]: pgmap v153: 17 pgs: 17 active+clean; 5.8 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.44k op/s 2026-02-24T07:51:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:06 trial016 ceph-mon[39544]: 3.9 scrub starts 2026-02-24T07:51:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:06 trial016 ceph-mon[39544]: 3.1 scrub ok 2026-02-24T07:51:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/835507314' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:08.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 127 805998 805871 77.7205 86.0781 0.0154204 0.0128638 2026-02-24T07:51:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:07 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:51:08.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:07 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:51:09.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 816291 816163 77.7532 80.4062 0.0131386 0.0128586 2026-02-24T07:51:09.095 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:09.246 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:08 trial016 ceph-mon[39544]: 3.9 scrub ok 2026-02-24T07:51:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:08 trial016 ceph-mon[39544]: pgmap v154: 17 pgs: 17 active+clean; 5.8 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.44k op/s 2026-02-24T07:51:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:08 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:51:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:08 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:51:09.758 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:09.741+0000 7f2480fae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:09.758 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:09.741+0000 7f2480fae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:09.759 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:09.776 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:09.777 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:09.793 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:09.793 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:09.809 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:09.809 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:10.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 128 824571 824443 77.5957 64.6875 0.00197794 0.0128808 2026-02-24T07:51:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:09 trial016 ceph-mon[39544]: 3.b scrub starts 2026-02-24T07:51:10.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2718605427' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:10.772 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:10.772 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:51:10.928 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:11.006 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 127 832983 832856 77.4544 65.7266 0.00691283 0.0129086 2026-02-24T07:51:11.280 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:10 trial016 ceph-mon[39544]: pgmap v155: 17 pgs: 17 active+clean; 6.1 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 97 MiB/s wr, 12.42k op/s 2026-02-24T07:51:11.541 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:11.479+0000 7f8125b4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:11.541 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:11.479+0000 7f8125b4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:11.975 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:51:12.007 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 841933 841805 77.3648 69.9141 0.00855339 0.0129235 2026-02-24T07:51:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:11 trial016 ceph-mon[39544]: 3.b scrub ok 2026-02-24T07:51:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3116924109' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:51:12.594 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:12.767 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:12.919 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:51:13.007 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 128 849526 849398 77.1549 59.3203 0.00204228 0.012957 2026-02-24T07:51:13.247 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:13.249 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:12 trial016 ceph-mon[39544]: 3.3 scrub starts 2026-02-24T07:51:13.249 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:12 trial016 ceph-mon[39544]: pgmap v156: 17 pgs: 17 active+clean; 6.1 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.40k op/s 2026-02-24T07:51:13.250 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3116924109' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:51:13.250 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:12 trial016 ceph-mon[39544]: osdmap e50: 4 total, 4 up, 4 in 2026-02-24T07:51:13.458 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:13.458 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:13.394+0000 7fdf090a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:13.394+0000 7fdf090a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:13.459 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:13.467 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:13.468 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:13.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:13.996+0000 7fded56d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:13.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:13.997+0000 7fded56d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:14.007 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 127 857323 857196 76.9682 60.9219 0.0116622 0.0129901 2026-02-24T07:51:14.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:13 trial016 ceph-mon[39544]: 3.4 scrub starts 2026-02-24T07:51:14.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:13 trial016 ceph-mon[39544]: 3.3 scrub ok 2026-02-24T07:51:14.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/471368460' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:14.979 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:51:15.007 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 867252 867124 76.9749 77.5625 0.00638329 0.0129889 2026-02-24T07:51:15.027 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:51:15.173 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:15.200 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:14 trial016 ceph-mon[39544]: pgmap v158: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.5 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.17k op/s 2026-02-24T07:51:15.200 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2477460224' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:51:15.200 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:15.306 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:15.303+0000 7fea9e6f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:15.307 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:15.304+0000 7fea9e6f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:15.914 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:15.981 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:51:16.007 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 127 877400 877273 77.0005 79.2891 0.00920722 0.012984 2026-02-24T07:51:16.038 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:51:16.064 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:16.192 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:16.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:16.191+0000 7fc294f04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:16.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:16.191+0000 7fc294f04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:16.194 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: 3.c scrub starts 2026-02-24T07:51:16.194 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: 3.4 scrub ok 2026-02-24T07:51:16.194 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: 3.5 scrub starts 2026-02-24T07:51:16.195 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2477460224' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:51:16.195 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: osdmap e51: 4 total, 4 up, 4 in 2026-02-24T07:51:16.195 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:15 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2111117' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:51:16.218 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:16.218 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:16.237 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:16.237 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:16.258 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:16.258 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:16.274 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:16.274 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:16.331 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:16.328+0000 7f69827fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:16.331 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:16.329+0000 7f69827fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:16.984 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:51:17.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 59 887593 887534 77.0356 80.1641 0.0234279 0.0129785 2026-02-24T07:51:17.028 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:51:17.029 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:17.183 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:17.237 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: 3.c scrub ok 2026-02-24T07:51:17.237 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: pgmap v160: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.5 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 90 MiB/s wr, 11.46k op/s 2026-02-24T07:51:17.237 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2111117' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:51:17.237 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: osdmap e52: 4 total, 4 up, 4 in 2026-02-24T07:51:17.237 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: 3.5 scrub ok 2026-02-24T07:51:17.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2386948208' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:17.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/643842437' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:51:17.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:17.280+0000 7fba32320640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:17.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:17.281+0000 7fba32320640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:17.394 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:17.394 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:17.432 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2026-02-24T07:51:16.985907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6945612320,"num_objects":105976,"num_object_clones":0,"num_object_copies":317928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105976,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":847916,"num_write_kb":6784398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":25778596,"kb_used_data":20279188,"kb_used_omap":25,"kb_used_meta":5499302,"kb_avail":2910234204,"statfs":{"total":3006477107200,"available":2980079824896,"internally_reserved":0,"allocated":20765888512,"data_stored":20764577232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25696,"internal_metadata":5631286176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":360292352,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43981,"num_write_kb":351848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210919"},"pg_stats":[{"pgid":"3.f","version":"50'53568","reported_seq":53650,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774268+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:12.774268+0000","last_peered":"2026-02-24T07:51:12.774268+0000","last_clean":"2026-02-24T07:51:12.774268+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:12.774268+0000","last_undegraded":"2026-02-24T07:51:12.774268+0000","last_fullsized":"2026-02-24T07:51:12.774268+0000","mapping_epoch":41,"log_start":"50'53560","ondisk_log_start":"50'53560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438829056,"num_objects":6696,"num_object_clones":0,"num_object_copies":20088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53568,"num_write_kb":428544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"50'53520","reported_seq":53605,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.767217+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:12.767217+0000","last_peered":"2026-02-24T07:51:12.767217+0000","last_clean":"2026-02-24T07:51:12.767217+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:12.767217+0000","last_undegraded":"2026-02-24T07:51:12.767217+0000","last_fullsized":"2026-02-24T07:51:12.767217+0000","mapping_epoch":41,"log_start":"50'53513","ondisk_log_start":"50'53513","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438435840,"num_objects":6690,"num_object_clones":0,"num_object_copies":20070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53520,"num_write_kb":428160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"50'52233","reported_seq":52314,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.791299+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:12.791299+0000","last_peered":"2026-02-24T07:51:12.791299+0000","last_clean":"2026-02-24T07:51:12.791299+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:12.791299+0000","last_undegraded":"2026-02-24T07:51:12.791299+0000","last_fullsized":"2026-02-24T07:51:12.791299+0000","mapping_epoch":41,"log_start":"50'52226","ondisk_log_start":"50'52226","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427892736,"num_objects":6530,"num_object_clones":0,"num_object_copies":19590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52233,"num_write_kb":417864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"50'53648","reported_seq":53676,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.781854+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:51:12.781854+0000","last_peered":"2026-02-24T07:51:12.781854+0000","last_clean":"2026-02-24T07:51:12.781854+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:12.781854+0000","last_undegraded":"2026-02-24T07:51:12.781854+0000","last_fullsized":"2026-02-24T07:51:12.781854+0000","mapping_epoch":41,"log_start":"50'53640","ondisk_log_start":"50'53640","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439484416,"num_objects":6706,"num_object_clones":0,"num_object_copies":20118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53648,"num_write_kb":429184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"50'51704","reported_seq":51803,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.841308+0000","last_change":"2026-02-24T07:51:10.589098+0000","last_active":"2026-02-24T07:51:12.841308+0000","last_peered":"2026-02-24T07:51:12.841308+0000","last_clean":"2026-02-24T07:51:12.841308+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:12.841308+0000","last_undegraded":"2026-02-24T07:51:12.841308+0000","last_fullsized":"2026-02-24T07:51:12.841308+0000","mapping_epoch":41,"log_start":"50'51696","ondisk_log_start":"50'51696","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50408","last_scrub_stamp":"2026-02-24T07:51:10.588984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:10.588984+0000","objects_scrubbed":6231,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:40.138757+0000","scrub_duration":2170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423559168,"num_objects":6463,"num_object_clones":0,"num_object_copies":19389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51704,"num_write_kb":413632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"50'52600","reported_seq":52689,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.759772+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:12.759772+0000","last_peered":"2026-02-24T07:51:12.759772+0000","last_clean":"2026-02-24T07:51:12.759772+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:12.759772+0000","last_undegraded":"2026-02-24T07:51:12.759772+0000","last_fullsized":"2026-02-24T07:51:12.759772+0000","mapping_epoch":41,"log_start":"50'52584","ondisk_log_start":"50'52584","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"50'53208","reported_seq":53307,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.761202+0000","last_change":"2026-02-24T07:51:07.503725+0000","last_active":"2026-02-24T07:51:12.761202+0000","last_peered":"2026-02-24T07:51:12.761202+0000","last_clean":"2026-02-24T07:51:12.761202+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:12.761202+0000","last_undegraded":"2026-02-24T07:51:12.761202+0000","last_fullsized":"2026-02-24T07:51:12.761202+0000","mapping_epoch":41,"log_start":"50'53201","ondisk_log_start":"50'53201","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50608","last_scrub_stamp":"2026-02-24T07:51:07.503594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:07.503594+0000","objects_scrubbed":6255,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:23.488891+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435879936,"num_objects":6651,"num_object_clones":0,"num_object_copies":19953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53208,"num_write_kb":425664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"50'53224","reported_seq":53252,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.863876+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:51:12.863876+0000","last_peered":"2026-02-24T07:51:12.863876+0000","last_clean":"2026-02-24T07:51:12.863876+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:12.863876+0000","last_undegraded":"2026-02-24T07:51:12.863876+0000","last_fullsized":"2026-02-24T07:51:12.863876+0000","mapping_epoch":41,"log_start":"50'53216","ondisk_log_start":"50'53216","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436011008,"num_objects":6653,"num_object_clones":0,"num_object_copies":19959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53224,"num_write_kb":425792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"50'53096","reported_seq":53177,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.838718+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:12.838718+0000","last_peered":"2026-02-24T07:51:12.838718+0000","last_clean":"2026-02-24T07:51:12.838718+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:12.838718+0000","last_undegraded":"2026-02-24T07:51:12.838718+0000","last_fullsized":"2026-02-24T07:51:12.838718+0000","mapping_epoch":41,"log_start":"50'53088","ondisk_log_start":"50'53088","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434962432,"num_objects":6637,"num_object_clones":0,"num_object_copies":19911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53096,"num_write_kb":424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"50'52480","reported_seq":52565,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.779216+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:12.779216+0000","last_peered":"2026-02-24T07:51:12.779216+0000","last_clean":"2026-02-24T07:51:12.779216+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:12.779216+0000","last_undegraded":"2026-02-24T07:51:12.779216+0000","last_fullsized":"2026-02-24T07:51:12.779216+0000","mapping_epoch":41,"log_start":"50'52464","ondisk_log_start":"50'52464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429916160,"num_objects":6560,"num_object_clones":0,"num_object_copies":19680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52480,"num_write_kb":419840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"50'52028","reported_seq":52047,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774303+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:51:12.774303+0000","last_peered":"2026-02-24T07:51:12.774303+0000","last_clean":"2026-02-24T07:51:12.774303+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:12.774303+0000","last_undegraded":"2026-02-24T07:51:12.774303+0000","last_fullsized":"2026-02-24T07:51:12.774303+0000","mapping_epoch":41,"log_start":"50'52015","ondisk_log_start":"50'52015","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426213376,"num_objects":6504,"num_object_clones":0,"num_object_copies":19512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52028,"num_write_kb":416224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"50'53800","reported_seq":53836,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.867457+0000","last_change":"2026-02-24T07:51:12.420618+0000","last_active":"2026-02-24T07:51:12.867457+0000","last_peered":"2026-02-24T07:51:12.867457+0000","last_clean":"2026-02-24T07:51:12.867457+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:12.867457+0000","last_undegraded":"2026-02-24T07:51:12.867457+0000","last_fullsized":"2026-02-24T07:51:12.867457+0000","mapping_epoch":41,"log_start":"50'53792","ondisk_log_start":"50'53792","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":1199,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"50'53256","reported_seq":53340,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.763820+0000","last_change":"2026-02-24T07:51:11.681169+0000","last_active":"2026-02-24T07:51:12.763820+0000","last_peered":"2026-02-24T07:51:12.763820+0000","last_clean":"2026-02-24T07:51:12.763820+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:12.763820+0000","last_undegraded":"2026-02-24T07:51:12.763820+0000","last_fullsized":"2026-02-24T07:51:12.763820+0000","mapping_epoch":41,"log_start":"50'53248","ondisk_log_start":"50'53248","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":5899,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436273152,"num_objects":6657,"num_object_clones":0,"num_object_copies":19971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53256,"num_write_kb":426048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"50'53016","reported_seq":53114,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.775631+0000","last_change":"2026-02-24T07:51:06.486692+0000","last_active":"2026-02-24T07:51:12.775631+0000","last_peered":"2026-02-24T07:51:12.775631+0000","last_clean":"2026-02-24T07:51:12.775631+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:12.775631+0000","last_undegraded":"2026-02-24T07:51:12.775631+0000","last_fullsized":"2026-02-24T07:51:12.775631+0000","mapping_epoch":41,"log_start":"50'53008","ondisk_log_start":"50'53008","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'49408","last_scrub_stamp":"2026-02-24T07:51:06.486650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:06.486650+0000","objects_scrubbed":6128,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:09.951938+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434307072,"num_objects":6627,"num_object_clones":0,"num_object_copies":19881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53016,"num_write_kb":424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"50'53800","reported_seq":53828,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.864995+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:51:12.864995+0000","last_peered":"2026-02-24T07:51:12.864995+0000","last_clean":"2026-02-24T07:51:12.864995+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:12.864995+0000","last_undegraded":"2026-02-24T07:51:12.864995+0000","last_fullsized":"2026-02-24T07:51:12.864995+0000","mapping_epoch":41,"log_start":"50'53777","ondisk_log_start":"50'53777","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"50'52600","reported_seq":52628,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.827299+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:51:12.827299+0000","last_peered":"2026-02-24T07:51:12.827299+0000","last_clean":"2026-02-24T07:51:12.827299+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:12.827299+0000","last_undegraded":"2026-02-24T07:51:12.827299+0000","last_fullsized":"2026-02-24T07:51:12.827299+0000","mapping_epoch":41,"log_start":"50'52597","ondisk_log_start":"50'52597","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":255,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:11.974315+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:11.974315+0000","last_peered":"2026-02-24T07:51:11.974315+0000","last_clean":"2026-02-24T07:51:11.974315+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:11.974315+0000","last_undegraded":"2026-02-24T07:51:11.974315+0000","last_fullsized":"2026-02-24T07:51:11.974315+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":6945021952,"num_objects":105974,"num_object_clones":0,"num_object_copies":317922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847781,"num_write_kb":6782248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20835745792,"data_stored":20835745792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5634424,"kb_used_data":4216996,"kb_used_omap":8,"kb_used_meta":1417399,"kb_avail":728368776,"statfs":{"total":751619276800,"available":745849626624,"internally_reserved":0,"allocated":4318203904,"data_stored":4317875196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8435,"internal_metadata":1451417357},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444089,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7454032,"kb_used_data":5924732,"kb_used_omap":5,"kb_used_meta":1529274,"kb_avail":726549168,"statfs":{"total":751619276800,"available":743986348032,"internally_reserved":0,"allocated":6066925568,"data_stored":6066596860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5754,"internal_metadata":1565976966},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5802004,"kb_used_data":4652096,"kb_used_omap":5,"kb_used_meta":1149882,"kb_avail":728201196,"statfs":{"total":751619276800,"available":745678024704,"internally_reserved":0,"allocated":4763746304,"data_stored":4763421148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5750,"internal_metadata":1177479562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6888136,"kb_used_data":5485364,"kb_used_omap":5,"kb_used_meta":1402746,"kb_avail":727115064,"statfs":{"total":751619276800,"available":744565825536,"internally_reserved":0,"allocated":5617012736,"data_stored":5616684028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5757,"internal_metadata":1436412291},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5644394496,"data_stored":5644394496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4781981696,"data_stored":4781981696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6069338112,"data_stored":6069338112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4340031488,"data_stored":4340031488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:17.434 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:17.548 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:17.653 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:17.651+0000 7f9117607640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:17.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:17.651+0000 7f9117607640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:17.764 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:17.765 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:17.798 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2026-02-24T07:51:16.985907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6945612320,"num_objects":105976,"num_object_clones":0,"num_object_copies":317928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105976,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":847916,"num_write_kb":6784398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":25778596,"kb_used_data":20279188,"kb_used_omap":25,"kb_used_meta":5499302,"kb_avail":2910234204,"statfs":{"total":3006477107200,"available":2980079824896,"internally_reserved":0,"allocated":20765888512,"data_stored":20764577232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25696,"internal_metadata":5631286176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":360292352,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43981,"num_write_kb":351848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210919"},"pg_stats":[{"pgid":"3.f","version":"50'53568","reported_seq":53650,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774268+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:12.774268+0000","last_peered":"2026-02-24T07:51:12.774268+0000","last_clean":"2026-02-24T07:51:12.774268+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:12.774268+0000","last_undegraded":"2026-02-24T07:51:12.774268+0000","last_fullsized":"2026-02-24T07:51:12.774268+0000","mapping_epoch":41,"log_start":"50'53560","ondisk_log_start":"50'53560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438829056,"num_objects":6696,"num_object_clones":0,"num_object_copies":20088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53568,"num_write_kb":428544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"50'53520","reported_seq":53605,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.767217+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:12.767217+0000","last_peered":"2026-02-24T07:51:12.767217+0000","last_clean":"2026-02-24T07:51:12.767217+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:12.767217+0000","last_undegraded":"2026-02-24T07:51:12.767217+0000","last_fullsized":"2026-02-24T07:51:12.767217+0000","mapping_epoch":41,"log_start":"50'53513","ondisk_log_start":"50'53513","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438435840,"num_objects":6690,"num_object_clones":0,"num_object_copies":20070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53520,"num_write_kb":428160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"50'52233","reported_seq":52314,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.791299+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:12.791299+0000","last_peered":"2026-02-24T07:51:12.791299+0000","last_clean":"2026-02-24T07:51:12.791299+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:12.791299+0000","last_undegraded":"2026-02-24T07:51:12.791299+0000","last_fullsized":"2026-02-24T07:51:12.791299+0000","mapping_epoch":41,"log_start":"50'52226","ondisk_log_start":"50'52226","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427892736,"num_objects":6530,"num_object_clones":0,"num_object_copies":19590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52233,"num_write_kb":417864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"50'53648","reported_seq":53676,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.781854+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:51:12.781854+0000","last_peered":"2026-02-24T07:51:12.781854+0000","last_clean":"2026-02-24T07:51:12.781854+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:12.781854+0000","last_undegraded":"2026-02-24T07:51:12.781854+0000","last_fullsized":"2026-02-24T07:51:12.781854+0000","mapping_epoch":41,"log_start":"50'53640","ondisk_log_start":"50'53640","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439484416,"num_objects":6706,"num_object_clones":0,"num_object_copies":20118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53648,"num_write_kb":429184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"50'51704","reported_seq":51803,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.841308+0000","last_change":"2026-02-24T07:51:10.589098+0000","last_active":"2026-02-24T07:51:12.841308+0000","last_peered":"2026-02-24T07:51:12.841308+0000","last_clean":"2026-02-24T07:51:12.841308+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:12.841308+0000","last_undegraded":"2026-02-24T07:51:12.841308+0000","last_fullsized":"2026-02-24T07:51:12.841308+0000","mapping_epoch":41,"log_start":"50'51696","ondisk_log_start":"50'51696","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50408","last_scrub_stamp":"2026-02-24T07:51:10.588984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:10.588984+0000","objects_scrubbed":6231,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:40.138757+0000","scrub_duration":2170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423559168,"num_objects":6463,"num_object_clones":0,"num_object_copies":19389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51704,"num_write_kb":413632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"50'52600","reported_seq":52689,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.759772+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:12.759772+0000","last_peered":"2026-02-24T07:51:12.759772+0000","last_clean":"2026-02-24T07:51:12.759772+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:12.759772+0000","last_undegraded":"2026-02-24T07:51:12.759772+0000","last_fullsized":"2026-02-24T07:51:12.759772+0000","mapping_epoch":41,"log_start":"50'52584","ondisk_log_start":"50'52584","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"50'53208","reported_seq":53307,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.761202+0000","last_change":"2026-02-24T07:51:07.503725+0000","last_active":"2026-02-24T07:51:12.761202+0000","last_peered":"2026-02-24T07:51:12.761202+0000","last_clean":"2026-02-24T07:51:12.761202+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:12.761202+0000","last_undegraded":"2026-02-24T07:51:12.761202+0000","last_fullsized":"2026-02-24T07:51:12.761202+0000","mapping_epoch":41,"log_start":"50'53201","ondisk_log_start":"50'53201","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50608","last_scrub_stamp":"2026-02-24T07:51:07.503594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:07.503594+0000","objects_scrubbed":6255,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:23.488891+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435879936,"num_objects":6651,"num_object_clones":0,"num_object_copies":19953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53208,"num_write_kb":425664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"50'53224","reported_seq":53252,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.863876+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:51:12.863876+0000","last_peered":"2026-02-24T07:51:12.863876+0000","last_clean":"2026-02-24T07:51:12.863876+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:12.863876+0000","last_undegraded":"2026-02-24T07:51:12.863876+0000","last_fullsized":"2026-02-24T07:51:12.863876+0000","mapping_epoch":41,"log_start":"50'53216","ondisk_log_start":"50'53216","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436011008,"num_objects":6653,"num_object_clones":0,"num_object_copies":19959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53224,"num_write_kb":425792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"50'53096","reported_seq":53177,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.838718+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:12.838718+0000","last_peered":"2026-02-24T07:51:12.838718+0000","last_clean":"2026-02-24T07:51:12.838718+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:12.838718+0000","last_undegraded":"2026-02-24T07:51:12.838718+0000","last_fullsized":"2026-02-24T07:51:12.838718+0000","mapping_epoch":41,"log_start":"50'53088","ondisk_log_start":"50'53088","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434962432,"num_objects":6637,"num_object_clones":0,"num_object_copies":19911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53096,"num_write_kb":424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"50'52480","reported_seq":52565,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.779216+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:12.779216+0000","last_peered":"2026-02-24T07:51:12.779216+0000","last_clean":"2026-02-24T07:51:12.779216+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:12.779216+0000","last_undegraded":"2026-02-24T07:51:12.779216+0000","last_fullsized":"2026-02-24T07:51:12.779216+0000","mapping_epoch":41,"log_start":"50'52464","ondisk_log_start":"50'52464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429916160,"num_objects":6560,"num_object_clones":0,"num_object_copies":19680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52480,"num_write_kb":419840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"50'52028","reported_seq":52047,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774303+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:51:12.774303+0000","last_peered":"2026-02-24T07:51:12.774303+0000","last_clean":"2026-02-24T07:51:12.774303+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:12.774303+0000","last_undegraded":"2026-02-24T07:51:12.774303+0000","last_fullsized":"2026-02-24T07:51:12.774303+0000","mapping_epoch":41,"log_start":"50'52015","ondisk_log_start":"50'52015","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426213376,"num_objects":6504,"num_object_clones":0,"num_object_copies":19512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52028,"num_write_kb":416224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"50'53800","reported_seq":53836,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.867457+0000","last_change":"2026-02-24T07:51:12.420618+0000","last_active":"2026-02-24T07:51:12.867457+0000","last_peered":"2026-02-24T07:51:12.867457+0000","last_clean":"2026-02-24T07:51:12.867457+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:12.867457+0000","last_undegraded":"2026-02-24T07:51:12.867457+0000","last_fullsized":"2026-02-24T07:51:12.867457+0000","mapping_epoch":41,"log_start":"50'53792","ondisk_log_start":"50'53792","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":1199,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"50'53256","reported_seq":53340,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.763820+0000","last_change":"2026-02-24T07:51:11.681169+0000","last_active":"2026-02-24T07:51:12.763820+0000","last_peered":"2026-02-24T07:51:12.763820+0000","last_clean":"2026-02-24T07:51:12.763820+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:12.763820+0000","last_undegraded":"2026-02-24T07:51:12.763820+0000","last_fullsized":"2026-02-24T07:51:12.763820+0000","mapping_epoch":41,"log_start":"50'53248","ondisk_log_start":"50'53248","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":5899,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436273152,"num_objects":6657,"num_object_clones":0,"num_object_copies":19971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53256,"num_write_kb":426048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"50'53016","reported_seq":53114,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.775631+0000","last_change":"2026-02-24T07:51:06.486692+0000","last_active":"2026-02-24T07:51:12.775631+0000","last_peered":"2026-02-24T07:51:12.775631+0000","last_clean":"2026-02-24T07:51:12.775631+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:12.775631+0000","last_undegraded":"2026-02-24T07:51:12.775631+0000","last_fullsized":"2026-02-24T07:51:12.775631+0000","mapping_epoch":41,"log_start":"50'53008","ondisk_log_start":"50'53008","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'49408","last_scrub_stamp":"2026-02-24T07:51:06.486650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:06.486650+0000","objects_scrubbed":6128,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:09.951938+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434307072,"num_objects":6627,"num_object_clones":0,"num_object_copies":19881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53016,"num_write_kb":424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"50'53800","reported_seq":53828,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.864995+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:51:12.864995+0000","last_peered":"2026-02-24T07:51:12.864995+0000","last_clean":"2026-02-24T07:51:12.864995+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:12.864995+0000","last_undegraded":"2026-02-24T07:51:12.864995+0000","last_fullsized":"2026-02-24T07:51:12.864995+0000","mapping_epoch":41,"log_start":"50'53777","ondisk_log_start":"50'53777","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"50'52600","reported_seq":52628,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.827299+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:51:12.827299+0000","last_peered":"2026-02-24T07:51:12.827299+0000","last_clean":"2026-02-24T07:51:12.827299+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:12.827299+0000","last_undegraded":"2026-02-24T07:51:12.827299+0000","last_fullsized":"2026-02-24T07:51:12.827299+0000","mapping_epoch":41,"log_start":"50'52597","ondisk_log_start":"50'52597","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":255,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:11.974315+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:11.974315+0000","last_peered":"2026-02-24T07:51:11.974315+0000","last_clean":"2026-02-24T07:51:11.974315+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:11.974315+0000","last_undegraded":"2026-02-24T07:51:11.974315+0000","last_fullsized":"2026-02-24T07:51:11.974315+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":6945021952,"num_objects":105974,"num_object_clones":0,"num_object_copies":317922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847781,"num_write_kb":6782248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20835745792,"data_stored":20835745792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5634424,"kb_used_data":4216996,"kb_used_omap":8,"kb_used_meta":1417399,"kb_avail":728368776,"statfs":{"total":751619276800,"available":745849626624,"internally_reserved":0,"allocated":4318203904,"data_stored":4317875196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8435,"internal_metadata":1451417357},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444089,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7454032,"kb_used_data":5924732,"kb_used_omap":5,"kb_used_meta":1529274,"kb_avail":726549168,"statfs":{"total":751619276800,"available":743986348032,"internally_reserved":0,"allocated":6066925568,"data_stored":6066596860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5754,"internal_metadata":1565976966},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5802004,"kb_used_data":4652096,"kb_used_omap":5,"kb_used_meta":1149882,"kb_avail":728201196,"statfs":{"total":751619276800,"available":745678024704,"internally_reserved":0,"allocated":4763746304,"data_stored":4763421148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5750,"internal_metadata":1177479562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6888136,"kb_used_data":5485364,"kb_used_omap":5,"kb_used_meta":1402746,"kb_avail":727115064,"statfs":{"total":751619276800,"available":744565825536,"internally_reserved":0,"allocated":5617012736,"data_stored":5616684028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5757,"internal_metadata":1436412291},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5644394496,"data_stored":5644394496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4781981696,"data_stored":4781981696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6069338112,"data_stored":6069338112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4340031488,"data_stored":4340031488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:17.800 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:51:17.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:17.801 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:51:17.801 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:17.914 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0129 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 887593 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 77.037 2026-02-24T07:51:18.008 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 8.44384 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 88.3672 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 57.5156 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 9860 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 1080.81 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 11311 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 7362 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0129788 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.00880146 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.119737 2026-02-24T07:51:18.009 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000613999 2026-02-24T07:51:18.010 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.006+0000 7f5147ef5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.010 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.007+0000 7f5147ef5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.010 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:51:18.163 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:18.164 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:18.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/643842437' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:51:18.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:17 trial016 ceph-mon[39544]: osdmap e53: 4 total, 4 up, 4 in 2026-02-24T07:51:18.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:17 trial016 ceph-mon[39544]: from='client.14755 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:18.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:17 trial016 ceph-mon[39544]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:18.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:17 trial016 ceph-mon[39544]: pgmap v163: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.5 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.58k op/s 2026-02-24T07:51:18.214 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2026-02-24T07:51:17.775751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6945612320,"num_objects":105976,"num_object_clones":0,"num_object_copies":317928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105976,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":847916,"num_write_kb":6784398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":25778596,"kb_used_data":20279188,"kb_used_omap":25,"kb_used_meta":5499302,"kb_avail":2910234204,"statfs":{"total":3006477107200,"available":2980079824896,"internally_reserved":0,"allocated":20765888512,"data_stored":20764577232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25696,"internal_metadata":5631286176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":360292352,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43981,"num_write_kb":351848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.801886"},"pg_stats":[{"pgid":"3.f","version":"50'53568","reported_seq":53650,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774268+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:12.774268+0000","last_peered":"2026-02-24T07:51:12.774268+0000","last_clean":"2026-02-24T07:51:12.774268+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:12.774268+0000","last_undegraded":"2026-02-24T07:51:12.774268+0000","last_fullsized":"2026-02-24T07:51:12.774268+0000","mapping_epoch":41,"log_start":"50'53560","ondisk_log_start":"50'53560","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438829056,"num_objects":6696,"num_object_clones":0,"num_object_copies":20088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53568,"num_write_kb":428544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"50'53520","reported_seq":53605,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.767217+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:12.767217+0000","last_peered":"2026-02-24T07:51:12.767217+0000","last_clean":"2026-02-24T07:51:12.767217+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:12.767217+0000","last_undegraded":"2026-02-24T07:51:12.767217+0000","last_fullsized":"2026-02-24T07:51:12.767217+0000","mapping_epoch":41,"log_start":"50'53513","ondisk_log_start":"50'53513","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438435840,"num_objects":6690,"num_object_clones":0,"num_object_copies":20070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53520,"num_write_kb":428160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"50'52233","reported_seq":52314,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.791299+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:12.791299+0000","last_peered":"2026-02-24T07:51:12.791299+0000","last_clean":"2026-02-24T07:51:12.791299+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:12.791299+0000","last_undegraded":"2026-02-24T07:51:12.791299+0000","last_fullsized":"2026-02-24T07:51:12.791299+0000","mapping_epoch":41,"log_start":"50'52226","ondisk_log_start":"50'52226","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427892736,"num_objects":6530,"num_object_clones":0,"num_object_copies":19590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52233,"num_write_kb":417864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"50'53648","reported_seq":53676,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.781854+0000","last_change":"2026-02-24T07:49:45.869996+0000","last_active":"2026-02-24T07:51:12.781854+0000","last_peered":"2026-02-24T07:51:12.781854+0000","last_clean":"2026-02-24T07:51:12.781854+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:12.781854+0000","last_undegraded":"2026-02-24T07:51:12.781854+0000","last_fullsized":"2026-02-24T07:51:12.781854+0000","mapping_epoch":41,"log_start":"50'53640","ondisk_log_start":"50'53640","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439484416,"num_objects":6706,"num_object_clones":0,"num_object_copies":20118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53648,"num_write_kb":429184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"50'51704","reported_seq":51803,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.841308+0000","last_change":"2026-02-24T07:51:10.589098+0000","last_active":"2026-02-24T07:51:12.841308+0000","last_peered":"2026-02-24T07:51:12.841308+0000","last_clean":"2026-02-24T07:51:12.841308+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:12.841308+0000","last_undegraded":"2026-02-24T07:51:12.841308+0000","last_fullsized":"2026-02-24T07:51:12.841308+0000","mapping_epoch":41,"log_start":"50'51696","ondisk_log_start":"50'51696","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50408","last_scrub_stamp":"2026-02-24T07:51:10.588984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:10.588984+0000","objects_scrubbed":6231,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:40.138757+0000","scrub_duration":2170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423559168,"num_objects":6463,"num_object_clones":0,"num_object_copies":19389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51704,"num_write_kb":413632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"50'52600","reported_seq":52689,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.759772+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:12.759772+0000","last_peered":"2026-02-24T07:51:12.759772+0000","last_clean":"2026-02-24T07:51:12.759772+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:12.759772+0000","last_undegraded":"2026-02-24T07:51:12.759772+0000","last_fullsized":"2026-02-24T07:51:12.759772+0000","mapping_epoch":41,"log_start":"50'52584","ondisk_log_start":"50'52584","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"50'53208","reported_seq":53307,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.761202+0000","last_change":"2026-02-24T07:51:07.503725+0000","last_active":"2026-02-24T07:51:12.761202+0000","last_peered":"2026-02-24T07:51:12.761202+0000","last_clean":"2026-02-24T07:51:12.761202+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:12.761202+0000","last_undegraded":"2026-02-24T07:51:12.761202+0000","last_fullsized":"2026-02-24T07:51:12.761202+0000","mapping_epoch":41,"log_start":"50'53201","ondisk_log_start":"50'53201","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50608","last_scrub_stamp":"2026-02-24T07:51:07.503594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:07.503594+0000","objects_scrubbed":6255,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:23.488891+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435879936,"num_objects":6651,"num_object_clones":0,"num_object_copies":19953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53208,"num_write_kb":425664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"50'53224","reported_seq":53252,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.863876+0000","last_change":"2026-02-24T07:49:45.868668+0000","last_active":"2026-02-24T07:51:12.863876+0000","last_peered":"2026-02-24T07:51:12.863876+0000","last_clean":"2026-02-24T07:51:12.863876+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:12.863876+0000","last_undegraded":"2026-02-24T07:51:12.863876+0000","last_fullsized":"2026-02-24T07:51:12.863876+0000","mapping_epoch":41,"log_start":"50'53216","ondisk_log_start":"50'53216","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436011008,"num_objects":6653,"num_object_clones":0,"num_object_copies":19959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53224,"num_write_kb":425792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"50'53096","reported_seq":53177,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.838718+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:12.838718+0000","last_peered":"2026-02-24T07:51:12.838718+0000","last_clean":"2026-02-24T07:51:12.838718+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:12.838718+0000","last_undegraded":"2026-02-24T07:51:12.838718+0000","last_fullsized":"2026-02-24T07:51:12.838718+0000","mapping_epoch":41,"log_start":"50'53088","ondisk_log_start":"50'53088","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434962432,"num_objects":6637,"num_object_clones":0,"num_object_copies":19911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53096,"num_write_kb":424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"50'52480","reported_seq":52565,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.779216+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:12.779216+0000","last_peered":"2026-02-24T07:51:12.779216+0000","last_clean":"2026-02-24T07:51:12.779216+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:12.779216+0000","last_undegraded":"2026-02-24T07:51:12.779216+0000","last_fullsized":"2026-02-24T07:51:12.779216+0000","mapping_epoch":41,"log_start":"50'52464","ondisk_log_start":"50'52464","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429916160,"num_objects":6560,"num_object_clones":0,"num_object_copies":19680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52480,"num_write_kb":419840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"50'52028","reported_seq":52047,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.774303+0000","last_change":"2026-02-24T07:49:45.868487+0000","last_active":"2026-02-24T07:51:12.774303+0000","last_peered":"2026-02-24T07:51:12.774303+0000","last_clean":"2026-02-24T07:51:12.774303+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:12.774303+0000","last_undegraded":"2026-02-24T07:51:12.774303+0000","last_fullsized":"2026-02-24T07:51:12.774303+0000","mapping_epoch":41,"log_start":"50'52015","ondisk_log_start":"50'52015","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:14.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426213376,"num_objects":6504,"num_object_clones":0,"num_object_copies":19512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52028,"num_write_kb":416224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"50'53800","reported_seq":53836,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.867457+0000","last_change":"2026-02-24T07:51:12.420618+0000","last_active":"2026-02-24T07:51:12.867457+0000","last_peered":"2026-02-24T07:51:12.867457+0000","last_clean":"2026-02-24T07:51:12.867457+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:12.867457+0000","last_undegraded":"2026-02-24T07:51:12.867457+0000","last_fullsized":"2026-02-24T07:51:12.867457+0000","mapping_epoch":41,"log_start":"50'53792","ondisk_log_start":"50'53792","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":1199,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"50'53256","reported_seq":53340,"reported_epoch":50,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:12.763820+0000","last_change":"2026-02-24T07:51:11.681169+0000","last_active":"2026-02-24T07:51:12.763820+0000","last_peered":"2026-02-24T07:51:12.763820+0000","last_clean":"2026-02-24T07:51:12.763820+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:12.763820+0000","last_undegraded":"2026-02-24T07:51:12.763820+0000","last_fullsized":"2026-02-24T07:51:12.763820+0000","mapping_epoch":41,"log_start":"50'53248","ondisk_log_start":"50'53248","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":5899,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436273152,"num_objects":6657,"num_object_clones":0,"num_object_copies":19971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53256,"num_write_kb":426048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"50'53016","reported_seq":53114,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.775631+0000","last_change":"2026-02-24T07:51:06.486692+0000","last_active":"2026-02-24T07:51:12.775631+0000","last_peered":"2026-02-24T07:51:12.775631+0000","last_clean":"2026-02-24T07:51:12.775631+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:12.775631+0000","last_undegraded":"2026-02-24T07:51:12.775631+0000","last_fullsized":"2026-02-24T07:51:12.775631+0000","mapping_epoch":41,"log_start":"50'53008","ondisk_log_start":"50'53008","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'49408","last_scrub_stamp":"2026-02-24T07:51:06.486650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:06.486650+0000","objects_scrubbed":6128,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:09.951938+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434307072,"num_objects":6627,"num_object_clones":0,"num_object_copies":19881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53016,"num_write_kb":424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"50'53800","reported_seq":53828,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.864995+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:51:12.864995+0000","last_peered":"2026-02-24T07:51:12.864995+0000","last_clean":"2026-02-24T07:51:12.864995+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:12.864995+0000","last_undegraded":"2026-02-24T07:51:12.864995+0000","last_fullsized":"2026-02-24T07:51:12.864995+0000","mapping_epoch":41,"log_start":"50'53777","ondisk_log_start":"50'53777","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:13.606140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440729600,"num_objects":6725,"num_object_clones":0,"num_object_copies":20175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":430400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"50'52600","reported_seq":52628,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:12.827299+0000","last_change":"2026-02-24T07:49:45.868265+0000","last_active":"2026-02-24T07:51:12.827299+0000","last_peered":"2026-02-24T07:51:12.827299+0000","last_clean":"2026-02-24T07:51:12.827299+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:12.827299+0000","last_undegraded":"2026-02-24T07:51:12.827299+0000","last_fullsized":"2026-02-24T07:51:12.827299+0000","mapping_epoch":41,"log_start":"50'52597","ondisk_log_start":"50'52597","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430899200,"num_objects":6575,"num_object_clones":0,"num_object_copies":19725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52600,"num_write_kb":420800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":255,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-24T07:51:11.974315+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:11.974315+0000","last_peered":"2026-02-24T07:51:11.974315+0000","last_clean":"2026-02-24T07:51:11.974315+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:11.974315+0000","last_undegraded":"2026-02-24T07:51:11.974315+0000","last_fullsized":"2026-02-24T07:51:11.974315+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":6945021952,"num_objects":105974,"num_object_clones":0,"num_object_copies":317922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847781,"num_write_kb":6782248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20835745792,"data_stored":20835745792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5634424,"kb_used_data":4216996,"kb_used_omap":8,"kb_used_meta":1417399,"kb_avail":728368776,"statfs":{"total":751619276800,"available":745849626624,"internally_reserved":0,"allocated":4318203904,"data_stored":4317875196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8435,"internal_metadata":1451417357},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444089,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7454032,"kb_used_data":5924732,"kb_used_omap":5,"kb_used_meta":1529274,"kb_avail":726549168,"statfs":{"total":751619276800,"available":743986348032,"internally_reserved":0,"allocated":6066925568,"data_stored":6066596860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5754,"internal_metadata":1565976966},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5802004,"kb_used_data":4652096,"kb_used_omap":5,"kb_used_meta":1149882,"kb_avail":728201196,"statfs":{"total":751619276800,"available":745678024704,"internally_reserved":0,"allocated":4763746304,"data_stored":4763421148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5750,"internal_metadata":1177479562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,8,6,0,0,8,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6888136,"kb_used_data":5485364,"kb_used_omap":5,"kb_used_meta":1402746,"kb_avail":727115064,"statfs":{"total":751619276800,"available":744565825536,"internally_reserved":0,"allocated":5617012736,"data_stored":5616684028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5757,"internal_metadata":1436412291},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2686,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5644394496,"data_stored":5644394496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4781981696,"data_stored":4781981696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6069338112,"data_stored":6069338112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4340031488,"data_stored":4340031488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:18.215 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:51:18.216 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 61 2026-02-24T07:51:18.324 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:18.362 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:18.476 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:18.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.488+0000 7feab3c37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.489+0000 7feab3c37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.598+0000 7f8ce6f66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:18.598+0000 7f8ce6f66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:18.619 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:18.620 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:18.644 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:18.644 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:18.646 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:51:18.678 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:18.678 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:18.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:18.703 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:18.703 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:18 trial016 ceph-mon[39544]: from='client.14759 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:19.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1308739070' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:19.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2871688328' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "61"} : dispatch 2026-02-24T07:51:20.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:19 trial016 ceph-mon[39544]: pgmap v164: 17 pgs: 17 active+clean; 6.8 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.63k op/s 2026-02-24T07:51:20.749 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:20.893 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:21.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:20 trial016 ceph-mon[39544]: 3.2 scrub starts 2026-02-24T07:51:21.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:21 trial016 ceph-mon[39544]: osdmap e54: 4 total, 4 up, 4 in 2026-02-24T07:51:21.442 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:21.389+0000 7fd00248d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:21.442 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:21.389+0000 7fd00248d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:21.442 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:21.442 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:21.443 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:21.443 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:21.455 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:21.456 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:21.472 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:21.472 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:21 trial016 ceph-mon[39544]: 3.8 scrub starts 2026-02-24T07:51:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:21 trial016 ceph-mon[39544]: 3.2 scrub ok 2026-02-24T07:51:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3543052672' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:21 trial016 ceph-mon[39544]: pgmap v166: 17 pgs: 17 active+clean; 6.8 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.63k op/s 2026-02-24T07:51:23.691 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:23.691 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:23.691 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:51:23.692 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:23.716 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:23.844 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:23.885 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:23.968 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:23.964+0000 7fbc77dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:23.968 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:23.965+0000 7fbc77dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:24.018 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:24.014+0000 7f340fbba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:24.018 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:24.014+0000 7f340fbba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:24.033 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:24.034 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:24.056 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:24.057 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:24.073 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:24.073 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:24.090 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:24.090 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:24.130 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:24.130 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:24.179 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2026-02-24T07:51:23.776505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3996918328,"num_objects":60983,"num_object_clones":0,"num_object_copies":182949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60983,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":937699,"num_write_kb":7102895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19075904,"kb_used_data":13034992,"kb_used_omap":35,"kb_used_meta":6040732,"kb_avail":2916936896,"statfs":{"total":3006477107200,"available":2986943381504,"internally_reserved":0,"allocated":13347831808,"data_stored":13346382416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36128,"internal_metadata":6185710304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2948693992,"num_objects":-44993,"num_object_clones":0,"num_object_copies":-134979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44993,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":89783,"num_write_kb":318497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.796412"},"pg_stats":[{"pgid":"3.f","version":"54'59124","reported_seq":59219,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.772866+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:22.772866+0000","last_peered":"2026-02-24T07:51:22.772866+0000","last_clean":"2026-02-24T07:51:22.772866+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:22.772866+0000","last_undegraded":"2026-02-24T07:51:22.772866+0000","last_fullsized":"2026-02-24T07:51:22.772866+0000","mapping_epoch":41,"log_start":"54'59121","ondisk_log_start":"54'59121","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254091264,"num_objects":3878,"num_object_clones":0,"num_object_copies":11634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59124,"num_write_kb":448008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"54'59107","reported_seq":59199,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.774468+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:22.774468+0000","last_peered":"2026-02-24T07:51:22.774468+0000","last_clean":"2026-02-24T07:51:22.774468+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:22.774468+0000","last_undegraded":"2026-02-24T07:51:22.774468+0000","last_fullsized":"2026-02-24T07:51:22.774468+0000","mapping_epoch":41,"log_start":"54'59104","ondisk_log_start":"54'59104","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255131648,"num_objects":3893,"num_object_clones":0,"num_object_copies":11679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59107,"num_write_kb":448000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'57757","reported_seq":57853,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.785281+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:22.785281+0000","last_peered":"2026-02-24T07:51:22.785281+0000","last_clean":"2026-02-24T07:51:22.785281+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:22.785281+0000","last_undegraded":"2026-02-24T07:51:22.785281+0000","last_fullsized":"2026-02-24T07:51:22.785281+0000","mapping_epoch":41,"log_start":"54'57754","ondisk_log_start":"54'57754","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249298968,"num_objects":3805,"num_object_clones":0,"num_object_copies":11415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3805,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":57757,"num_write_kb":437761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'59323","reported_seq":59435,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.789061+0000","last_change":"2026-02-24T07:51:15.223876+0000","last_active":"2026-02-24T07:51:22.789061+0000","last_peered":"2026-02-24T07:51:22.789061+0000","last_clean":"2026-02-24T07:51:22.789061+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:22.789061+0000","last_undegraded":"2026-02-24T07:51:22.789061+0000","last_fullsized":"2026-02-24T07:51:22.789061+0000","mapping_epoch":41,"log_start":"54'59320","ondisk_log_start":"54'59320","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'55048","last_scrub_stamp":"2026-02-24T07:51:15.223820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:15.223820+0000","objects_scrubbed":6842,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:28.952051+0000","scrub_duration":993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256311296,"num_objects":3911,"num_object_clones":0,"num_object_copies":11733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59323,"num_write_kb":449664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"54'57181","reported_seq":57277,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.870452+0000","last_change":"2026-02-24T07:51:10.589098+0000","last_active":"2026-02-24T07:51:22.870452+0000","last_peered":"2026-02-24T07:51:22.870452+0000","last_clean":"2026-02-24T07:51:22.870452+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:22.870452+0000","last_undegraded":"2026-02-24T07:51:22.870452+0000","last_fullsized":"2026-02-24T07:51:22.870452+0000","mapping_epoch":41,"log_start":"54'57169","ondisk_log_start":"54'57169","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50408","last_scrub_stamp":"2026-02-24T07:51:10.588984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:10.588984+0000","objects_scrubbed":6231,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:40.138757+0000","scrub_duration":2170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241565696,"num_objects":3686,"num_object_clones":0,"num_object_copies":11058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3686,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57181,"num_write_kb":432832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"54'58172","reported_seq":58269,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.789382+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:22.789382+0000","last_peered":"2026-02-24T07:51:22.789382+0000","last_clean":"2026-02-24T07:51:22.789382+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:22.789382+0000","last_undegraded":"2026-02-24T07:51:22.789382+0000","last_fullsized":"2026-02-24T07:51:22.789382+0000","mapping_epoch":41,"log_start":"54'58169","ondisk_log_start":"54'58169","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247398400,"num_objects":3775,"num_object_clones":0,"num_object_copies":11325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58172,"num_write_kb":440512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"54'58873","reported_seq":58980,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.784543+0000","last_change":"2026-02-24T07:51:07.503725+0000","last_active":"2026-02-24T07:51:22.784543+0000","last_peered":"2026-02-24T07:51:22.784543+0000","last_clean":"2026-02-24T07:51:22.784543+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:22.784543+0000","last_undegraded":"2026-02-24T07:51:22.784543+0000","last_fullsized":"2026-02-24T07:51:22.784543+0000","mapping_epoch":41,"log_start":"54'58870","ondisk_log_start":"54'58870","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50608","last_scrub_stamp":"2026-02-24T07:51:07.503594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:07.503594+0000","objects_scrubbed":6255,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:23.488891+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250413056,"num_objects":3821,"num_object_clones":0,"num_object_copies":11463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58873,"num_write_kb":445824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"54'58986","reported_seq":59061,"reported_epoch":54,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:51:22.871192+0000","last_change":"2026-02-24T07:51:20.427346+0000","last_active":"2026-02-24T07:51:22.871192+0000","last_peered":"2026-02-24T07:51:22.871192+0000","last_clean":"2026-02-24T07:51:22.871192+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:22.871192+0000","last_undegraded":"2026-02-24T07:51:22.871192+0000","last_fullsized":"2026-02-24T07:51:22.871192+0000","mapping_epoch":41,"log_start":"54'58976","ondisk_log_start":"54'58976","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":3600,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248905728,"num_objects":3798,"num_object_clones":0,"num_object_copies":11394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58986,"num_write_kb":446464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'58671","reported_seq":58754,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.870648+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:22.870648+0000","last_peered":"2026-02-24T07:51:22.870648+0000","last_clean":"2026-02-24T07:51:22.870648+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:22.870648+0000","last_undegraded":"2026-02-24T07:51:22.870648+0000","last_fullsized":"2026-02-24T07:51:22.870648+0000","mapping_epoch":41,"log_start":"54'58655","ondisk_log_start":"54'58655","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243007488,"num_objects":3708,"num_object_clones":0,"num_object_copies":11124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58671,"num_write_kb":443584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"54'58274","reported_seq":58367,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.788698+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:22.788698+0000","last_peered":"2026-02-24T07:51:22.788698+0000","last_clean":"2026-02-24T07:51:22.788698+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:22.788698+0000","last_undegraded":"2026-02-24T07:51:22.788698+0000","last_fullsized":"2026-02-24T07:51:22.788698+0000","mapping_epoch":41,"log_start":"54'58261","ondisk_log_start":"54'58261","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250740736,"num_objects":3826,"num_object_clones":0,"num_object_copies":11478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58274,"num_write_kb":441600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"54'57665","reported_seq":57776,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.776463+0000","last_change":"2026-02-24T07:51:16.160572+0000","last_active":"2026-02-24T07:51:22.776463+0000","last_peered":"2026-02-24T07:51:22.776463+0000","last_clean":"2026-02-24T07:51:22.776463+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:22.776463+0000","last_undegraded":"2026-02-24T07:51:22.776463+0000","last_fullsized":"2026-02-24T07:51:22.776463+0000","mapping_epoch":41,"log_start":"54'57662","ondisk_log_start":"54'57662","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'54112","last_scrub_stamp":"2026-02-24T07:51:16.160453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:16.160453+0000","objects_scrubbed":6716,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:25.298707+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57665,"num_write_kb":437248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"54'59131","reported_seq":59235,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.869669+0000","last_change":"2026-02-24T07:51:14.388902+0000","last_active":"2026-02-24T07:51:22.869669+0000","last_peered":"2026-02-24T07:51:22.869669+0000","last_clean":"2026-02-24T07:51:22.869669+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:22.869669+0000","last_undegraded":"2026-02-24T07:51:22.869669+0000","last_fullsized":"2026-02-24T07:51:22.869669+0000","mapping_epoch":41,"log_start":"54'59117","ondisk_log_start":"54'59117","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'54480","last_scrub_stamp":"2026-02-24T07:51:14.388850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:14.388850+0000","objects_scrubbed":6761,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:27.391195+0000","scrub_duration":1969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252379136,"num_objects":3851,"num_object_clones":0,"num_object_copies":11553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59131,"num_write_kb":447872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"54'59156","reported_seq":59268,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.773740+0000","last_change":"2026-02-24T07:51:12.936793+0000","last_active":"2026-02-24T07:51:22.773740+0000","last_peered":"2026-02-24T07:51:22.773740+0000","last_clean":"2026-02-24T07:51:22.773740+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:22.773740+0000","last_undegraded":"2026-02-24T07:51:22.773740+0000","last_fullsized":"2026-02-24T07:51:22.773740+0000","mapping_epoch":41,"log_start":"54'59153","ondisk_log_start":"54'59153","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'53344","last_scrub_stamp":"2026-02-24T07:51:12.936734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:12.936734+0000","objects_scrubbed":6633,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:25.466393+0000","scrub_duration":1255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253689856,"num_objects":3871,"num_object_clones":0,"num_object_copies":11613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59156,"num_write_kb":448192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'58517","reported_seq":58623,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.788832+0000","last_change":"2026-02-24T07:51:06.486692+0000","last_active":"2026-02-24T07:51:22.788832+0000","last_peered":"2026-02-24T07:51:22.788832+0000","last_clean":"2026-02-24T07:51:22.788832+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:22.788832+0000","last_undegraded":"2026-02-24T07:51:22.788832+0000","last_fullsized":"2026-02-24T07:51:22.788832+0000","mapping_epoch":41,"log_start":"54'58496","ondisk_log_start":"54'58496","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'49408","last_scrub_stamp":"2026-02-24T07:51:06.486650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:06.486650+0000","objects_scrubbed":6128,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:09.951938+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248381440,"num_objects":3790,"num_object_clones":0,"num_object_copies":11370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58517,"num_write_kb":443072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"54'59307","reported_seq":59339,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.870145+0000","last_change":"2026-02-24T07:49:45.868524+0000","last_active":"2026-02-24T07:51:22.870145+0000","last_peered":"2026-02-24T07:51:22.870145+0000","last_clean":"2026-02-24T07:51:22.870145+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:22.870145+0000","last_undegraded":"2026-02-24T07:51:22.870145+0000","last_fullsized":"2026-02-24T07:51:22.870145+0000","mapping_epoch":41,"log_start":"54'59301","ondisk_log_start":"54'59301","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:49:44.858870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249692160,"num_objects":3810,"num_object_clones":0,"num_object_copies":11430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59307,"num_write_kb":448832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"54'58320","reported_seq":58421,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:22.877621+0000","last_change":"2026-02-24T07:51:20.978929+0000","last_active":"2026-02-24T07:51:22.877621+0000","last_peered":"2026-02-24T07:51:22.877621+0000","last_clean":"2026-02-24T07:51:22.877621+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:22.877621+0000","last_undegraded":"2026-02-24T07:51:22.877621+0000","last_fullsized":"2026-02-24T07:51:22.877621+0000","mapping_epoch":41,"log_start":"54'58314","ondisk_log_start":"54'58314","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'57131","last_scrub_stamp":"2026-02-24T07:51:20.978860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:20.978860+0000","objects_scrubbed":5428,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.892410+0000","scrub_duration":1573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244776960,"num_objects":3735,"num_object_clones":0,"num_object_copies":11205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58320,"num_write_kb":441280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":263,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:19.995173+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:19.995173+0000","last_peered":"2026-02-24T07:51:19.995173+0000","last_clean":"2026-02-24T07:51:19.995173+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:19.995173+0000","last_undegraded":"2026-02-24T07:51:19.995173+0000","last_fullsized":"2026-02-24T07:51:19.995173+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3996327960,"num_objects":60981,"num_object_clones":0,"num_object_copies":182943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60981,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":937564,"num_write_kb":7100745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12011606016,"data_stored":12011593800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4215684,"kb_used_data":2689968,"kb_used_omap":10,"kb_used_meta":1525685,"kb_avail":729787516,"statfs":{"total":751619276800,"available":747302416384,"internally_reserved":0,"allocated":2754527232,"data_stored":2754162978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11043,"internal_metadata":1562301661},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5695236,"kb_used_data":4003504,"kb_used_omap":8,"kb_used_meta":1691703,"kb_avail":728307964,"statfs":{"total":751619276800,"available":745787355136,"internally_reserved":0,"allocated":4099588096,"data_stored":4099223842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1732304726},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4137396,"kb_used_data":2861152,"kb_used_omap":8,"kb_used_meta":1276215,"kb_avail":729865804,"statfs":{"total":751619276800,"available":747382583296,"internally_reserved":0,"allocated":2929819648,"data_stored":2929463018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8358,"internal_metadata":1306845018},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5027588,"kb_used_data":3480368,"kb_used_omap":8,"kb_used_meta":1547127,"kb_avail":728975612,"statfs":{"total":751619276800,"available":746471026688,"internally_reserved":0,"allocated":3563896832,"data_stored":3563532578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8365,"internal_metadata":1584258899},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3263836160,"data_stored":3263832088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2716860416,"data_stored":2716860416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3521785856,"data_stored":3521781784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2509123584,"data_stored":2509119512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:24.181 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:51:24.182 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 71 2026-02-24T07:51:24.325 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:24.450 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:24.446+0000 7fbc4a1e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:24.450 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:24.446+0000 7fbc4a1e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:24.600 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:51:24.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:24.875 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:24 trial016 ceph-mon[39544]: 3.8 scrub ok 2026-02-24T07:51:24.875 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:24 trial016 ceph-mon[39544]: pgmap v167: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 131 B/s rd, 40 MiB/s wr, 11.52k op/s 2026-02-24T07:51:24.875 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1096552113' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:24.876 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3487762309' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "71"} : dispatch 2026-02-24T07:51:25.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:26.138 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:26.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:25 trial016 ceph-mon[39544]: from='client.14767 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:26.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:25 trial016 ceph-mon[39544]: 3.0 scrub starts 2026-02-24T07:51:26.288 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:26.418 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:26.415+0000 7f5e45f85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:26.418 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:26.415+0000 7f5e45f85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:26.433 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:26.433 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:26.450 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:26.451 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:26.469 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:26.470 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:26.485 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:26.485 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:26 trial016 ceph-mon[39544]: pgmap v168: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 116 B/s rd, 35 MiB/s wr, 10.21k op/s 2026-02-24T07:51:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:26 trial016 ceph-mon[39544]: 3.0 scrub ok 2026-02-24T07:51:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:26 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4116133906' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:28.407 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 110950 objects 2026-02-24T07:51:28.407 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :10.3971 2026-02-24T07:51:28.533 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:28.651 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:29.088 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:28 trial016 ceph-mon[39544]: pgmap v169: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 31 MiB/s wr, 8.98k op/s 2026-02-24T07:51:29.088 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:28 trial016 ceph-mon[39544]: osdmap e55: 4 total, 4 up, 4 in 2026-02-24T07:51:29.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:29.037+0000 7f5a92354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:29.037+0000 7f5a92354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:29.104 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:29.105 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:29.105 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:29.105 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:29.643 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:29.643 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:29.644 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:51:29.644 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:29.759 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:29.859 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:29.855+0000 7f8f96a40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:29.859 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:29.856+0000 7f8f96a40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:29.970 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:29.970 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:30.005 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2026-02-24T07:51:29.777351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":402727480,"num_objects":6140,"num_object_clones":0,"num_object_copies":18420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6140,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":992542,"num_write_kb":7102895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8743680,"kb_used_data":2486128,"kb_used_omap":35,"kb_used_meta":6257308,"kb_avail":2927269120,"statfs":{"total":3006477107200,"available":2997523578880,"internally_reserved":0,"allocated":2545795072,"data_stored":2544345680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36128,"internal_metadata":6407484128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,4,12,32,11,23],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6869024744,"num_objects":-104812,"num_object_clones":0,"num_object_copies":-314436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-104812,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":104814,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.786783"},"pg_stats":[{"pgid":"3.f","version":"54'62584","reported_seq":62679,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.774698+0000","last_change":"2026-02-24T07:50:51.177495+0000","last_active":"2026-02-24T07:51:27.774698+0000","last_peered":"2026-02-24T07:51:27.774698+0000","last_clean":"2026-02-24T07:51:27.774698+0000","last_became_active":"2026-02-24T07:49:45.868364+0000","last_became_peered":"2026-02-24T07:49:45.868364+0000","last_unstale":"2026-02-24T07:51:27.774698+0000","last_undegraded":"2026-02-24T07:51:27.774698+0000","last_fullsized":"2026-02-24T07:51:27.774698+0000","mapping_epoch":41,"log_start":"54'62581","ondisk_log_start":"54'62581","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40744","last_scrub_stamp":"2026-02-24T07:50:51.177446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:51.177446+0000","objects_scrubbed":5068,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:16.870025+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27336704,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62584,"num_write_kb":448008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"54'62588","reported_seq":62679,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.774814+0000","last_change":"2026-02-24T07:50:49.775007+0000","last_active":"2026-02-24T07:51:27.774814+0000","last_peered":"2026-02-24T07:51:27.774814+0000","last_clean":"2026-02-24T07:51:27.774814+0000","last_became_active":"2026-02-24T07:49:45.867446+0000","last_became_peered":"2026-02-24T07:49:45.867446+0000","last_unstale":"2026-02-24T07:51:27.774814+0000","last_undegraded":"2026-02-24T07:51:27.774814+0000","last_fullsized":"2026-02-24T07:51:27.774814+0000","mapping_epoch":41,"log_start":"54'62583","ondisk_log_start":"54'62583","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'39488","last_scrub_stamp":"2026-02-24T07:50:49.774932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:49.774932+0000","objects_scrubbed":4882,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:52.198395+0000","scrub_duration":1281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62588,"num_write_kb":448000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'61157","reported_seq":61251,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.790653+0000","last_change":"2026-02-24T07:50:52.946653+0000","last_active":"2026-02-24T07:51:27.790653+0000","last_peered":"2026-02-24T07:51:27.790653+0000","last_clean":"2026-02-24T07:51:27.790653+0000","last_became_active":"2026-02-24T07:49:45.869168+0000","last_became_peered":"2026-02-24T07:49:45.869168+0000","last_unstale":"2026-02-24T07:51:27.790653+0000","last_undegraded":"2026-02-24T07:51:27.790653+0000","last_fullsized":"2026-02-24T07:51:27.790653+0000","mapping_epoch":41,"log_start":"54'61151","ondisk_log_start":"54'61151","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'40417","last_scrub_stamp":"2026-02-24T07:50:52.946594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:52.946594+0000","objects_scrubbed":5022,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:57.753076+0000","scrub_duration":812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26476568,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":61157,"num_write_kb":437761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'62829","reported_seq":62940,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.789184+0000","last_change":"2026-02-24T07:51:15.223876+0000","last_active":"2026-02-24T07:51:27.789184+0000","last_peered":"2026-02-24T07:51:27.789184+0000","last_clean":"2026-02-24T07:51:27.789184+0000","last_became_active":"2026-02-24T07:49:45.869794+0000","last_became_peered":"2026-02-24T07:49:45.869794+0000","last_unstale":"2026-02-24T07:51:27.789184+0000","last_undegraded":"2026-02-24T07:51:27.789184+0000","last_fullsized":"2026-02-24T07:51:27.789184+0000","mapping_epoch":41,"log_start":"54'62826","ondisk_log_start":"54'62826","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'55048","last_scrub_stamp":"2026-02-24T07:51:15.223820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:15.223820+0000","objects_scrubbed":6842,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:28.952051+0000","scrub_duration":993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62829,"num_write_kb":449664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"55'60527","reported_seq":60623,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.879708+0000","last_change":"2026-02-24T07:51:10.589098+0000","last_active":"2026-02-24T07:51:27.879708+0000","last_peered":"2026-02-24T07:51:27.879708+0000","last_clean":"2026-02-24T07:51:27.879708+0000","last_became_active":"2026-02-24T07:49:45.868402+0000","last_became_peered":"2026-02-24T07:49:45.868402+0000","last_unstale":"2026-02-24T07:51:27.879708+0000","last_undegraded":"2026-02-24T07:51:27.879708+0000","last_fullsized":"2026-02-24T07:51:27.879708+0000","mapping_epoch":41,"log_start":"55'60512","ondisk_log_start":"55'60512","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50408","last_scrub_stamp":"2026-02-24T07:51:10.588984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:10.588984+0000","objects_scrubbed":6231,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:40.138757+0000","scrub_duration":2170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60527,"num_write_kb":432832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"54'61565","reported_seq":61662,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.790419+0000","last_change":"2026-02-24T07:50:54.297958+0000","last_active":"2026-02-24T07:51:27.790419+0000","last_peered":"2026-02-24T07:51:27.790419+0000","last_clean":"2026-02-24T07:51:27.790419+0000","last_became_active":"2026-02-24T07:49:45.869441+0000","last_became_peered":"2026-02-24T07:49:45.869441+0000","last_unstale":"2026-02-24T07:51:27.790419+0000","last_undegraded":"2026-02-24T07:51:27.790419+0000","last_fullsized":"2026-02-24T07:51:27.790419+0000","mapping_epoch":41,"log_start":"54'61561","ondisk_log_start":"54'61561","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'41888","last_scrub_stamp":"2026-02-24T07:50:54.297904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.297904+0000","objects_scrubbed":5192,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:04.797038+0000","scrub_duration":1185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61565,"num_write_kb":440512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"54'62305","reported_seq":62410,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.791138+0000","last_change":"2026-02-24T07:51:07.503725+0000","last_active":"2026-02-24T07:51:27.791138+0000","last_peered":"2026-02-24T07:51:27.791138+0000","last_clean":"2026-02-24T07:51:27.791138+0000","last_became_active":"2026-02-24T07:49:45.868722+0000","last_became_peered":"2026-02-24T07:49:45.868722+0000","last_unstale":"2026-02-24T07:51:27.791138+0000","last_undegraded":"2026-02-24T07:51:27.791138+0000","last_fullsized":"2026-02-24T07:51:27.791138+0000","mapping_epoch":41,"log_start":"54'62300","ondisk_log_start":"54'62300","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'50608","last_scrub_stamp":"2026-02-24T07:51:07.503594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:07.503594+0000","objects_scrubbed":6255,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:23.488891+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62305,"num_write_kb":445824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"55'62419","reported_seq":62508,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.879440+0000","last_change":"2026-02-24T07:51:23.451891+0000","last_active":"2026-02-24T07:51:27.879440+0000","last_peered":"2026-02-24T07:51:27.879440+0000","last_clean":"2026-02-24T07:51:27.879440+0000","last_became_active":"2026-02-24T07:49:45.868245+0000","last_became_peered":"2026-02-24T07:49:45.868245+0000","last_unstale":"2026-02-24T07:51:27.879440+0000","last_undegraded":"2026-02-24T07:51:27.879440+0000","last_fullsized":"2026-02-24T07:51:27.879440+0000","mapping_epoch":41,"log_start":"55'62401","ondisk_log_start":"55'62401","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'59381","last_scrub_stamp":"2026-02-24T07:51:23.451833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:23.451833+0000","objects_scrubbed":4354,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.618366+0000","scrub_duration":3024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62419,"num_write_kb":446464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"55'62046","reported_seq":62133,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.880295+0000","last_change":"2026-02-24T07:50:54.470198+0000","last_active":"2026-02-24T07:51:27.880295+0000","last_peered":"2026-02-24T07:51:27.880295+0000","last_clean":"2026-02-24T07:51:27.880295+0000","last_became_active":"2026-02-24T07:49:45.868598+0000","last_became_peered":"2026-02-24T07:49:45.868598+0000","last_unstale":"2026-02-24T07:51:27.880295+0000","last_undegraded":"2026-02-24T07:51:27.880295+0000","last_fullsized":"2026-02-24T07:51:27.880295+0000","mapping_epoch":41,"log_start":"55'62032","ondisk_log_start":"55'62032","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'42040","last_scrub_stamp":"2026-02-24T07:50:54.470137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:54.470137+0000","objects_scrubbed":5212,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:00.442662+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823488,"num_objects":333,"num_object_clones":0,"num_object_copies":999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62046,"num_write_kb":443584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"54'61668","reported_seq":61761,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.788148+0000","last_change":"2026-02-24T07:50:47.963016+0000","last_active":"2026-02-24T07:51:27.788148+0000","last_peered":"2026-02-24T07:51:27.788148+0000","last_clean":"2026-02-24T07:51:27.788148+0000","last_became_active":"2026-02-24T07:49:45.868973+0000","last_became_peered":"2026-02-24T07:49:45.868973+0000","last_unstale":"2026-02-24T07:51:27.788148+0000","last_undegraded":"2026-02-24T07:51:27.788148+0000","last_fullsized":"2026-02-24T07:51:27.788148+0000","mapping_epoch":41,"log_start":"54'61655","ondisk_log_start":"54'61655","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'37968","last_scrub_stamp":"2026-02-24T07:50:47.962980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:50:47.962980+0000","objects_scrubbed":4711,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:05.985375+0000","scrub_duration":847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61668,"num_write_kb":441600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"54'61047","reported_seq":61154,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.775007+0000","last_change":"2026-02-24T07:51:16.160572+0000","last_active":"2026-02-24T07:51:27.775007+0000","last_peered":"2026-02-24T07:51:27.775007+0000","last_clean":"2026-02-24T07:51:27.775007+0000","last_became_active":"2026-02-24T07:49:45.868163+0000","last_became_peered":"2026-02-24T07:49:45.868163+0000","last_unstale":"2026-02-24T07:51:27.775007+0000","last_undegraded":"2026-02-24T07:51:27.775007+0000","last_fullsized":"2026-02-24T07:51:27.775007+0000","mapping_epoch":41,"log_start":"54'61042","ondisk_log_start":"54'61042","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'54112","last_scrub_stamp":"2026-02-24T07:51:16.160453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:16.160453+0000","objects_scrubbed":6716,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:25.298707+0000","scrub_duration":1370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61047,"num_write_kb":437248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"55'62665","reported_seq":62765,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.880162+0000","last_change":"2026-02-24T07:51:14.388902+0000","last_active":"2026-02-24T07:51:27.880162+0000","last_peered":"2026-02-24T07:51:27.880162+0000","last_clean":"2026-02-24T07:51:27.880162+0000","last_became_active":"2026-02-24T07:49:45.867902+0000","last_became_peered":"2026-02-24T07:49:45.867902+0000","last_unstale":"2026-02-24T07:51:27.880162+0000","last_undegraded":"2026-02-24T07:51:27.880162+0000","last_fullsized":"2026-02-24T07:51:27.880162+0000","mapping_epoch":41,"log_start":"55'62649","ondisk_log_start":"55'62649","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'54480","last_scrub_stamp":"2026-02-24T07:51:14.388850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:14.388850+0000","objects_scrubbed":6761,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:27.391195+0000","scrub_duration":1969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62665,"num_write_kb":447872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"54'62589","reported_seq":62700,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.774426+0000","last_change":"2026-02-24T07:51:12.936793+0000","last_active":"2026-02-24T07:51:27.774426+0000","last_peered":"2026-02-24T07:51:27.774426+0000","last_clean":"2026-02-24T07:51:27.774426+0000","last_became_active":"2026-02-24T07:49:45.868294+0000","last_became_peered":"2026-02-24T07:49:45.868294+0000","last_unstale":"2026-02-24T07:51:27.774426+0000","last_undegraded":"2026-02-24T07:51:27.774426+0000","last_fullsized":"2026-02-24T07:51:27.774426+0000","mapping_epoch":41,"log_start":"54'62586","ondisk_log_start":"54'62586","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'53344","last_scrub_stamp":"2026-02-24T07:51:12.936734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:12.936734+0000","objects_scrubbed":6633,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:25.466393+0000","scrub_duration":1255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62589,"num_write_kb":448192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'61927","reported_seq":62033,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.788382+0000","last_change":"2026-02-24T07:51:06.486692+0000","last_active":"2026-02-24T07:51:27.788382+0000","last_peered":"2026-02-24T07:51:27.788382+0000","last_clean":"2026-02-24T07:51:27.788382+0000","last_became_active":"2026-02-24T07:49:45.868833+0000","last_became_peered":"2026-02-24T07:49:45.868833+0000","last_unstale":"2026-02-24T07:51:27.788382+0000","last_undegraded":"2026-02-24T07:51:27.788382+0000","last_fullsized":"2026-02-24T07:51:27.788382+0000","mapping_epoch":41,"log_start":"54'61910","ondisk_log_start":"54'61910","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'49408","last_scrub_stamp":"2026-02-24T07:51:06.486650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:06.486650+0000","objects_scrubbed":6128,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:09.951938+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":380,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61927,"num_write_kb":443072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"55'62783","reported_seq":62851,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.879902+0000","last_change":"2026-02-24T07:51:26.055752+0000","last_active":"2026-02-24T07:51:27.879902+0000","last_peered":"2026-02-24T07:51:27.879902+0000","last_clean":"2026-02-24T07:51:27.879902+0000","last_became_active":"2026-02-24T07:49:45.868218+0000","last_became_peered":"2026-02-24T07:49:45.868218+0000","last_unstale":"2026-02-24T07:51:27.879902+0000","last_undegraded":"2026-02-24T07:51:27.879902+0000","last_fullsized":"2026-02-24T07:51:27.879902+0000","mapping_epoch":41,"log_start":"55'62774","ondisk_log_start":"55'62774","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'61488","last_scrub_stamp":"2026-02-24T07:51:26.055687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:26.055687+0000","objects_scrubbed":2043,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:43.674525+0000","scrub_duration":1532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62783,"num_write_kb":448832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"55'61708","reported_seq":61814,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-24T07:51:27.874224+0000","last_change":"2026-02-24T07:51:20.978929+0000","last_active":"2026-02-24T07:51:27.874224+0000","last_peered":"2026-02-24T07:51:27.874224+0000","last_clean":"2026-02-24T07:51:27.874224+0000","last_became_active":"2026-02-24T07:49:45.867916+0000","last_became_peered":"2026-02-24T07:49:45.867916+0000","last_unstale":"2026-02-24T07:51:27.874224+0000","last_undegraded":"2026-02-24T07:51:27.874224+0000","last_fullsized":"2026-02-24T07:51:27.874224+0000","mapping_epoch":41,"log_start":"55'61705","ondisk_log_start":"55'61705","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'57131","last_scrub_stamp":"2026-02-24T07:51:20.978860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:49:44.858870+0000","last_clean_scrub_stamp":"2026-02-24T07:51:20.978860+0000","objects_scrubbed":5428,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.892410+0000","scrub_duration":1573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61708,"num_write_kb":441280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":263,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T07:51:19.995173+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:19.995173+0000","last_peered":"2026-02-24T07:51:19.995173+0000","last_clean":"2026-02-24T07:51:19.995173+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:19.995173+0000","last_undegraded":"2026-02-24T07:51:19.995173+0000","last_fullsized":"2026-02-24T07:51:19.995173+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":402137112,"num_objects":6138,"num_object_clones":0,"num_object_copies":18414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6138,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":992407,"num_write_kb":7100745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1233358848,"data_stored":1233346632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2064260,"kb_used_data":502448,"kb_used_omap":10,"kb_used_meta":1561781,"kb_avail":731938940,"statfs":{"total":751619276800,"available":749505474560,"internally_reserved":0,"allocated":514506752,"data_stored":514142498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11043,"internal_metadata":1599263965},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2677956,"kb_used_data":932080,"kb_used_omap":8,"kb_used_meta":1745847,"kb_avail":731325244,"statfs":{"total":751619276800,"available":748877049856,"internally_reserved":0,"allocated":954449920,"data_stored":954085666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1787748182},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1775156,"kb_used_data":426656,"kb_used_omap":8,"kb_used_meta":1348407,"kb_avail":732228044,"statfs":{"total":751619276800,"available":749801517056,"internally_reserved":0,"allocated":436895744,"data_stored":436539114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8358,"internal_metadata":1380769626},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,9,21,11,23],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2226308,"kb_used_data":624944,"kb_used_omap":8,"kb_used_meta":1601271,"kb_avail":731776892,"statfs":{"total":751619276800,"available":749339537408,"internally_reserved":0,"allocated":639942656,"data_stored":639578402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8365,"internal_metadata":1639702355},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,11],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":342831104,"data_stored":342827032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":248119296,"data_stored":248119296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":377892864,"data_stored":377888792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":264515584,"data_stored":264511512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:30.007 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:51:30.008 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 81 2026-02-24T07:51:30.031 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/623703081' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:30.123 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:30.225 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:30.221+0000 7f556bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:30.225 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:30.222+0000 7f556bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:30.338 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:51:30.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:30.675 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-24T07:51:30.676 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-24T07:51:30.794 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:30.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:30.893+0000 7efde06da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:30.898 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:30.894+0000 7efde06da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:30 trial016 ceph-mon[39544]: pgmap v171: 17 pgs: 17 active+clean; 384 MiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 104 B/s rd, 104 B/s wr, 10.71k op/s 2026-02-24T07:51:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:30 trial016 ceph-mon[39544]: from='client.14777 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:31.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1565124196' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "81"} : dispatch 2026-02-24T07:51:31.602 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:31.719 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:31.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:31.820+0000 7fbc44bcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:31.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:31.820+0000 7fbc44bcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:31.836 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:31.836 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:31.840 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_1' removed 2026-02-24T07:51:31.847 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:31.848 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:31.859 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:31.860 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:31.872 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:31.873 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:31.879 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3483190706' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:51:31.880 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2298068576' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:31.883 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:51:31.884 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:51:31.884 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-24T07:51:31.884 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_2 16 2026-02-24T07:51:32.004 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:32.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:32.099+0000 7f1bb27bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:32.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:32.099+0000 7f1bb27bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:32.845 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_2' created 2026-02-24T07:51:32.891 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-24T07:51:33.007 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:33.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:33.101+0000 7f723f9b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:33.106 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:33.102+0000 7f723f9b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:33.106 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:51:33.106 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:51:33.106 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: pgmap v172: 17 pgs: 17 active+clean; 384 MiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 102 B/s wr, 10.48k op/s 2026-02-24T07:51:33.106 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3483190706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:51:33.106 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: osdmap e56: 4 total, 4 up, 4 in 2026-02-24T07:51:33.107 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1261864211' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16} : dispatch 2026-02-24T07:51:33.107 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:51:33.107 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:32 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:51:33.849 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-24T07:51:33.913 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:34.030 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:34.130 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:34.126+0000 7fe18f7bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:34.130 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:34.127+0000 7fe18f7bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:34.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1261864211' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2026-02-24T07:51:34.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:33 trial016 ceph-mon[39544]: osdmap e57: 4 total, 4 up, 4 in 2026-02-24T07:51:34.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/264520719' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:51:34.142 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:34.142 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:34.155 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:34.155 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:34.166 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:34.166 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:34.177 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:34.177 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:34.890 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2026-02-24T07:51:34.893 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:51:34.893 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:51:34.941 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:51:34.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:51:34.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_105445 2026-02-24T07:51:34.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:51:34.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:51:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:34 trial016 ceph-mon[39544]: pgmap v175: 17 pgs: 4 creating+peering, 12 unknown, 1 active+clean; 577 KiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:51:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/264520719' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:51:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:34 trial016 ceph-mon[39544]: osdmap e58: 4 total, 4 up, 4 in 2026-02-24T07:51:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3955782735' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:35.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:35.372 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:35.372 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:35.372 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-24T07:51:35.372 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:35.514 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:35.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:35.660+0000 7f8e0710f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:35.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:35.660+0000 7f8e0710f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:35.820 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:35.821 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:35.871 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2026-02-24T07:51:35.778240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6315556,"kb_used_data":3988,"kb_used_omap":39,"kb_used_meta":6311448,"kb_avail":2929697244,"statfs":{"total":3006477107200,"available":3000009977856,"internally_reserved":0,"allocated":4083712,"data_stored":2599430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40695,"internal_metadata":6462923017},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-402137112,"num_objects":-6138,"num_object_clones":0,"num_object_copies":-18414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6138,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-992407,"num_write_kb":-7100745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000618"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2026-02-24T07:51:32.847329+0000","last_change":"2026-02-24T07:51:32.847329+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.847329+0000","last_undegraded":"2026-02-24T07:51:32.847329+0000","last_fullsized":"2026-02-24T07:51:32.847329+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2026-02-24T07:51:32.846817+0000","last_change":"2026-02-24T07:51:32.846817+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.846817+0000","last_undegraded":"2026-02-24T07:51:32.846817+0000","last_fullsized":"2026-02-24T07:51:32.846817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2026-02-24T07:51:32.846814+0000","last_change":"2026-02-24T07:51:32.846814+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.846814+0000","last_undegraded":"2026-02-24T07:51:32.846814+0000","last_fullsized":"2026-02-24T07:51:32.846814+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2026-02-24T07:51:32.846813+0000","last_change":"2026-02-24T07:51:32.846813+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.846813+0000","last_undegraded":"2026-02-24T07:51:32.846813+0000","last_fullsized":"2026-02-24T07:51:32.846813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:51:32.839332+0000","last_change":"2026-02-24T07:51:32.839332+0000","last_active":"2026-02-24T07:51:32.839332+0000","last_peered":"2026-02-24T07:51:32.839332+0000","last_clean":"2026-02-24T07:51:32.839332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:51:32.839332+0000","last_undegraded":"2026-02-24T07:51:32.839332+0000","last_fullsized":"2026-02-24T07:51:32.839332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":267,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T07:51:32.105524+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:32.105524+0000","last_peered":"2026-02-24T07:51:32.105524+0000","last_clean":"2026-02-24T07:51:32.105524+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:32.105524+0000","last_undegraded":"2026-02-24T07:51:32.105524+0000","last_fullsized":"2026-02-24T07:51:32.105524+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2832,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1581008,"kb_used_data":1148,"kb_used_omap":12,"kb_used_meta":1579827,"kb_avail":732422192,"statfs":{"total":751619276800,"available":750000324608,"internally_reserved":0,"allocated":1175552,"data_stored":799654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13002,"internal_metadata":1617743158},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1765060,"kb_used_data":1136,"kb_used_omap":8,"kb_used_meta":1763895,"kb_avail":732238140,"statfs":{"total":751619276800,"available":749811855360,"internally_reserved":0,"allocated":1163264,"data_stored":795245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9014,"internal_metadata":1806228682},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1348992,"kb_used_data":556,"kb_used_omap":8,"kb_used_meta":1348407,"kb_avail":732654208,"statfs":{"total":751619276800,"available":750237908992,"internally_reserved":0,"allocated":569344,"data_stored":204877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9010,"internal_metadata":1380768974},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1620496,"kb_used_data":1148,"kb_used_omap":9,"kb_used_meta":1619318,"kb_avail":732382704,"statfs":{"total":751619276800,"available":749959888896,"internally_reserved":0,"allocated":1175552,"data_stored":799654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9669,"internal_metadata":1658182203},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2832,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:35.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 10694 10566 82.5394 82.5469 0.00231097 0.0120295 2026-02-24T07:51:36.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:35 trial016 ceph-mon[39544]: osdmap e59: 4 total, 4 up, 4 in 2026-02-24T07:51:36.213 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:36.366 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:36.528 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:36.525+0000 7fc9c00b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:36.528 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:36.525+0000 7fc9c00b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:36.544 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:36.544 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:36.557 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:36.558 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:36.595 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:36.595 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:36.618 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:36.619 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:36.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 20858 20730 80.9697 79.4062 0.0213922 0.0122595 2026-02-24T07:51:37.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:36 trial016 ceph-mon[39544]: pgmap v178: 17 pgs: 4 creating+peering, 12 unknown, 1 active+clean; 577 KiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:51:37.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:36 trial016 ceph-mon[39544]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:37.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1951995197' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:37.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 31765 31638 82.3839 85.2188 0.0109327 0.0121098 2026-02-24T07:51:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:37 trial016 ceph-mon[39544]: osdmap e60: 4 total, 4 up, 4 in 2026-02-24T07:51:38.663 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:38.816 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:38.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 42493 42365 82.7375 83.8047 0.0143469 0.0120556 2026-02-24T07:51:38.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:38.943+0000 7fe9711f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:38.946 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:38.943+0000 7fe9711f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:38.946 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:38 trial016 ceph-mon[39544]: pgmap v180: 17 pgs: 4 creating+peering, 12 unknown, 1 active+clean; 577 KiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:51:38.962 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:38.962 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:38.979 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:38.979 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:39.055 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:39.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:39.074 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:39.074 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:39.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 53161 53033 82.8575 83.3438 0.00198888 0.0120467 2026-02-24T07:51:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1680680290' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:40.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:40.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:40.875 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T07:51:40.875 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:40.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 64989 64861 84.4477 92.4062 0.00955215 0.0118242 2026-02-24T07:51:41.036 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:41.122 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:41.147 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:40 trial016 ceph-mon[39544]: pgmap v181: 17 pgs: 17 active+clean; 239 MiB data, 6.7 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.08k op/s 2026-02-24T07:51:41.167 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.165+0000 7fc71a452640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.168 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.165+0000 7fc71a452640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.277 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:41.331 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:41.331 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:41.385 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2026-02-24T07:51:39.778705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":250380832,"num_objects":3814,"num_object_clones":0,"num_object_copies":11442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3814,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":30627,"num_write_kb":246086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7055140,"kb_used_data":581140,"kb_used_omap":51,"kb_used_meta":6473868,"kb_avail":2928957660,"statfs":{"total":3006477107200,"available":2999252643840,"internally_reserved":0,"allocated":595087360,"data_stored":593465648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52422,"internal_metadata":6629241658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[35,9,5,27,39],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249790464,"num_objects":3812,"num_object_clones":0,"num_object_copies":11436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30492,"num_write_kb":243936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000812"},"pg_stats":[{"pgid":"4.f","version":"60'2032","reported_seq":2048,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.930724+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:51:37.930724+0000","last_peered":"2026-02-24T07:51:37.930724+0000","last_clean":"2026-02-24T07:51:37.930724+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:51:37.930724+0000","last_undegraded":"2026-02-24T07:51:37.930724+0000","last_fullsized":"2026-02-24T07:51:37.930724+0000","mapping_epoch":57,"log_start":"60'2024","ondisk_log_start":"60'2024","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2024,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2032,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'1928","reported_seq":1944,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.787062+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:51:37.787062+0000","last_peered":"2026-02-24T07:51:37.787062+0000","last_clean":"2026-02-24T07:51:37.787062+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:51:37.787062+0000","last_undegraded":"2026-02-24T07:51:37.787062+0000","last_fullsized":"2026-02-24T07:51:37.787062+0000","mapping_epoch":57,"log_start":"60'1912","ondisk_log_start":"60'1912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1912,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1928,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'1728","reported_seq":1736,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.755929+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:51:37.755929+0000","last_peered":"2026-02-24T07:51:37.755929+0000","last_clean":"2026-02-24T07:51:37.755929+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:51:37.755929+0000","last_undegraded":"2026-02-24T07:51:37.755929+0000","last_fullsized":"2026-02-24T07:51:37.755929+0000","mapping_epoch":57,"log_start":"60'1720","ondisk_log_start":"60'1720","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1720,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'1736","reported_seq":1728,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.780735+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:51:37.780735+0000","last_peered":"2026-02-24T07:51:37.780735+0000","last_clean":"2026-02-24T07:51:37.780735+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:51:37.780735+0000","last_undegraded":"2026-02-24T07:51:37.780735+0000","last_fullsized":"2026-02-24T07:51:37.780735+0000","mapping_epoch":57,"log_start":"60'1712","ondisk_log_start":"60'1712","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1712,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"60'1917","reported_seq":1912,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.787283+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:51:37.787283+0000","last_peered":"2026-02-24T07:51:37.787283+0000","last_clean":"2026-02-24T07:51:37.787283+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:51:37.787283+0000","last_undegraded":"2026-02-24T07:51:37.787283+0000","last_fullsized":"2026-02-24T07:51:37.787283+0000","mapping_epoch":57,"log_start":"60'1896","ondisk_log_start":"60'1896","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1896,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15704064,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1917,"num_write_kb":15336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'1960","reported_seq":1971,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.793683+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:51:37.793683+0000","last_peered":"2026-02-24T07:51:37.793683+0000","last_clean":"2026-02-24T07:51:37.793683+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:51:37.793683+0000","last_undegraded":"2026-02-24T07:51:37.793683+0000","last_fullsized":"2026-02-24T07:51:37.793683+0000","mapping_epoch":57,"log_start":"60'1945","ondisk_log_start":"60'1945","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1945,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":15680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'1912","reported_seq":1928,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.783435+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:51:37.783435+0000","last_peered":"2026-02-24T07:51:37.783435+0000","last_clean":"2026-02-24T07:51:37.783435+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:51:37.783435+0000","last_undegraded":"2026-02-24T07:51:37.783435+0000","last_fullsized":"2026-02-24T07:51:37.783435+0000","mapping_epoch":57,"log_start":"60'1904","ondisk_log_start":"60'1904","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1904,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'1920","reported_seq":1936,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.781554+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:51:37.781554+0000","last_peered":"2026-02-24T07:51:37.781554+0000","last_clean":"2026-02-24T07:51:37.781554+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:51:37.781554+0000","last_undegraded":"2026-02-24T07:51:37.781554+0000","last_fullsized":"2026-02-24T07:51:37.781554+0000","mapping_epoch":57,"log_start":"60'1904","ondisk_log_start":"60'1904","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1904,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'1919","reported_seq":1930,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.931760+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:51:37.931760+0000","last_peered":"2026-02-24T07:51:37.931760+0000","last_clean":"2026-02-24T07:51:37.931760+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:51:37.931760+0000","last_undegraded":"2026-02-24T07:51:37.931760+0000","last_fullsized":"2026-02-24T07:51:37.931760+0000","mapping_epoch":57,"log_start":"60'1912","ondisk_log_start":"60'1912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":1912,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15720448,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":15352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'1992","reported_seq":1999,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.797256+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:51:37.797256+0000","last_peered":"2026-02-24T07:51:37.797256+0000","last_clean":"2026-02-24T07:51:37.797256+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:51:37.797256+0000","last_undegraded":"2026-02-24T07:51:37.797256+0000","last_fullsized":"2026-02-24T07:51:37.797256+0000","mapping_epoch":57,"log_start":"60'1982","ondisk_log_start":"60'1982","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":1982,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'1920","reported_seq":1936,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.931899+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:51:37.931899+0000","last_peered":"2026-02-24T07:51:37.931899+0000","last_clean":"2026-02-24T07:51:37.931899+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:51:37.931899+0000","last_undegraded":"2026-02-24T07:51:37.931899+0000","last_fullsized":"2026-02-24T07:51:37.931899+0000","mapping_epoch":57,"log_start":"60'1912","ondisk_log_start":"60'1912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1912,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'2024","reported_seq":2040,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.791847+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:51:37.791847+0000","last_peered":"2026-02-24T07:51:37.791847+0000","last_clean":"2026-02-24T07:51:37.791847+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:51:37.791847+0000","last_undegraded":"2026-02-24T07:51:37.791847+0000","last_fullsized":"2026-02-24T07:51:37.791847+0000","mapping_epoch":57,"log_start":"60'2016","ondisk_log_start":"60'2016","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2016,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2024,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'1880","reported_seq":1896,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.925038+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:51:37.925038+0000","last_peered":"2026-02-24T07:51:37.925038+0000","last_clean":"2026-02-24T07:51:37.925038+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:51:37.925038+0000","last_undegraded":"2026-02-24T07:51:37.925038+0000","last_fullsized":"2026-02-24T07:51:37.925038+0000","mapping_epoch":57,"log_start":"60'1872","ondisk_log_start":"60'1872","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1872,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'1800","reported_seq":1807,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.791905+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:51:37.791905+0000","last_peered":"2026-02-24T07:51:37.791905+0000","last_clean":"2026-02-24T07:51:37.791905+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:51:37.791905+0000","last_undegraded":"2026-02-24T07:51:37.791905+0000","last_fullsized":"2026-02-24T07:51:37.791905+0000","mapping_epoch":57,"log_start":"60'1791","ondisk_log_start":"60'1791","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":1791,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1800,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"60'1960","reported_seq":1976,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.787397+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:51:37.787397+0000","last_peered":"2026-02-24T07:51:37.787397+0000","last_clean":"2026-02-24T07:51:37.787397+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:51:37.787397+0000","last_undegraded":"2026-02-24T07:51:37.787397+0000","last_fullsized":"2026-02-24T07:51:37.787397+0000","mapping_epoch":57,"log_start":"60'1945","ondisk_log_start":"60'1945","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1945,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":15680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'1864","reported_seq":1861,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:37.790700+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:51:37.790700+0000","last_peered":"2026-02-24T07:51:37.790700+0000","last_clean":"2026-02-24T07:51:37.790700+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:51:37.790700+0000","last_undegraded":"2026-02-24T07:51:37.790700+0000","last_fullsized":"2026-02-24T07:51:37.790700+0000","mapping_epoch":57,"log_start":"60'1845","ondisk_log_start":"60'1845","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1845,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1864,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":275,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:36.889721+0000","last_change":"2026-02-24T07:50:36.300120+0000","last_active":"2026-02-24T07:51:36.889721+0000","last_peered":"2026-02-24T07:51:36.889721+0000","last_clean":"2026-02-24T07:51:36.889721+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:36.889721+0000","last_undegraded":"2026-02-24T07:51:36.889721+0000","last_fullsized":"2026-02-24T07:51:36.889721+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:50:36.300077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:50:36.300077+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:39.645246+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":249790464,"num_objects":3812,"num_object_clones":0,"num_object_copies":11436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30492,"num_write_kb":243936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":747167744,"data_stored":747167744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2866,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215165,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1769176,"kb_used_data":153220,"kb_used_omap":15,"kb_used_meta":1615920,"kb_avail":732234024,"statfs":{"total":751619276800,"available":749807640576,"internally_reserved":0,"allocated":156897280,"data_stored":156490964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15601,"internal_metadata":1654702863},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1945760,"kb_used_data":145740,"kb_used_omap":12,"kb_used_meta":1799987,"kb_avail":732057440,"statfs":{"total":751619276800,"available":749626818560,"internally_reserved":0,"allocated":149237760,"data_stored":148831444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12926,"internal_metadata":1843187074},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,6,4,12,32],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1520124,"kb_used_data":135592,"kb_used_omap":11,"kb_used_meta":1384500,"kb_avail":732483076,"statfs":{"total":751619276800,"available":750062669824,"internally_reserved":0,"allocated":138846208,"data_stored":138443444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11618,"internal_metadata":1417728670},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,3,1,15,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1820080,"kb_used_data":146588,"kb_used_omap":11,"kb_used_meta":1673460,"kb_avail":732183120,"statfs":{"total":751619276800,"available":749755514880,"internally_reserved":0,"allocated":150106112,"data_stored":149699796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12277,"internal_metadata":1713623051},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2866,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":184868864,"data_stored":184868864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":162332672,"data_stored":162332672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":216236032,"data_stored":216236032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183730176,"data_stored":183730176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:41.387 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:51:41.387 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 26 2026-02-24T07:51:41.421 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.418+0000 7f13c5c27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.421 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.419+0000 7f13c5c27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.439 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:41.439 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:41.453 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:41.453 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:41.473 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:41.473 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:41.491 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:41.491 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:41.575 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:41.699 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.697+0000 7fec4b6c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.700 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:41.697+0000 7fec4b6c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:41.849 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:51:41.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:41.942 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 128 75292 75164 83.8818 80.4922 0.00644079 0.0119028 2026-02-24T07:51:42.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1494840161' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:42.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/377022462' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:51:42.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 86255 86127 84.1017 85.6484 0.00727325 0.011882 2026-02-24T07:51:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:42 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:51:43.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:42 trial016 ceph-mon[39544]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:43.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:42 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:51:43.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:42 trial016 ceph-mon[39544]: pgmap v182: 17 pgs: 17 active+clean; 239 MiB data, 6.7 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.84k op/s 2026-02-24T07:51:43.537 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:43.691 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:43.820 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:43.817+0000 7fc645234640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:43.820 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:43.817+0000 7fc645234640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:43.834 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:43.835 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:43.848 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:43.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:43.880 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:43.880 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:43.922 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:43.922 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:43.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 96528 96400 83.6739 80.2578 0.0155305 0.0119385 2026-02-24T07:51:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2964823474' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:44.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 128 106920 106792 83.4247 81.1875 0.00740009 0.0119781 2026-02-24T07:51:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:44 trial016 ceph-mon[39544]: pgmap v183: 17 pgs: 17 active+clean; 664 MiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.50k op/s 2026-02-24T07:51:45.318 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:45.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 117616 117488 83.4366 83.5625 0.00526472 0.0119711 2026-02-24T07:51:45.973 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:46.122 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:46.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:45 trial016 ceph-mon[39544]: osdmap e61: 4 total, 4 up, 4 in 2026-02-24T07:51:46.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:46.250+0000 7f1efd4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:46.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:46.251+0000 7f1efd4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:46.269 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:46.270 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:46.286 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:46.286 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:46.343 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:46.343 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:46.377 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:46.377 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:46.896 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:46.897 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:46.897 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:46.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 128410 128282 83.5103 84.3281 0.0136834 0.0119625 2026-02-24T07:51:47.050 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:47.127 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:46 trial016 ceph-mon[39544]: pgmap v185: 17 pgs: 17 active+clean; 664 MiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.51k op/s 2026-02-24T07:51:47.127 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3796531096' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:47.186 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:47.183+0000 7f5411389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:47.186 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:47.183+0000 7f5411389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:47.331 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:47.332 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:47.381 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-24T07:51:45.779502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":695796256,"num_objects":10611,"num_object_clones":0,"num_object_copies":31833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10611,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":84999,"num_write_kb":681062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8363004,"kb_used_data":1880996,"kb_used_omap":51,"kb_used_meta":6481868,"kb_avail":2927649796,"statfs":{"total":3006477107200,"available":2997913391104,"internally_reserved":0,"allocated":1926139904,"data_stored":1924518192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52481,"internal_metadata":6637433599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[18,8,9,16,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":695205888,"num_objects":10609,"num_object_clones":0,"num_object_copies":31827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84864,"num_write_kb":678912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.922115"},"pg_stats":[{"pgid":"4.f","version":"60'5504","reported_seq":5520,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.920068+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:51:42.920068+0000","last_peered":"2026-02-24T07:51:42.920068+0000","last_clean":"2026-02-24T07:51:42.920068+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:51:42.920068+0000","last_undegraded":"2026-02-24T07:51:42.920068+0000","last_fullsized":"2026-02-24T07:51:42.920068+0000","mapping_epoch":57,"log_start":"60'5497","ondisk_log_start":"60'5497","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45088768,"num_objects":688,"num_object_clones":0,"num_object_copies":2064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5504,"num_write_kb":44032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'5440","reported_seq":5456,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.793590+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:51:42.793590+0000","last_peered":"2026-02-24T07:51:42.793590+0000","last_clean":"2026-02-24T07:51:42.793590+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:51:42.793590+0000","last_undegraded":"2026-02-24T07:51:42.793590+0000","last_fullsized":"2026-02-24T07:51:42.793590+0000","mapping_epoch":57,"log_start":"60'5432","ondisk_log_start":"60'5432","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44564480,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5440,"num_write_kb":43520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'4896","reported_seq":4912,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.783515+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:51:42.783515+0000","last_peered":"2026-02-24T07:51:42.783515+0000","last_clean":"2026-02-24T07:51:42.783515+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:51:42.783515+0000","last_undegraded":"2026-02-24T07:51:42.783515+0000","last_fullsized":"2026-02-24T07:51:42.783515+0000","mapping_epoch":57,"log_start":"60'4864","ondisk_log_start":"60'4864","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4896,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'5368","reported_seq":5367,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.795896+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:51:42.795896+0000","last_peered":"2026-02-24T07:51:42.795896+0000","last_clean":"2026-02-24T07:51:42.795896+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:51:42.795896+0000","last_undegraded":"2026-02-24T07:51:42.795896+0000","last_fullsized":"2026-02-24T07:51:42.795896+0000","mapping_epoch":57,"log_start":"60'5336","ondisk_log_start":"60'5336","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43974656,"num_objects":671,"num_object_clones":0,"num_object_copies":2013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5368,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"60'5424","reported_seq":5440,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.726049+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:51:42.726049+0000","last_peered":"2026-02-24T07:51:42.726049+0000","last_clean":"2026-02-24T07:51:42.726049+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:51:42.726049+0000","last_undegraded":"2026-02-24T07:51:42.726049+0000","last_fullsized":"2026-02-24T07:51:42.726049+0000","mapping_epoch":57,"log_start":"60'5404","ondisk_log_start":"60'5404","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":43392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'5272","reported_seq":5280,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.793434+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:51:42.793434+0000","last_peered":"2026-02-24T07:51:42.793434+0000","last_clean":"2026-02-24T07:51:42.793434+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:51:42.793434+0000","last_undegraded":"2026-02-24T07:51:42.793434+0000","last_fullsized":"2026-02-24T07:51:42.793434+0000","mapping_epoch":57,"log_start":"60'5259","ondisk_log_start":"60'5259","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5272,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'5360","reported_seq":5376,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.789504+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:51:42.789504+0000","last_peered":"2026-02-24T07:51:42.789504+0000","last_clean":"2026-02-24T07:51:42.789504+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:51:42.789504+0000","last_undegraded":"2026-02-24T07:51:42.789504+0000","last_fullsized":"2026-02-24T07:51:42.789504+0000","mapping_epoch":57,"log_start":"60'5352","ondisk_log_start":"60'5352","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909120,"num_objects":670,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5360,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'5296","reported_seq":5312,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.781608+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:51:42.781608+0000","last_peered":"2026-02-24T07:51:42.781608+0000","last_clean":"2026-02-24T07:51:42.781608+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:51:42.781608+0000","last_undegraded":"2026-02-24T07:51:42.781608+0000","last_fullsized":"2026-02-24T07:51:42.781608+0000","mapping_epoch":57,"log_start":"60'5288","ondisk_log_start":"60'5288","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43384832,"num_objects":662,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5296,"num_write_kb":42368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'5396","reported_seq":5409,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.904061+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:51:42.904061+0000","last_peered":"2026-02-24T07:51:42.904061+0000","last_clean":"2026-02-24T07:51:42.904061+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:51:42.904061+0000","last_undegraded":"2026-02-24T07:51:42.904061+0000","last_fullsized":"2026-02-24T07:51:42.904061+0000","mapping_epoch":57,"log_start":"60'5392","ondisk_log_start":"60'5392","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44204032,"num_objects":675,"num_object_clones":0,"num_object_copies":2025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5396,"num_write_kb":43168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'5560","reported_seq":5576,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.784729+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:51:42.784729+0000","last_peered":"2026-02-24T07:51:42.784729+0000","last_clean":"2026-02-24T07:51:42.784729+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:51:42.784729+0000","last_undegraded":"2026-02-24T07:51:42.784729+0000","last_fullsized":"2026-02-24T07:51:42.784729+0000","mapping_epoch":57,"log_start":"60'5552","ondisk_log_start":"60'5552","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5560,"num_write_kb":44480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'5064","reported_seq":5080,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.897760+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:51:42.897760+0000","last_peered":"2026-02-24T07:51:42.897760+0000","last_clean":"2026-02-24T07:51:42.897760+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:51:42.897760+0000","last_undegraded":"2026-02-24T07:51:42.897760+0000","last_fullsized":"2026-02-24T07:51:42.897760+0000","mapping_epoch":57,"log_start":"60'5056","ondisk_log_start":"60'5056","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41484288,"num_objects":633,"num_object_clones":0,"num_object_copies":1899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5064,"num_write_kb":40512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'5368","reported_seq":5384,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.785879+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:51:42.785879+0000","last_peered":"2026-02-24T07:51:42.785879+0000","last_clean":"2026-02-24T07:51:42.785879+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:51:42.785879+0000","last_undegraded":"2026-02-24T07:51:42.785879+0000","last_fullsized":"2026-02-24T07:51:42.785879+0000","mapping_epoch":57,"log_start":"60'5352","ondisk_log_start":"60'5352","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43974656,"num_objects":671,"num_object_clones":0,"num_object_copies":2013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5368,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'5268","reported_seq":5284,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.929671+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:51:42.929671+0000","last_peered":"2026-02-24T07:51:42.929671+0000","last_clean":"2026-02-24T07:51:42.929671+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:51:42.929671+0000","last_undegraded":"2026-02-24T07:51:42.929671+0000","last_fullsized":"2026-02-24T07:51:42.929671+0000","mapping_epoch":57,"log_start":"60'5261","ondisk_log_start":"60'5261","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43155456,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5268,"num_write_kb":42144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'5328","reported_seq":5344,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.780820+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:51:42.780820+0000","last_peered":"2026-02-24T07:51:42.780820+0000","last_clean":"2026-02-24T07:51:42.780820+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:51:42.780820+0000","last_undegraded":"2026-02-24T07:51:42.780820+0000","last_fullsized":"2026-02-24T07:51:42.780820+0000","mapping_epoch":57,"log_start":"60'5321","ondisk_log_start":"60'5321","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5328,"num_write_kb":42624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"60'5136","reported_seq":5152,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.768537+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:51:42.768537+0000","last_peered":"2026-02-24T07:51:42.768537+0000","last_clean":"2026-02-24T07:51:42.768537+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:51:42.768537+0000","last_undegraded":"2026-02-24T07:51:42.768537+0000","last_fullsized":"2026-02-24T07:51:42.768537+0000","mapping_epoch":57,"log_start":"60'5104","ondisk_log_start":"60'5104","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42074112,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5136,"num_write_kb":41088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'5184","reported_seq":5195,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:42.789114+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:51:42.789114+0000","last_peered":"2026-02-24T07:51:42.789114+0000","last_clean":"2026-02-24T07:51:42.789114+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:51:42.789114+0000","last_undegraded":"2026-02-24T07:51:42.789114+0000","last_fullsized":"2026-02-24T07:51:42.789114+0000","mapping_epoch":57,"log_start":"60'5178","ondisk_log_start":"60'5178","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":283,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T07:51:41.333948+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:41.333948+0000","last_peered":"2026-02-24T07:51:41.333948+0000","last_clean":"2026-02-24T07:51:41.333948+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:41.333948+0000","last_undegraded":"2026-02-24T07:51:41.333948+0000","last_fullsized":"2026-02-24T07:51:41.333948+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":695205888,"num_objects":10609,"num_object_clones":0,"num_object_copies":31827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84864,"num_write_kb":678912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2085183488,"data_stored":2085183488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3826,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215166,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2213624,"kb_used_data":471332,"kb_used_omap":15,"kb_used_meta":1742256,"kb_avail":731789576,"statfs":{"total":751619276800,"available":749352525824,"internally_reserved":0,"allocated":482643968,"data_stored":482237652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15660,"internal_metadata":1784070868},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1,7,0,12],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2045616,"kb_used_data":526364,"kb_used_omap":12,"kb_used_meta":1519219,"kb_avail":731957584,"statfs":{"total":751619276800,"available":749524566016,"internally_reserved":0,"allocated":538996736,"data_stored":538590420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12926,"internal_metadata":1555680642},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1870564,"kb_used_data":413832,"kb_used_omap":11,"kb_used_meta":1456692,"kb_avail":732132636,"statfs":{"total":751619276800,"available":749703819264,"internally_reserved":0,"allocated":423763968,"data_stored":423361204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11618,"internal_metadata":1491653278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,1,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2233200,"kb_used_data":469468,"kb_used_omap":11,"kb_used_meta":1763700,"kb_avail":731770000,"statfs":{"total":751619276800,"available":749332480000,"internally_reserved":0,"allocated":480735232,"data_stored":480328916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12277,"internal_metadata":1806028811},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,7,1,12,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3826,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":516472832,"data_stored":516472832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":444645376,"data_stored":444645376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":609165312,"data_stored":609165312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":514899968,"data_stored":514899968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:47.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 139217 139089 83.5806 84.4297 0.00256043 0.0119563 2026-02-24T07:51:48.424 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:48.588 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:48.717 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:48.715+0000 7faab8bd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:48.717 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:48.715+0000 7faab8bd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:48.735 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:48.736 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:48.762 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:48.762 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:48.820 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:48.821 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:48.842 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:48.842 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:48.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 128 149901 149773 83.5721 83.4688 0.00945186 0.0119575 2026-02-24T07:51:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:48 trial016 ceph-mon[39544]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:49.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:48 trial016 ceph-mon[39544]: pgmap v186: 17 pgs: 17 active+clean; 664 MiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.48k op/s 2026-02-24T07:51:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/653126409' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:49.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 160530 160402 83.5362 83.0391 0.0100923 0.011964 2026-02-24T07:51:50.894 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:50.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 171520 171392 83.6809 85.8594 0.00113504 0.011944 2026-02-24T07:51:51.048 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:51.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:50 trial016 ceph-mon[39544]: pgmap v187: 17 pgs: 17 active+clean; 1.1 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.75k op/s 2026-02-24T07:51:51.555 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:51.498+0000 7faca6ca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:51.555 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:51.498+0000 7faca6ca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:51.555 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:51.556 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:51.556 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:51.556 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:51.583 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:51.583 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:51.600 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:51.601 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:51.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 180096 179968 82.6994 67 0.00892101 0.0120829 2026-02-24T07:51:52.210 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/501386903' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:52.382 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:51:52.382 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:51:52.383 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:51:52.383 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:51:52.534 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:52.940 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:52 trial016 ceph-mon[39544]: pgmap v188: 17 pgs: 17 active+clean; 1.1 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.75k op/s 2026-02-24T07:51:52.943 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 128 188945 188817 81.9454 69.1328 0.0103377 0.0121851 2026-02-24T07:51:53.012 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:52.937+0000 7fb4b2134640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:53.012 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:52.937+0000 7fb4b2134640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:53.083 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:51:53.083 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:51:53.809 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2026-02-24T07:51:51.780254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1131209248,"num_objects":17255,"num_object_clones":0,"num_object_copies":51765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17255,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":138150,"num_write_kb":1106270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10066252,"kb_used_data":3151100,"kb_used_omap":53,"kb_used_meta":6915018,"kb_avail":2925946548,"statfs":{"total":3006477107200,"available":2996169265152,"internally_reserved":0,"allocated":3226726400,"data_stored":3225073340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55102,"internal_metadata":7080978626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":880828416,"num_objects":13441,"num_object_clones":0,"num_object_copies":40323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107523,"num_write_kb":860184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001299"},"pg_stats":[{"pgid":"4.f","version":"61'8808","reported_seq":8826,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.904576+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:51:47.904576+0000","last_peered":"2026-02-24T07:51:47.904576+0000","last_clean":"2026-02-24T07:51:47.904576+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:51:47.904576+0000","last_undegraded":"2026-02-24T07:51:47.904576+0000","last_fullsized":"2026-02-24T07:51:47.904576+0000","mapping_epoch":57,"log_start":"61'8804","ondisk_log_start":"61'8804","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72155136,"num_objects":1101,"num_object_clones":0,"num_object_copies":3303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8808,"num_write_kb":70464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'8992","reported_seq":9010,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.771163+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:51:47.771163+0000","last_peered":"2026-02-24T07:51:47.771163+0000","last_clean":"2026-02-24T07:51:47.771163+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:51:47.771163+0000","last_undegraded":"2026-02-24T07:51:47.771163+0000","last_fullsized":"2026-02-24T07:51:47.771163+0000","mapping_epoch":57,"log_start":"61'8976","ondisk_log_start":"61'8976","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8992,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'7952","reported_seq":7970,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.776753+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:51:47.776753+0000","last_peered":"2026-02-24T07:51:47.776753+0000","last_clean":"2026-02-24T07:51:47.776753+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:51:47.776753+0000","last_undegraded":"2026-02-24T07:51:47.776753+0000","last_fullsized":"2026-02-24T07:51:47.776753+0000","mapping_epoch":57,"log_start":"61'7944","ondisk_log_start":"61'7944","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65142784,"num_objects":994,"num_object_clones":0,"num_object_copies":2982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7952,"num_write_kb":63616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'8608","reported_seq":8608,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.797001+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:51:47.797001+0000","last_peered":"2026-02-24T07:51:47.797001+0000","last_clean":"2026-02-24T07:51:47.797001+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:51:47.797001+0000","last_undegraded":"2026-02-24T07:51:47.797001+0000","last_fullsized":"2026-02-24T07:51:47.797001+0000","mapping_epoch":57,"log_start":"61'8584","ondisk_log_start":"61'8584","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8608,"num_write_kb":68864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'8776","reported_seq":8794,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.782659+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:51:47.782659+0000","last_peered":"2026-02-24T07:51:47.782659+0000","last_clean":"2026-02-24T07:51:47.782659+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:51:47.782659+0000","last_undegraded":"2026-02-24T07:51:47.782659+0000","last_fullsized":"2026-02-24T07:51:47.782659+0000","mapping_epoch":57,"log_start":"61'8754","ondisk_log_start":"61'8754","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71892992,"num_objects":1097,"num_object_clones":0,"num_object_copies":3291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8776,"num_write_kb":70208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'8500","reported_seq":8514,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.789038+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:51:47.789038+0000","last_peered":"2026-02-24T07:51:47.789038+0000","last_clean":"2026-02-24T07:51:47.789038+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:51:47.789038+0000","last_undegraded":"2026-02-24T07:51:47.789038+0000","last_fullsized":"2026-02-24T07:51:47.789038+0000","mapping_epoch":57,"log_start":"61'8487","ondisk_log_start":"61'8487","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69632000,"num_objects":1063,"num_object_clones":0,"num_object_copies":3189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8500,"num_write_kb":68000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'8728","reported_seq":8746,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.778751+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:51:47.778751+0000","last_peered":"2026-02-24T07:51:47.778751+0000","last_clean":"2026-02-24T07:51:47.778751+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:51:47.778751+0000","last_undegraded":"2026-02-24T07:51:47.778751+0000","last_fullsized":"2026-02-24T07:51:47.778751+0000","mapping_epoch":57,"log_start":"61'8720","ondisk_log_start":"61'8720","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71499776,"num_objects":1091,"num_object_clones":0,"num_object_copies":3273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8728,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'8800","reported_seq":8818,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.778290+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:51:47.778290+0000","last_peered":"2026-02-24T07:51:47.778290+0000","last_clean":"2026-02-24T07:51:47.778290+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:51:47.778290+0000","last_undegraded":"2026-02-24T07:51:47.778290+0000","last_fullsized":"2026-02-24T07:51:47.778290+0000","mapping_epoch":57,"log_start":"61'8792","ondisk_log_start":"61'8792","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72089600,"num_objects":1100,"num_object_clones":0,"num_object_copies":3300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8800,"num_write_kb":70400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'8632","reported_seq":8645,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.933415+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:51:47.933415+0000","last_peered":"2026-02-24T07:51:47.933415+0000","last_clean":"2026-02-24T07:51:47.933415+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:51:47.933415+0000","last_undegraded":"2026-02-24T07:51:47.933415+0000","last_fullsized":"2026-02-24T07:51:47.933415+0000","mapping_epoch":57,"log_start":"61'8623","ondisk_log_start":"61'8623","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8632,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'9096","reported_seq":9114,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.785541+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:51:47.785541+0000","last_peered":"2026-02-24T07:51:47.785541+0000","last_clean":"2026-02-24T07:51:47.785541+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:51:47.785541+0000","last_undegraded":"2026-02-24T07:51:47.785541+0000","last_fullsized":"2026-02-24T07:51:47.785541+0000","mapping_epoch":57,"log_start":"61'9088","ondisk_log_start":"61'9088","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74514432,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9096,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'8416","reported_seq":8434,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.918786+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:51:47.918786+0000","last_peered":"2026-02-24T07:51:47.918786+0000","last_clean":"2026-02-24T07:51:47.918786+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:51:47.918786+0000","last_undegraded":"2026-02-24T07:51:47.918786+0000","last_fullsized":"2026-02-24T07:51:47.918786+0000","mapping_epoch":57,"log_start":"61'8410","ondisk_log_start":"61'8410","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68943872,"num_objects":1052,"num_object_clones":0,"num_object_copies":3156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8416,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'8536","reported_seq":8554,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.785422+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:51:47.785422+0000","last_peered":"2026-02-24T07:51:47.785422+0000","last_clean":"2026-02-24T07:51:47.785422+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:51:47.785422+0000","last_undegraded":"2026-02-24T07:51:47.785422+0000","last_fullsized":"2026-02-24T07:51:47.785422+0000","mapping_epoch":57,"log_start":"61'8512","ondisk_log_start":"61'8512","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69926912,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8536,"num_write_kb":68288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'8528","reported_seq":8544,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.933503+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:51:47.933503+0000","last_peered":"2026-02-24T07:51:47.933503+0000","last_clean":"2026-02-24T07:51:47.933503+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:51:47.933503+0000","last_undegraded":"2026-02-24T07:51:47.933503+0000","last_fullsized":"2026-02-24T07:51:47.933503+0000","mapping_epoch":57,"log_start":"61'8520","ondisk_log_start":"61'8520","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69861376,"num_objects":1066,"num_object_clones":0,"num_object_copies":3198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8528,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'8739","reported_seq":8738,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.788163+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:51:47.788163+0000","last_peered":"2026-02-24T07:51:47.788163+0000","last_clean":"2026-02-24T07:51:47.788163+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:51:47.788163+0000","last_undegraded":"2026-02-24T07:51:47.788163+0000","last_fullsized":"2026-02-24T07:51:47.788163+0000","mapping_epoch":57,"log_start":"61'8714","ondisk_log_start":"61'8714","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71589888,"num_objects":1093,"num_object_clones":0,"num_object_copies":3279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8739,"num_write_kb":69912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'8352","reported_seq":8370,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.784161+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:51:47.784161+0000","last_peered":"2026-02-24T07:51:47.784161+0000","last_clean":"2026-02-24T07:51:47.784161+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:51:47.784161+0000","last_undegraded":"2026-02-24T07:51:47.784161+0000","last_fullsized":"2026-02-24T07:51:47.784161+0000","mapping_epoch":57,"log_start":"61'8344","ondisk_log_start":"61'8344","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68419584,"num_objects":1044,"num_object_clones":0,"num_object_copies":3132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":66816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'8552","reported_seq":8563,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:47.775682+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:51:47.775682+0000","last_peered":"2026-02-24T07:51:47.775682+0000","last_clean":"2026-02-24T07:51:47.775682+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:51:47.775682+0000","last_undegraded":"2026-02-24T07:51:47.775682+0000","last_fullsized":"2026-02-24T07:51:47.775682+0000","mapping_epoch":57,"log_start":"61'8544","ondisk_log_start":"61'8544","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70057984,"num_objects":1069,"num_object_clones":0,"num_object_copies":3207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8552,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1130618880,"num_objects":17253,"num_object_clones":0,"num_object_copies":51759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138015,"num_write_kb":1104120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3392585728,"data_stored":3392585728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3850,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2609396,"kb_used_data":776864,"kb_used_omap":15,"kb_used_meta":1832496,"kb_avail":731393804,"statfs":{"total":751619276800,"available":748947255296,"internally_reserved":0,"allocated":795508736,"data_stored":795094583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16325,"internal_metadata":1876475963},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2525756,"kb_used_data":898216,"kb_used_omap":13,"kb_used_meta":1627506,"kb_avail":731477444,"statfs":{"total":751619276800,"available":749032902656,"internally_reserved":0,"allocated":919773184,"data_stored":919359031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13578,"internal_metadata":1666566902},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2250032,"kb_used_data":685020,"kb_used_omap":11,"kb_used_meta":1564980,"kb_avail":731753168,"statfs":{"total":751619276800,"available":749315244032,"internally_reserved":0,"allocated":701460480,"data_stored":701049879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1602539538},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2681068,"kb_used_data":791000,"kb_used_omap":12,"kb_used_meta":1890035,"kb_avail":731322132,"statfs":{"total":751619276800,"available":748873863168,"internally_reserved":0,"allocated":809984000,"data_stored":809569847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1935396223},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3850,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":843030528,"data_stored":843030528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":718340096,"data_stored":718340096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":990969856,"data_stored":990969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":840245248,"data_stored":840245248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:51:53.811 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:51:53.811 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 91 2026-02-24T07:51:53.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 127 197730 197603 81.2449 68.6406 0.00721405 0.0123031 2026-02-24T07:51:53.959 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:54.234 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:51:54.466 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:54.405+0000 7fa5cca2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:54.466 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:54.405+0000 7fa5cca2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:54.482 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:54.554 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:51:54.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:51:54.942587+0000 min lat: 0.000623079 max lat: 0.0854784 avg lat: 0.0123826 2026-02-24T07:51:54.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:51:54.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 127 206808 206681 80.7285 70.9219 0.00939993 0.0123826 2026-02-24T07:51:55.259 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:54 trial016 ceph-mon[39544]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:51:55.260 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:54 trial016 ceph-mon[39544]: pgmap v189: 17 pgs: 17 active+clean; 1.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.33k op/s 2026-02-24T07:51:55.260 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1066422451' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "91"} : dispatch 2026-02-24T07:51:55.260 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:51:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:51:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:51:55.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:51:55.589 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:55.563+0000 7f8a87709640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:55.590 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:55.563+0000 7f8a87709640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:55.590 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:55.590 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:55.594 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:55.594 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:55.631 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:55.632 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:55.649 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:55.649 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:55.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 215034 214906 79.9439 64.2578 0.00830789 0.0124995 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:51:56.160 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3978005430' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:56.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 127 224372 224245 79.6262 72.9609 0.0127264 0.012553 2026-02-24T07:51:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:56 trial016 ceph-mon[39544]: pgmap v190: 17 pgs: 17 active+clean; 1.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.46k op/s 2026-02-24T07:51:57.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 128 235167 235039 79.8305 84.3281 0.00755696 0.0125226 2026-02-24T07:51:58.188 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:51:58.343 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:51:58.463 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:58.460+0000 7fa269580640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:58.463 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:51:58.461+0000 7fa269580640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:51:58.480 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:51:58.480 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:51:58.498 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:51:58.498 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:51:58.516 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:51:58.517 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:51:58.533 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:51:58.534 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:51:58.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 128 246403 246275 80.1615 87.7812 0.00765564 0.0124696 2026-02-24T07:51:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:58 trial016 ceph-mon[39544]: pgmap v191: 17 pgs: 17 active+clean; 1.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.61k op/s 2026-02-24T07:51:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:51:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1731505152' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:51:59.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 128 257924 257796 80.555 90.0078 0.0071024 0.0124091 2026-02-24T07:52:00.282 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:00.282 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:00.282 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:52:00.283 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:00.431 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:00.559 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:00.556+0000 7fa5ba1da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:00.559 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:00.556+0000 7fa5ba1da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:00.584 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:00.720 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:00.721 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:00.744 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:00.773 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2026-02-24T07:51:59.781246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1917043232,"num_objects":29247,"num_object_clones":0,"num_object_copies":87741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29247,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":234077,"num_write_kb":1873686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11967140,"kb_used_data":5452180,"kb_used_omap":53,"kb_used_meta":6514826,"kb_avail":2924045660,"statfs":{"total":3006477107200,"available":2994222755840,"internally_reserved":0,"allocated":5583032320,"data_stored":5581379260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55102,"internal_metadata":6671182018},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,6,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1221246976,"num_objects":18636,"num_object_clones":0,"num_object_copies":55908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149078,"num_write_kb":1192624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001494"},"pg_stats":[{"pgid":"4.f","version":"61'15040","reported_seq":15057,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.947050+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:51:57.947050+0000","last_peered":"2026-02-24T07:51:57.947050+0000","last_clean":"2026-02-24T07:51:57.947050+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:51:57.947050+0000","last_undegraded":"2026-02-24T07:51:57.947050+0000","last_fullsized":"2026-02-24T07:51:57.947050+0000","mapping_epoch":57,"log_start":"61'15032","ondisk_log_start":"61'15032","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123207680,"num_objects":1880,"num_object_clones":0,"num_object_copies":5640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15040,"num_write_kb":120320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'15021","reported_seq":15034,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.785115+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:51:57.785115+0000","last_peered":"2026-02-24T07:51:57.785115+0000","last_clean":"2026-02-24T07:51:57.785115+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:51:57.785115+0000","last_undegraded":"2026-02-24T07:51:57.785115+0000","last_fullsized":"2026-02-24T07:51:57.785115+0000","mapping_epoch":57,"log_start":"61'15015","ondisk_log_start":"61'15015","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123052032,"num_objects":1878,"num_object_clones":0,"num_object_copies":5634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15021,"num_write_kb":120168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'13976","reported_seq":13994,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.797044+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:51:57.797044+0000","last_peered":"2026-02-24T07:51:57.797044+0000","last_clean":"2026-02-24T07:51:57.797044+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:51:57.797044+0000","last_undegraded":"2026-02-24T07:51:57.797044+0000","last_fullsized":"2026-02-24T07:51:57.797044+0000","mapping_epoch":57,"log_start":"61'13968","ondisk_log_start":"61'13968","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114491392,"num_objects":1747,"num_object_clones":0,"num_object_copies":5241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13976,"num_write_kb":111808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'14432","reported_seq":14439,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.798446+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:51:57.798446+0000","last_peered":"2026-02-24T07:51:57.798446+0000","last_clean":"2026-02-24T07:51:57.798446+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:51:57.798446+0000","last_undegraded":"2026-02-24T07:51:57.798446+0000","last_fullsized":"2026-02-24T07:51:57.798446+0000","mapping_epoch":57,"log_start":"61'14408","ondisk_log_start":"61'14408","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118226944,"num_objects":1804,"num_object_clones":0,"num_object_copies":5412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14432,"num_write_kb":115456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'14960","reported_seq":14978,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.800501+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:51:57.800501+0000","last_peered":"2026-02-24T07:51:57.800501+0000","last_clean":"2026-02-24T07:51:57.800501+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:51:57.800501+0000","last_undegraded":"2026-02-24T07:51:57.800501+0000","last_fullsized":"2026-02-24T07:51:57.800501+0000","mapping_epoch":57,"log_start":"61'14952","ondisk_log_start":"61'14952","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122552320,"num_objects":1870,"num_object_clones":0,"num_object_copies":5610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14960,"num_write_kb":119680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'14447","reported_seq":14450,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.793282+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:51:57.793282+0000","last_peered":"2026-02-24T07:51:57.793282+0000","last_clean":"2026-02-24T07:51:57.793282+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:51:57.793282+0000","last_undegraded":"2026-02-24T07:51:57.793282+0000","last_fullsized":"2026-02-24T07:51:57.793282+0000","mapping_epoch":57,"log_start":"61'14429","ondisk_log_start":"61'14429","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118349824,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14447,"num_write_kb":115576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'14960","reported_seq":14954,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.792471+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:51:57.792471+0000","last_peered":"2026-02-24T07:51:57.792471+0000","last_clean":"2026-02-24T07:51:57.792471+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:51:57.792471+0000","last_undegraded":"2026-02-24T07:51:57.792471+0000","last_fullsized":"2026-02-24T07:51:57.792471+0000","mapping_epoch":57,"log_start":"61'14935","ondisk_log_start":"61'14935","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122552320,"num_objects":1870,"num_object_clones":0,"num_object_copies":5610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14960,"num_write_kb":119680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'14790","reported_seq":14802,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.797739+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:51:57.797739+0000","last_peered":"2026-02-24T07:51:57.797739+0000","last_clean":"2026-02-24T07:51:57.797739+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:51:57.797739+0000","last_undegraded":"2026-02-24T07:51:57.797739+0000","last_fullsized":"2026-02-24T07:51:57.797739+0000","mapping_epoch":57,"log_start":"61'14783","ondisk_log_start":"61'14783","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121159680,"num_objects":1849,"num_object_clones":0,"num_object_copies":5547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14790,"num_write_kb":118320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'14640","reported_seq":14658,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.939996+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:51:57.939996+0000","last_peered":"2026-02-24T07:51:57.939996+0000","last_clean":"2026-02-24T07:51:57.939996+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:51:57.939996+0000","last_undegraded":"2026-02-24T07:51:57.939996+0000","last_fullsized":"2026-02-24T07:51:57.939996+0000","mapping_epoch":57,"log_start":"61'14624","ondisk_log_start":"61'14624","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119930880,"num_objects":1830,"num_object_clones":0,"num_object_copies":5490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14640,"num_write_kb":117120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'15144","reported_seq":15157,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.803392+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:51:57.803392+0000","last_peered":"2026-02-24T07:51:57.803392+0000","last_clean":"2026-02-24T07:51:57.803392+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:51:57.803392+0000","last_undegraded":"2026-02-24T07:51:57.803392+0000","last_fullsized":"2026-02-24T07:51:57.803392+0000","mapping_epoch":57,"log_start":"61'15136","ondisk_log_start":"61'15136","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124059648,"num_objects":1893,"num_object_clones":0,"num_object_copies":5679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15144,"num_write_kb":121152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'14448","reported_seq":14466,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.924330+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:51:57.924330+0000","last_peered":"2026-02-24T07:51:57.924330+0000","last_clean":"2026-02-24T07:51:57.924330+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:51:57.924330+0000","last_undegraded":"2026-02-24T07:51:57.924330+0000","last_fullsized":"2026-02-24T07:51:57.924330+0000","mapping_epoch":57,"log_start":"61'14440","ondisk_log_start":"61'14440","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14448,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'14640","reported_seq":14658,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.799704+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:51:57.799704+0000","last_peered":"2026-02-24T07:51:57.799704+0000","last_clean":"2026-02-24T07:51:57.799704+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:51:57.799704+0000","last_undegraded":"2026-02-24T07:51:57.799704+0000","last_fullsized":"2026-02-24T07:51:57.799704+0000","mapping_epoch":57,"log_start":"61'14632","ondisk_log_start":"61'14632","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119930880,"num_objects":1830,"num_object_clones":0,"num_object_copies":5490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14640,"num_write_kb":117120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'14211","reported_seq":14226,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.939846+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:51:57.939846+0000","last_peered":"2026-02-24T07:51:57.939846+0000","last_clean":"2026-02-24T07:51:57.939846+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:51:57.939846+0000","last_undegraded":"2026-02-24T07:51:57.939846+0000","last_fullsized":"2026-02-24T07:51:57.939846+0000","mapping_epoch":57,"log_start":"61'14206","ondisk_log_start":"61'14206","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116416512,"num_objects":1777,"num_object_clones":0,"num_object_copies":5331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14211,"num_write_kb":113688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'14568","reported_seq":14586,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.782870+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:51:57.782870+0000","last_peered":"2026-02-24T07:51:57.782870+0000","last_clean":"2026-02-24T07:51:57.782870+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:51:57.782870+0000","last_undegraded":"2026-02-24T07:51:57.782870+0000","last_fullsized":"2026-02-24T07:51:57.782870+0000","mapping_epoch":57,"log_start":"61'14560","ondisk_log_start":"61'14560","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119341056,"num_objects":1821,"num_object_clones":0,"num_object_copies":5463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14568,"num_write_kb":116544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'14144","reported_seq":14162,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.782520+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:51:57.782520+0000","last_peered":"2026-02-24T07:51:57.782520+0000","last_clean":"2026-02-24T07:51:57.782520+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:51:57.782520+0000","last_undegraded":"2026-02-24T07:51:57.782520+0000","last_fullsized":"2026-02-24T07:51:57.782520+0000","mapping_epoch":57,"log_start":"61'14136","ondisk_log_start":"61'14136","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115867648,"num_objects":1768,"num_object_clones":0,"num_object_copies":5304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14144,"num_write_kb":113152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'14521","reported_seq":14521,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:57.798373+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:51:57.798373+0000","last_peered":"2026-02-24T07:51:57.798373+0000","last_clean":"2026-02-24T07:51:57.798373+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:51:57.798373+0000","last_undegraded":"2026-02-24T07:51:57.798373+0000","last_fullsized":"2026-02-24T07:51:57.798373+0000","mapping_epoch":57,"log_start":"61'14502","ondisk_log_start":"61'14502","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118956032,"num_objects":1816,"num_object_clones":0,"num_object_copies":5448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14521,"num_write_kb":116168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1916452864,"num_objects":29245,"num_object_clones":0,"num_object_copies":87735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233942,"num_write_kb":1871536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5748736000,"data_stored":5748736000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3850,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3290724,"kb_used_data":1342864,"kb_used_omap":15,"kb_used_meta":1947824,"kb_avail":730712476,"statfs":{"total":751619276800,"available":748249575424,"internally_reserved":0,"allocated":1375092736,"data_stored":1374678583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16325,"internal_metadata":1994571835},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444098,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3415740,"kb_used_data":1571624,"kb_used_omap":13,"kb_used_meta":1844082,"kb_avail":730587460,"statfs":{"total":751619276800,"available":748121559040,"internally_reserved":0,"allocated":1609342976,"data_stored":1608928823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13578,"internal_metadata":1888340726},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2853288,"kb_used_data":1161940,"kb_used_omap":11,"kb_used_meta":1691316,"kb_avail":731149912,"statfs":{"total":751619276800,"available":748697509888,"internally_reserved":0,"allocated":1189826560,"data_stored":1189415959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1731907602},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705735,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2407388,"kb_used_data":1375752,"kb_used_omap":12,"kb_used_meta":1031603,"kb_avail":731595812,"statfs":{"total":751619276800,"available":749154111488,"internally_reserved":0,"allocated":1408770048,"data_stored":1408355895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1056361855},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,6,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3850,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1432002560,"data_stored":1432002560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1211891712,"data_stored":1211891712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679884288,"data_stored":1679884288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1424957440,"data_stored":1424957440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:00.774 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 91 2026-02-24T07:52:00.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:00.867+0000 7ff7e8ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:00.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:00.867+0000 7ff7e8ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:00.888 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:00.888 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:00.908 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:00.908 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:00.922 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:00.922 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:00.925 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:00.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 269700 269572 80.9949 92 0.00287711 0.0123408 2026-02-24T07:52:00.951 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:00.952 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:01.054 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:01.052+0000 7fab83f40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:01.054 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:01.052+0000 7fab83f40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:00 trial016 ceph-mon[39544]: pgmap v192: 17 pgs: 17 active+clean; 1.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 97 MiB/s wr, 12.42k op/s 2026-02-24T07:52:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2017985601' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:01.208 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:52:01.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:01.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 128 280988 280860 81.2611 88.1875 0.0218327 0.0123009 2026-02-24T07:52:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:01 trial016 ceph-mon[39544]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:02.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4101846009' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "91"} : dispatch 2026-02-24T07:52:02.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 293009 292881 81.7127 93.9141 0.0170847 0.0122343 2026-02-24T07:52:03.013 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:03.172 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:03.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:02 trial016 ceph-mon[39544]: pgmap v193: 17 pgs: 17 active+clean; 1.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.99k op/s 2026-02-24T07:52:03.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:03.581+0000 7f39120d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:03.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:03.582+0000 7f39120d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:03.601 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:03.601 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:03.625 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:03.625 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:03.655 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:03.655 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:03.687 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:03.688 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:03.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 302144 302016 81.3558 71.3672 0.0382163 0.012285 2026-02-24T07:52:04.313 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3784732821' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:04.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 127 311808 311681 81.1607 75.5078 0.00823233 0.0123177 2026-02-24T07:52:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:04 trial016 ceph-mon[39544]: pgmap v194: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 100 MiB/s wr, 12.80k op/s 2026-02-24T07:52:05.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:05.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 128 322338 322210 81.1958 82.2578 0.0153154 0.012312 2026-02-24T07:52:06.253 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:06.254 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:06.254 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:52:06.254 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:06.335 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:06.406 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:06.485 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:06.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:06.534+0000 7f6425ed2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:06.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:06.534+0000 7f6425ed2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:06.614 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:06.611+0000 7fc5d562b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:06.615 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:06.611+0000 7fc5d562b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:06.628 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:06.628 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:06.657 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:06.657 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:06.671 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:06.671 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:06.685 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:06.685 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:06.697 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:06.697 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:06.753 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2026-02-24T07:52:05.782061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2389910048,"num_objects":36462,"num_object_clones":0,"num_object_copies":109386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36462,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":291800,"num_write_kb":2335470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12270828,"kb_used_data":6816412,"kb_used_omap":36,"kb_used_meta":5454299,"kb_avail":2923741972,"statfs":{"total":3006477107200,"available":2993911779328,"internally_reserved":0,"allocated":6980005888,"data_stored":6978352828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37471,"internal_metadata":5585202593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,8,16],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":848052224,"num_objects":12942,"num_object_clones":0,"num_object_copies":38826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103522,"num_write_kb":828176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001609"},"pg_stats":[{"pgid":"4.f","version":"61'18656","reported_seq":18671,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.948237+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:02.948237+0000","last_peered":"2026-02-24T07:52:02.948237+0000","last_clean":"2026-02-24T07:52:02.948237+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:02.948237+0000","last_undegraded":"2026-02-24T07:52:02.948237+0000","last_fullsized":"2026-02-24T07:52:02.948237+0000","mapping_epoch":57,"log_start":"61'18648","ondisk_log_start":"61'18648","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152829952,"num_objects":2332,"num_object_clones":0,"num_object_copies":6996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18656,"num_write_kb":149248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'18648","reported_seq":18666,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.790142+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:02.790142+0000","last_peered":"2026-02-24T07:52:02.790142+0000","last_clean":"2026-02-24T07:52:02.790142+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:02.790142+0000","last_undegraded":"2026-02-24T07:52:02.790142+0000","last_fullsized":"2026-02-24T07:52:02.790142+0000","mapping_epoch":57,"log_start":"61'18640","ondisk_log_start":"61'18640","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152764416,"num_objects":2331,"num_object_clones":0,"num_object_copies":6993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18648,"num_write_kb":149184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'17400","reported_seq":17418,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.797538+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:02.797538+0000","last_peered":"2026-02-24T07:52:02.797538+0000","last_clean":"2026-02-24T07:52:02.797538+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:02.797538+0000","last_undegraded":"2026-02-24T07:52:02.797538+0000","last_fullsized":"2026-02-24T07:52:02.797538+0000","mapping_epoch":57,"log_start":"61'17384","ondisk_log_start":"61'17384","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142540800,"num_objects":2175,"num_object_clones":0,"num_object_copies":6525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17400,"num_write_kb":139200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'18024","reported_seq":18042,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.790404+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:02.790404+0000","last_peered":"2026-02-24T07:52:02.790404+0000","last_clean":"2026-02-24T07:52:02.790404+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:02.790404+0000","last_undegraded":"2026-02-24T07:52:02.790404+0000","last_fullsized":"2026-02-24T07:52:02.790404+0000","mapping_epoch":57,"log_start":"61'18006","ondisk_log_start":"61'18006","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147652608,"num_objects":2253,"num_object_clones":0,"num_object_copies":6759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18024,"num_write_kb":144192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'18587","reported_seq":18599,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.801416+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:02.801416+0000","last_peered":"2026-02-24T07:52:02.801416+0000","last_clean":"2026-02-24T07:52:02.801416+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:02.801416+0000","last_undegraded":"2026-02-24T07:52:02.801416+0000","last_fullsized":"2026-02-24T07:52:02.801416+0000","mapping_epoch":57,"log_start":"61'18577","ondisk_log_start":"61'18577","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152264704,"num_objects":2324,"num_object_clones":0,"num_object_copies":6972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2324,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18587,"num_write_kb":148696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'17942","reported_seq":17954,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.792714+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:02.792714+0000","last_peered":"2026-02-24T07:52:02.792714+0000","last_clean":"2026-02-24T07:52:02.792714+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:02.792714+0000","last_undegraded":"2026-02-24T07:52:02.792714+0000","last_fullsized":"2026-02-24T07:52:02.792714+0000","mapping_epoch":57,"log_start":"61'17933","ondisk_log_start":"61'17933","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146980864,"num_objects":2243,"num_object_clones":0,"num_object_copies":6729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17942,"num_write_kb":143536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'18688","reported_seq":18706,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.773288+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:02.773288+0000","last_peered":"2026-02-24T07:52:02.773288+0000","last_clean":"2026-02-24T07:52:02.773288+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:02.773288+0000","last_undegraded":"2026-02-24T07:52:02.773288+0000","last_fullsized":"2026-02-24T07:52:02.773288+0000","mapping_epoch":57,"log_start":"61'18680","ondisk_log_start":"61'18680","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153092096,"num_objects":2336,"num_object_clones":0,"num_object_copies":7008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18688,"num_write_kb":149504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'18384","reported_seq":18402,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.797637+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:02.797637+0000","last_peered":"2026-02-24T07:52:02.797637+0000","last_clean":"2026-02-24T07:52:02.797637+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:02.797637+0000","last_undegraded":"2026-02-24T07:52:02.797637+0000","last_fullsized":"2026-02-24T07:52:02.797637+0000","mapping_epoch":57,"log_start":"61'18368","ondisk_log_start":"61'18368","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150601728,"num_objects":2298,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18384,"num_write_kb":147072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'18344","reported_seq":18362,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.904507+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:02.904507+0000","last_peered":"2026-02-24T07:52:02.904507+0000","last_clean":"2026-02-24T07:52:02.904507+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:02.904507+0000","last_undegraded":"2026-02-24T07:52:02.904507+0000","last_fullsized":"2026-02-24T07:52:02.904507+0000","mapping_epoch":57,"log_start":"61'18336","ondisk_log_start":"61'18336","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150274048,"num_objects":2293,"num_object_clones":0,"num_object_copies":6879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18344,"num_write_kb":146752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'18728","reported_seq":18746,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.797883+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:02.797883+0000","last_peered":"2026-02-24T07:52:02.797883+0000","last_clean":"2026-02-24T07:52:02.797883+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:02.797883+0000","last_undegraded":"2026-02-24T07:52:02.797883+0000","last_fullsized":"2026-02-24T07:52:02.797883+0000","mapping_epoch":57,"log_start":"61'18712","ondisk_log_start":"61'18712","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153419776,"num_objects":2341,"num_object_clones":0,"num_object_copies":7023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18728,"num_write_kb":149824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'17912","reported_seq":17930,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.945243+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:02.945243+0000","last_peered":"2026-02-24T07:52:02.945243+0000","last_clean":"2026-02-24T07:52:02.945243+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:02.945243+0000","last_undegraded":"2026-02-24T07:52:02.945243+0000","last_fullsized":"2026-02-24T07:52:02.945243+0000","mapping_epoch":57,"log_start":"61'17904","ondisk_log_start":"61'17904","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146735104,"num_objects":2239,"num_object_clones":0,"num_object_copies":6717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17912,"num_write_kb":143296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'18272","reported_seq":18290,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.798737+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:02.798737+0000","last_peered":"2026-02-24T07:52:02.798737+0000","last_clean":"2026-02-24T07:52:02.798737+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:02.798737+0000","last_undegraded":"2026-02-24T07:52:02.798737+0000","last_fullsized":"2026-02-24T07:52:02.798737+0000","mapping_epoch":57,"log_start":"61'18256","ondisk_log_start":"61'18256","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149684224,"num_objects":2284,"num_object_clones":0,"num_object_copies":6852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18272,"num_write_kb":146176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'17680","reported_seq":17696,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.946826+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:02.946826+0000","last_peered":"2026-02-24T07:52:02.946826+0000","last_clean":"2026-02-24T07:52:02.946826+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:02.946826+0000","last_undegraded":"2026-02-24T07:52:02.946826+0000","last_fullsized":"2026-02-24T07:52:02.946826+0000","mapping_epoch":57,"log_start":"61'17664","ondisk_log_start":"61'17664","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144834560,"num_objects":2210,"num_object_clones":0,"num_object_copies":6630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17680,"num_write_kb":141440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'18480","reported_seq":18498,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.775560+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:02.775560+0000","last_peered":"2026-02-24T07:52:02.775560+0000","last_clean":"2026-02-24T07:52:02.775560+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:02.775560+0000","last_undegraded":"2026-02-24T07:52:02.775560+0000","last_fullsized":"2026-02-24T07:52:02.775560+0000","mapping_epoch":57,"log_start":"61'18472","ondisk_log_start":"61'18472","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151388160,"num_objects":2310,"num_object_clones":0,"num_object_copies":6930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18480,"num_write_kb":147840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'17823","reported_seq":17836,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.801818+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:02.801818+0000","last_peered":"2026-02-24T07:52:02.801818+0000","last_clean":"2026-02-24T07:52:02.801818+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:02.801818+0000","last_undegraded":"2026-02-24T07:52:02.801818+0000","last_fullsized":"2026-02-24T07:52:02.801818+0000","mapping_epoch":57,"log_start":"61'17816","ondisk_log_start":"61'17816","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146006016,"num_objects":2228,"num_object_clones":0,"num_object_copies":6684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17823,"num_write_kb":142584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'18097","reported_seq":18114,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:02.798975+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:02.798975+0000","last_peered":"2026-02-24T07:52:02.798975+0000","last_clean":"2026-02-24T07:52:02.798975+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:02.798975+0000","last_undegraded":"2026-02-24T07:52:02.798975+0000","last_fullsized":"2026-02-24T07:52:02.798975+0000","mapping_epoch":57,"log_start":"61'18093","ondisk_log_start":"61'18093","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148250624,"num_objects":2263,"num_object_clones":0,"num_object_copies":6789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18097,"num_write_kb":144776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2389319680,"num_objects":36460,"num_object_clones":0,"num_object_copies":109380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36460,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291665,"num_write_kb":2333320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7167361024,"data_stored":7167361024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2778028,"kb_used_data":1678360,"kb_used_omap":6,"kb_used_meta":1099641,"kb_avail":731225172,"statfs":{"total":751619276800,"available":748774576128,"internally_reserved":0,"allocated":1718640640,"data_stored":1718226487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6149,"internal_metadata":1126033403},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444099,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3350420,"kb_used_data":1971328,"kb_used_omap":5,"kb_used_meta":1379066,"kb_avail":730652780,"statfs":{"total":751619276800,"available":748188446720,"internally_reserved":0,"allocated":2018639872,"data_stored":2018225719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6123,"internal_metadata":1412163605},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3264160,"kb_used_data":1446476,"kb_used_omap":11,"kb_used_meta":1817652,"kb_avail":730739040,"statfs":{"total":751619276800,"available":748276776960,"internally_reserved":0,"allocated":1481191424,"data_stored":1480780823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1861275666},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2878220,"kb_used_data":1720248,"kb_used_omap":12,"kb_used_meta":1157939,"kb_avail":731124980,"statfs":{"total":751619276800,"available":748671979520,"internally_reserved":0,"allocated":1761533952,"data_stored":1761119799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1185729919},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,8,16],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1787191296,"data_stored":1787191296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1506648064,"data_stored":1506648064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2095857664,"data_stored":2095857664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1777664000,"data_stored":1777664000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:06.755 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:52:06.755 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 101 2026-02-24T07:52:06.937 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:06.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 127 332279 332152 81.0855 77.6719 0.00303277 0.0123288 2026-02-24T07:52:07.076 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:06 trial016 ceph-mon[39544]: pgmap v195: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.62k op/s 2026-02-24T07:52:07.076 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/929133907' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:07.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:07.073+0000 7f1f75166640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:07.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:07.073+0000 7f1f75166640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:07.224 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:52:07.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:07.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 128 343133 343005 81.1976 84.7891 0.0140829 0.0123115 2026-02-24T07:52:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:07 trial016 ceph-mon[39544]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1461709233' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "101"} : dispatch 2026-02-24T07:52:08.745 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:08.892 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:08.944 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 353597 353469 81.2136 81.75 0.00112571 0.0123084 2026-02-24T07:52:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:08 trial016 ceph-mon[39544]: pgmap v196: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.62k op/s 2026-02-24T07:52:09.347 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:09.338+0000 7fc8f1632640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:09.347 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:09.338+0000 7fc8f1632640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:09.359 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:09.360 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:09.375 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:09.376 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:09.395 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:09.395 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:09.420 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:09.420 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:09.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 362996 362868 80.9911 73.4297 0.00398729 0.0123428 2026-02-24T07:52:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/426481886' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:10.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 374353 374225 81.2058 88.7266 0.0114089 0.0123109 2026-02-24T07:52:11.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:10 trial016 ceph-mon[39544]: pgmap v197: 17 pgs: 17 active+clean; 2.6 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 100 MiB/s wr, 12.81k op/s 2026-02-24T07:52:11.470 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:11.625 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:11.754 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:11.751+0000 7f8466400640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:11.754 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:11.752+0000 7f8466400640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:11.773 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:11.774 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:11.786 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:11.786 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:11.806 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:11.807 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:11.821 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:11.822 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:11.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 128 385430 385302 81.3497 86.5391 0.0106106 0.0122891 2026-02-24T07:52:12.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3791924672' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:12.269 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:12.269 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:12.269 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:52:12.269 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:12.425 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:12.568 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:12.565+0000 7fb0540ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:12.568 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:12.565+0000 7fb0540ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:12.706 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:12.707 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:12.760 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2026-02-24T07:52:11.782852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2801631776,"num_objects":42744,"num_object_clones":0,"num_object_copies":128232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42744,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":342059,"num_write_kb":2737542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13874756,"kb_used_data":8041332,"kb_used_omap":36,"kb_used_meta":5833307,"kb_avail":2922138044,"statfs":{"total":3006477107200,"available":2992269357056,"internally_reserved":0,"allocated":8234323968,"data_stored":8232670908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37471,"internal_metadata":5973306785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,15,16,8,46,13,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":884588544,"num_objects":13497,"num_object_clones":0,"num_object_copies":40491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107982,"num_write_kb":863856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001605"},"pg_stats":[{"pgid":"4.f","version":"61'21824","reported_seq":21842,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.929286+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:07.929286+0000","last_peered":"2026-02-24T07:52:07.929286+0000","last_clean":"2026-02-24T07:52:07.929286+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:07.929286+0000","last_undegraded":"2026-02-24T07:52:07.929286+0000","last_fullsized":"2026-02-24T07:52:07.929286+0000","mapping_epoch":57,"log_start":"61'21818","ondisk_log_start":"61'21818","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178782208,"num_objects":2728,"num_object_clones":0,"num_object_copies":8184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21824,"num_write_kb":174592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'21912","reported_seq":21930,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.774204+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:07.774204+0000","last_peered":"2026-02-24T07:52:07.774204+0000","last_clean":"2026-02-24T07:52:07.774204+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:07.774204+0000","last_undegraded":"2026-02-24T07:52:07.774204+0000","last_fullsized":"2026-02-24T07:52:07.774204+0000","mapping_epoch":57,"log_start":"61'21896","ondisk_log_start":"61'21896","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":8217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21912,"num_write_kb":175296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'20568","reported_seq":20586,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.788137+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:07.788137+0000","last_peered":"2026-02-24T07:52:07.788137+0000","last_clean":"2026-02-24T07:52:07.788137+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:07.788137+0000","last_undegraded":"2026-02-24T07:52:07.788137+0000","last_fullsized":"2026-02-24T07:52:07.788137+0000","mapping_epoch":57,"log_start":"61'20552","ondisk_log_start":"61'20552","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168493056,"num_objects":2571,"num_object_clones":0,"num_object_copies":7713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20568,"num_write_kb":164544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'21216","reported_seq":21234,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.783206+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:07.783206+0000","last_peered":"2026-02-24T07:52:07.783206+0000","last_clean":"2026-02-24T07:52:07.783206+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:07.783206+0000","last_undegraded":"2026-02-24T07:52:07.783206+0000","last_fullsized":"2026-02-24T07:52:07.783206+0000","mapping_epoch":57,"log_start":"61'21208","ondisk_log_start":"61'21208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173801472,"num_objects":2652,"num_object_clones":0,"num_object_copies":7956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21216,"num_write_kb":169728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'21712","reported_seq":21705,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.805696+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:07.805696+0000","last_peered":"2026-02-24T07:52:07.805696+0000","last_clean":"2026-02-24T07:52:07.805696+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:07.805696+0000","last_undegraded":"2026-02-24T07:52:07.805696+0000","last_fullsized":"2026-02-24T07:52:07.805696+0000","mapping_epoch":57,"log_start":"61'21680","ondisk_log_start":"61'21680","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177864704,"num_objects":2714,"num_object_clones":0,"num_object_copies":8142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21712,"num_write_kb":173696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'20888","reported_seq":20899,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.775705+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:07.775705+0000","last_peered":"2026-02-24T07:52:07.775705+0000","last_clean":"2026-02-24T07:52:07.775705+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:07.775705+0000","last_undegraded":"2026-02-24T07:52:07.775705+0000","last_fullsized":"2026-02-24T07:52:07.775705+0000","mapping_epoch":57,"log_start":"61'20880","ondisk_log_start":"61'20880","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171114496,"num_objects":2611,"num_object_clones":0,"num_object_copies":7833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20888,"num_write_kb":167104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'21808","reported_seq":21826,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.763334+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:07.763334+0000","last_peered":"2026-02-24T07:52:07.763334+0000","last_clean":"2026-02-24T07:52:07.763334+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:07.763334+0000","last_undegraded":"2026-02-24T07:52:07.763334+0000","last_fullsized":"2026-02-24T07:52:07.763334+0000","mapping_epoch":57,"log_start":"61'21803","ondisk_log_start":"61'21803","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178651136,"num_objects":2726,"num_object_clones":0,"num_object_copies":8178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":174464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'21668","reported_seq":21682,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.788685+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:07.788685+0000","last_peered":"2026-02-24T07:52:07.788685+0000","last_clean":"2026-02-24T07:52:07.788685+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:07.788685+0000","last_undegraded":"2026-02-24T07:52:07.788685+0000","last_fullsized":"2026-02-24T07:52:07.788685+0000","mapping_epoch":57,"log_start":"61'21655","ondisk_log_start":"61'21655","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177504256,"num_objects":2709,"num_object_clones":0,"num_object_copies":8127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":173344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'21152","reported_seq":21170,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.944506+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:07.944506+0000","last_peered":"2026-02-24T07:52:07.944506+0000","last_clean":"2026-02-24T07:52:07.944506+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:07.944506+0000","last_undegraded":"2026-02-24T07:52:07.944506+0000","last_fullsized":"2026-02-24T07:52:07.944506+0000","mapping_epoch":57,"log_start":"61'21145","ondisk_log_start":"61'21145","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173277184,"num_objects":2644,"num_object_clones":0,"num_object_copies":7932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21152,"num_write_kb":169216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'21960","reported_seq":21978,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.797369+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:07.797369+0000","last_peered":"2026-02-24T07:52:07.797369+0000","last_clean":"2026-02-24T07:52:07.797369+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:07.797369+0000","last_undegraded":"2026-02-24T07:52:07.797369+0000","last_fullsized":"2026-02-24T07:52:07.797369+0000","mapping_epoch":57,"log_start":"61'21952","ondisk_log_start":"61'21952","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179896320,"num_objects":2745,"num_object_clones":0,"num_object_copies":8235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":175680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'20944","reported_seq":20962,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.929001+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:07.929001+0000","last_peered":"2026-02-24T07:52:07.929001+0000","last_clean":"2026-02-24T07:52:07.929001+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:07.929001+0000","last_undegraded":"2026-02-24T07:52:07.929001+0000","last_fullsized":"2026-02-24T07:52:07.929001+0000","mapping_epoch":57,"log_start":"61'20940","ondisk_log_start":"61'20940","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171573248,"num_objects":2618,"num_object_clones":0,"num_object_copies":7854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20944,"num_write_kb":167552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'21480","reported_seq":21498,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.805370+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:07.805370+0000","last_peered":"2026-02-24T07:52:07.805370+0000","last_clean":"2026-02-24T07:52:07.805370+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:07.805370+0000","last_undegraded":"2026-02-24T07:52:07.805370+0000","last_fullsized":"2026-02-24T07:52:07.805370+0000","mapping_epoch":57,"log_start":"61'21474","ondisk_log_start":"61'21474","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175964160,"num_objects":2685,"num_object_clones":0,"num_object_copies":8055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21480,"num_write_kb":171840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'20765","reported_seq":20774,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.947337+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:07.947337+0000","last_peered":"2026-02-24T07:52:07.947337+0000","last_clean":"2026-02-24T07:52:07.947337+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:07.947337+0000","last_undegraded":"2026-02-24T07:52:07.947337+0000","last_fullsized":"2026-02-24T07:52:07.947337+0000","mapping_epoch":57,"log_start":"61'20752","ondisk_log_start":"61'20752","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170106880,"num_objects":2596,"num_object_clones":0,"num_object_copies":7788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20765,"num_write_kb":166120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'21856","reported_seq":21868,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.795889+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:07.795889+0000","last_peered":"2026-02-24T07:52:07.795889+0000","last_clean":"2026-02-24T07:52:07.795889+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:07.795889+0000","last_undegraded":"2026-02-24T07:52:07.795889+0000","last_fullsized":"2026-02-24T07:52:07.795889+0000","mapping_epoch":57,"log_start":"61'21829","ondisk_log_start":"61'21829","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":3000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179044352,"num_objects":2732,"num_object_clones":0,"num_object_copies":8196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21856,"num_write_kb":174848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'21016","reported_seq":21034,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.787542+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:07.787542+0000","last_peered":"2026-02-24T07:52:07.787542+0000","last_clean":"2026-02-24T07:52:07.787542+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:07.787542+0000","last_undegraded":"2026-02-24T07:52:07.787542+0000","last_fullsized":"2026-02-24T07:52:07.787542+0000","mapping_epoch":57,"log_start":"61'21008","ondisk_log_start":"61'21008","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172163072,"num_objects":2627,"num_object_clones":0,"num_object_copies":7881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21016,"num_write_kb":168128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'21155","reported_seq":21170,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:07.787405+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:07.787405+0000","last_peered":"2026-02-24T07:52:07.787405+0000","last_clean":"2026-02-24T07:52:07.787405+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:07.787405+0000","last_undegraded":"2026-02-24T07:52:07.787405+0000","last_fullsized":"2026-02-24T07:52:07.787405+0000","mapping_epoch":57,"log_start":"61'21144","ondisk_log_start":"61'21144","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173301760,"num_objects":2645,"num_object_clones":0,"num_object_copies":7935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21155,"num_write_kb":169240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2801041408,"num_objects":42742,"num_object_clones":0,"num_object_copies":128226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341924,"num_write_kb":2735392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8403722240,"data_stored":8403722240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":188,"ondisk_log_size":188,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3195836,"kb_used_data":1987880,"kb_used_omap":6,"kb_used_meta":1207929,"kb_avail":730807364,"statfs":{"total":751619276800,"available":748346740736,"internally_reserved":0,"allocated":2035589120,"data_stored":2035174967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6149,"internal_metadata":1236920315},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,23],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3797868,"kb_used_data":2328536,"kb_used_omap":5,"kb_used_meta":1469306,"kb_avail":730205332,"statfs":{"total":751619276800,"available":747730259968,"internally_reserved":0,"allocated":2384420864,"data_stored":2384006711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6123,"internal_metadata":1504569365},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,6,10,0,23],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3588576,"kb_used_data":1698700,"kb_used_omap":11,"kb_used_meta":1889844,"kb_avail":730414624,"statfs":{"total":751619276800,"available":747944574976,"internally_reserved":0,"allocated":1739468800,"data_stored":1739058199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1935200274},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,9,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3292476,"kb_used_data":2026216,"kb_used_omap":12,"kb_used_meta":1266227,"kb_avail":730710724,"statfs":{"total":751619276800,"available":748247781376,"internally_reserved":0,"allocated":2074845184,"data_stored":2074431031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1296616831},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,13,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2096152576,"data_stored":2096152576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1759846400,"data_stored":1759846400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2457952256,"data_stored":2457952256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2089771008,"data_stored":2089771008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:12.761 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:52:12.761 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 111 2026-02-24T07:52:12.915 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:12.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 396276 396148 81.4386 84.7344 0.00389177 0.0122751 2026-02-24T07:52:13.050 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:13.048+0000 7fcb482fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:13.051 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:13.048+0000 7fcb482fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:13.195 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:52:13.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:12 trial016 ceph-mon[39544]: pgmap v198: 17 pgs: 17 active+clean; 2.6 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 9.00k op/s 2026-02-24T07:52:13.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:13.870 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:13.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 128 407038 406910 81.5061 84.0781 0.00483798 0.0122653 2026-02-24T07:52:14.028 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:14.163 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:14.161+0000 7f7f6c322640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:14.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:14.161+0000 7f7f6c322640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:14.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:13 trial016 ceph-mon[39544]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:14.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/290765851' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "111"} : dispatch 2026-02-24T07:52:14.182 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:14.182 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:14.199 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:14.200 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:14.213 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:14.214 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:14.228 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:14.228 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:14.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:52:14.944109+0000 min lat: 0.000623079 max lat: 0.0854784 avg lat: 0.0122486 2026-02-24T07:52:14.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:52:14.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 127 418068 417941 81.6228 86.1797 0.0104409 0.0122486 2026-02-24T07:52:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:14 trial016 ceph-mon[39544]: pgmap v199: 17 pgs: 17 active+clean; 3.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 105 MiB/s wr, 13.43k op/s 2026-02-24T07:52:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2252203565' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:15.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:15.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 128 428500 428372 81.6194 81.4922 0.00636641 0.0122478 2026-02-24T07:52:16.281 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:16.423 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:16.836 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:16.836 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:16.837 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:16.790+0000 7f2f7ca46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:16.837 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:16.790+0000 7f2f7ca46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:16.837 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:16.837 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:16.899 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:16.899 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:16.930 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:16.930 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:16.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 127 437769 437642 81.4003 72.4219 0.0141789 0.0122813 2026-02-24T07:52:17.235 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:16 trial016 ceph-mon[39544]: pgmap v200: 17 pgs: 17 active+clean; 3.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.62k op/s 2026-02-24T07:52:17.235 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/438952432' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:17.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 446985 446857 81.1814 71.9922 0.00986316 0.0123149 2026-02-24T07:52:18.272 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:18.272 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:52:18.433 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:18.570 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:18.568+0000 7fba646ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:18.570 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:18.568+0000 7fba646ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:18.902 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:52:18.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 458059 457931 81.3025 86.5156 0.00633792 0.0122962 2026-02-24T07:52:18.953 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:52:19.104 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:19.153 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:18 trial016 ceph-mon[39544]: pgmap v201: 17 pgs: 17 active+clean; 3.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.62k op/s 2026-02-24T07:52:19.153 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/409449281' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:52:19.231 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:19.229+0000 7f107aa07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:19.232 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:19.229+0000 7f107aa07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:19.517 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:19.669 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:19.801 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:19.799+0000 7fecff40c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:19.801 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:19.799+0000 7fecff40c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:19.823 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:19.823 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:19.837 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:19.837 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:19.856 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:19.856 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:19.881 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:19.881 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:19.910 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:52:19.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 128 468871 468743 81.3727 84.4688 0.00595297 0.0122856 2026-02-24T07:52:19.964 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:52:20.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/409449281' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:52:20.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:19 trial016 ceph-mon[39544]: osdmap e62: 4 total, 4 up, 4 in 2026-02-24T07:52:20.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3169996926' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:52:20.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/850398508' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:20.153 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:20.294 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:20.290+0000 7f47630f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:20.294 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:20.291+0000 7f47630f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:20.907 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:52:20.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 128 479686 479558 81.4404 84.4922 0.00615393 0.0122758 2026-02-24T07:52:20.955 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:52:21.110 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:21.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:20 trial016 ceph-mon[39544]: pgmap v203: 17 pgs: 17 active+clean; 3.4 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.37k op/s 2026-02-24T07:52:21.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3169996926' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:52:21.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:20 trial016 ceph-mon[39544]: osdmap e63: 4 total, 4 up, 4 in 2026-02-24T07:52:21.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3537045588' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:52:21.240 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:21.238+0000 7f5b7c4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:21.240 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:21.238+0000 7f5b7c4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:21.910 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:52:21.938 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:21.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 128 490258 490130 81.4648 82.5938 0.00490589 0.0122725 2026-02-24T07:52:22.077 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:22.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3537045588' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:52:22.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:21 trial016 ceph-mon[39544]: osdmap e64: 4 total, 4 up, 4 in 2026-02-24T07:52:22.162 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4031433429' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:52:22.510 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:52:22.511 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:22.694 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:22.785 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:22.783+0000 7efc7663b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:22.785 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:22.783+0000 7efc7663b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:22.807 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:22.807 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:22.821 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:22.822 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:22.831 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:22.829+0000 7f44744f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:22.832 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:22.830+0000 7f44744f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:22.838 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:22.839 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:22.865 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:22.865 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:22.945 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 499011 498883 81.1921 68.3828 0.00786077 0.0123126 2026-02-24T07:52:22.991 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:22.991 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:23.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:22 trial016 ceph-mon[39544]: pgmap v206: 17 pgs: 17 active+clean; 3.4 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.43k op/s 2026-02-24T07:52:23.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4031433429' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:52:23.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:22 trial016 ceph-mon[39544]: osdmap e65: 4 total, 4 up, 4 in 2026-02-24T07:52:23.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/720992147' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:23.042 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-24T07:52:21.909133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3651617312,"num_objects":55713,"num_object_clones":0,"num_object_copies":167139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55713,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":445817,"num_write_kb":3567606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242,"ondisk_log_size":242,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15461692,"kb_used_data":10556772,"kb_used_omap":36,"kb_used_meta":4904795,"kb_avail":2920551108,"statfs":{"total":3006477107200,"available":2990644334592,"internally_reserved":0,"allocated":10810134528,"data_stored":10808481468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37471,"internal_metadata":5022510497},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,12,23,59,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":414556160,"num_objects":6326,"num_object_clones":0,"num_object_copies":18978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50605,"num_write_kb":404840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125379"},"pg_stats":[{"pgid":"4.f","version":"61'28304","reported_seq":28314,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949900+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:17.949900+0000","last_peered":"2026-02-24T07:52:17.949900+0000","last_clean":"2026-02-24T07:52:17.949900+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:17.949900+0000","last_undegraded":"2026-02-24T07:52:17.949900+0000","last_fullsized":"2026-02-24T07:52:17.949900+0000","mapping_epoch":57,"log_start":"61'28288","ondisk_log_start":"61'28288","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231866368,"num_objects":3538,"num_object_clones":0,"num_object_copies":10614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28304,"num_write_kb":226432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'28920","reported_seq":28938,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.788135+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:17.788135+0000","last_peered":"2026-02-24T07:52:17.788135+0000","last_clean":"2026-02-24T07:52:17.788135+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:17.788135+0000","last_undegraded":"2026-02-24T07:52:17.788135+0000","last_fullsized":"2026-02-24T07:52:17.788135+0000","mapping_epoch":57,"log_start":"61'28912","ondisk_log_start":"61'28912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236912640,"num_objects":3615,"num_object_clones":0,"num_object_copies":10845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28920,"num_write_kb":231360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'26888","reported_seq":26906,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.797464+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:17.797464+0000","last_peered":"2026-02-24T07:52:17.797464+0000","last_clean":"2026-02-24T07:52:17.797464+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:17.797464+0000","last_undegraded":"2026-02-24T07:52:17.797464+0000","last_fullsized":"2026-02-24T07:52:17.797464+0000","mapping_epoch":57,"log_start":"61'26880","ondisk_log_start":"61'26880","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220266496,"num_objects":3361,"num_object_clones":0,"num_object_copies":10083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26888,"num_write_kb":215104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'27936","reported_seq":27954,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.782616+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:17.782616+0000","last_peered":"2026-02-24T07:52:17.782616+0000","last_clean":"2026-02-24T07:52:17.782616+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:17.782616+0000","last_undegraded":"2026-02-24T07:52:17.782616+0000","last_fullsized":"2026-02-24T07:52:17.782616+0000","mapping_epoch":57,"log_start":"61'27913","ondisk_log_start":"61'27913","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228851712,"num_objects":3492,"num_object_clones":0,"num_object_copies":10476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27936,"num_write_kb":223488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'28152","reported_seq":28170,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.796970+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:17.796970+0000","last_peered":"2026-02-24T07:52:17.796970+0000","last_clean":"2026-02-24T07:52:17.796970+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:17.796970+0000","last_undegraded":"2026-02-24T07:52:17.796970+0000","last_fullsized":"2026-02-24T07:52:17.796970+0000","mapping_epoch":57,"log_start":"61'28136","ondisk_log_start":"61'28136","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230621184,"num_objects":3519,"num_object_clones":0,"num_object_copies":10557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28152,"num_write_kb":225216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'27143","reported_seq":27154,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.796127+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:17.796127+0000","last_peered":"2026-02-24T07:52:17.796127+0000","last_clean":"2026-02-24T07:52:17.796127+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:17.796127+0000","last_undegraded":"2026-02-24T07:52:17.796127+0000","last_fullsized":"2026-02-24T07:52:17.796127+0000","mapping_epoch":57,"log_start":"61'27128","ondisk_log_start":"61'27128","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222355456,"num_objects":3393,"num_object_clones":0,"num_object_copies":10179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27143,"num_write_kb":217144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'28072","reported_seq":28077,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.795630+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:17.795630+0000","last_peered":"2026-02-24T07:52:17.795630+0000","last_clean":"2026-02-24T07:52:17.795630+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:17.795630+0000","last_undegraded":"2026-02-24T07:52:17.795630+0000","last_fullsized":"2026-02-24T07:52:17.795630+0000","mapping_epoch":57,"log_start":"61'28056","ondisk_log_start":"61'28056","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229965824,"num_objects":3509,"num_object_clones":0,"num_object_copies":10527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28072,"num_write_kb":224576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'28680","reported_seq":28698,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.784698+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:17.784698+0000","last_peered":"2026-02-24T07:52:17.784698+0000","last_clean":"2026-02-24T07:52:17.784698+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:17.784698+0000","last_undegraded":"2026-02-24T07:52:17.784698+0000","last_fullsized":"2026-02-24T07:52:17.784698+0000","mapping_epoch":57,"log_start":"61'28672","ondisk_log_start":"61'28672","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234946560,"num_objects":3585,"num_object_clones":0,"num_object_copies":10755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28680,"num_write_kb":229440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'27360","reported_seq":27378,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.914324+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:17.914324+0000","last_peered":"2026-02-24T07:52:17.914324+0000","last_clean":"2026-02-24T07:52:17.914324+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:17.914324+0000","last_undegraded":"2026-02-24T07:52:17.914324+0000","last_fullsized":"2026-02-24T07:52:17.914324+0000","mapping_epoch":57,"log_start":"61'27357","ondisk_log_start":"61'27357","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224133120,"num_objects":3420,"num_object_clones":0,"num_object_copies":10260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27360,"num_write_kb":218880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'28760","reported_seq":28778,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.795707+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:17.795707+0000","last_peered":"2026-02-24T07:52:17.795707+0000","last_clean":"2026-02-24T07:52:17.795707+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:17.795707+0000","last_undegraded":"2026-02-24T07:52:17.795707+0000","last_fullsized":"2026-02-24T07:52:17.795707+0000","mapping_epoch":57,"log_start":"61'28752","ondisk_log_start":"61'28752","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235601920,"num_objects":3595,"num_object_clones":0,"num_object_copies":10785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28760,"num_write_kb":230080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'27179","reported_seq":27188,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949885+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:17.949885+0000","last_peered":"2026-02-24T07:52:17.949885+0000","last_clean":"2026-02-24T07:52:17.949885+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:17.949885+0000","last_undegraded":"2026-02-24T07:52:17.949885+0000","last_fullsized":"2026-02-24T07:52:17.949885+0000","mapping_epoch":57,"log_start":"61'27169","ondisk_log_start":"61'27169","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222650368,"num_objects":3398,"num_object_clones":0,"num_object_copies":10194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27179,"num_write_kb":217432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'27624","reported_seq":27628,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.806982+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:17.806982+0000","last_peered":"2026-02-24T07:52:17.806982+0000","last_clean":"2026-02-24T07:52:17.806982+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:17.806982+0000","last_undegraded":"2026-02-24T07:52:17.806982+0000","last_fullsized":"2026-02-24T07:52:17.806982+0000","mapping_epoch":57,"log_start":"61'27608","ondisk_log_start":"61'27608","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226295808,"num_objects":3453,"num_object_clones":0,"num_object_copies":10359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27624,"num_write_kb":220992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'27112","reported_seq":27108,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949627+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:17.949627+0000","last_peered":"2026-02-24T07:52:17.949627+0000","last_clean":"2026-02-24T07:52:17.949627+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:17.949627+0000","last_undegraded":"2026-02-24T07:52:17.949627+0000","last_fullsized":"2026-02-24T07:52:17.949627+0000","mapping_epoch":57,"log_start":"61'27080","ondisk_log_start":"61'27080","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222101504,"num_objects":3389,"num_object_clones":0,"num_object_copies":10167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27112,"num_write_kb":216896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'28328","reported_seq":28346,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.794891+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:17.794891+0000","last_peered":"2026-02-24T07:52:17.794891+0000","last_clean":"2026-02-24T07:52:17.794891+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:17.794891+0000","last_undegraded":"2026-02-24T07:52:17.794891+0000","last_fullsized":"2026-02-24T07:52:17.794891+0000","mapping_epoch":57,"log_start":"61'28292","ondisk_log_start":"61'28292","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":3000,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232062976,"num_objects":3541,"num_object_clones":0,"num_object_copies":10623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28328,"num_write_kb":226624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'27664","reported_seq":27678,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.807431+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:17.807431+0000","last_peered":"2026-02-24T07:52:17.807431+0000","last_clean":"2026-02-24T07:52:17.807431+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:17.807431+0000","last_undegraded":"2026-02-24T07:52:17.807431+0000","last_fullsized":"2026-02-24T07:52:17.807431+0000","mapping_epoch":57,"log_start":"61'27656","ondisk_log_start":"61'27656","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226623488,"num_objects":3458,"num_object_clones":0,"num_object_copies":10374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27664,"num_write_kb":221312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'27560","reported_seq":27566,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.804353+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:17.804353+0000","last_peered":"2026-02-24T07:52:17.804353+0000","last_clean":"2026-02-24T07:52:17.804353+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:17.804353+0000","last_undegraded":"2026-02-24T07:52:17.804353+0000","last_fullsized":"2026-02-24T07:52:17.804353+0000","mapping_epoch":57,"log_start":"61'27544","ondisk_log_start":"61'27544","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225771520,"num_objects":3445,"num_object_clones":0,"num_object_copies":10335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27560,"num_write_kb":220480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":3651026944,"num_objects":55711,"num_object_clones":0,"num_object_copies":167133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445682,"num_write_kb":3565456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10952335360,"data_stored":10952335360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":239,"ondisk_log_size":239,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4033516,"kb_used_data":2622872,"kb_used_omap":6,"kb_used_meta":1410617,"kb_avail":729969684,"statfs":{"total":751619276800,"available":747488956416,"internally_reserved":0,"allocated":2685820928,"data_stored":2685406775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6149,"internal_metadata":1444472827},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,10,5,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3977372,"kb_used_data":3072384,"kb_used_omap":5,"kb_used_meta":904954,"kb_avail":730025828,"statfs":{"total":751619276800,"available":747546447872,"internally_reserved":0,"allocated":3146121216,"data_stored":3145707063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6123,"internal_metadata":926672917},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3357448,"kb_used_data":2219060,"kb_used_omap":11,"kb_used_meta":1138356,"kb_avail":730645752,"statfs":{"total":751619276800,"available":748181250048,"internally_reserved":0,"allocated":2272317440,"data_stored":2271906839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1165676562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,15,8,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4093356,"kb_used_data":2642456,"kb_used_omap":12,"kb_used_meta":1450867,"kb_avail":729909844,"statfs":{"total":751619276800,"available":747427680256,"internally_reserved":0,"allocated":2705874944,"data_stored":2705460791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1485688191},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,3,38,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2729025536,"data_stored":2729025536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2291048448,"data_stored":2291048448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3204186112,"data_stored":3204186112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2728075264,"data_stored":2728075264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:23.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:23.236 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:23.364 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:23.362+0000 7ff8c4f70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:23.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:23.362+0000 7ff8c4f70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:23.526 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:23.527 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:23.580 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-24T07:52:21.909133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3651617312,"num_objects":55713,"num_object_clones":0,"num_object_copies":167139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55713,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":445817,"num_write_kb":3567606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242,"ondisk_log_size":242,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15461692,"kb_used_data":10556772,"kb_used_omap":36,"kb_used_meta":4904795,"kb_avail":2920551108,"statfs":{"total":3006477107200,"available":2990644334592,"internally_reserved":0,"allocated":10810134528,"data_stored":10808481468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37471,"internal_metadata":5022510497},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,12,23,59,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":414556160,"num_objects":6326,"num_object_clones":0,"num_object_copies":18978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50605,"num_write_kb":404840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125379"},"pg_stats":[{"pgid":"4.f","version":"61'28304","reported_seq":28314,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949900+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:17.949900+0000","last_peered":"2026-02-24T07:52:17.949900+0000","last_clean":"2026-02-24T07:52:17.949900+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:17.949900+0000","last_undegraded":"2026-02-24T07:52:17.949900+0000","last_fullsized":"2026-02-24T07:52:17.949900+0000","mapping_epoch":57,"log_start":"61'28288","ondisk_log_start":"61'28288","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231866368,"num_objects":3538,"num_object_clones":0,"num_object_copies":10614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28304,"num_write_kb":226432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'28920","reported_seq":28938,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.788135+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:17.788135+0000","last_peered":"2026-02-24T07:52:17.788135+0000","last_clean":"2026-02-24T07:52:17.788135+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:17.788135+0000","last_undegraded":"2026-02-24T07:52:17.788135+0000","last_fullsized":"2026-02-24T07:52:17.788135+0000","mapping_epoch":57,"log_start":"61'28912","ondisk_log_start":"61'28912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236912640,"num_objects":3615,"num_object_clones":0,"num_object_copies":10845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28920,"num_write_kb":231360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'26888","reported_seq":26906,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.797464+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:17.797464+0000","last_peered":"2026-02-24T07:52:17.797464+0000","last_clean":"2026-02-24T07:52:17.797464+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:17.797464+0000","last_undegraded":"2026-02-24T07:52:17.797464+0000","last_fullsized":"2026-02-24T07:52:17.797464+0000","mapping_epoch":57,"log_start":"61'26880","ondisk_log_start":"61'26880","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220266496,"num_objects":3361,"num_object_clones":0,"num_object_copies":10083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26888,"num_write_kb":215104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'27936","reported_seq":27954,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.782616+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:17.782616+0000","last_peered":"2026-02-24T07:52:17.782616+0000","last_clean":"2026-02-24T07:52:17.782616+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:17.782616+0000","last_undegraded":"2026-02-24T07:52:17.782616+0000","last_fullsized":"2026-02-24T07:52:17.782616+0000","mapping_epoch":57,"log_start":"61'27913","ondisk_log_start":"61'27913","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228851712,"num_objects":3492,"num_object_clones":0,"num_object_copies":10476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27936,"num_write_kb":223488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'28152","reported_seq":28170,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.796970+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:17.796970+0000","last_peered":"2026-02-24T07:52:17.796970+0000","last_clean":"2026-02-24T07:52:17.796970+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:17.796970+0000","last_undegraded":"2026-02-24T07:52:17.796970+0000","last_fullsized":"2026-02-24T07:52:17.796970+0000","mapping_epoch":57,"log_start":"61'28136","ondisk_log_start":"61'28136","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230621184,"num_objects":3519,"num_object_clones":0,"num_object_copies":10557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28152,"num_write_kb":225216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'27143","reported_seq":27154,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.796127+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:17.796127+0000","last_peered":"2026-02-24T07:52:17.796127+0000","last_clean":"2026-02-24T07:52:17.796127+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:17.796127+0000","last_undegraded":"2026-02-24T07:52:17.796127+0000","last_fullsized":"2026-02-24T07:52:17.796127+0000","mapping_epoch":57,"log_start":"61'27128","ondisk_log_start":"61'27128","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222355456,"num_objects":3393,"num_object_clones":0,"num_object_copies":10179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27143,"num_write_kb":217144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'28072","reported_seq":28077,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.795630+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:17.795630+0000","last_peered":"2026-02-24T07:52:17.795630+0000","last_clean":"2026-02-24T07:52:17.795630+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:17.795630+0000","last_undegraded":"2026-02-24T07:52:17.795630+0000","last_fullsized":"2026-02-24T07:52:17.795630+0000","mapping_epoch":57,"log_start":"61'28056","ondisk_log_start":"61'28056","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229965824,"num_objects":3509,"num_object_clones":0,"num_object_copies":10527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28072,"num_write_kb":224576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'28680","reported_seq":28698,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.784698+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:17.784698+0000","last_peered":"2026-02-24T07:52:17.784698+0000","last_clean":"2026-02-24T07:52:17.784698+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:17.784698+0000","last_undegraded":"2026-02-24T07:52:17.784698+0000","last_fullsized":"2026-02-24T07:52:17.784698+0000","mapping_epoch":57,"log_start":"61'28672","ondisk_log_start":"61'28672","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234946560,"num_objects":3585,"num_object_clones":0,"num_object_copies":10755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28680,"num_write_kb":229440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'27360","reported_seq":27378,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.914324+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:17.914324+0000","last_peered":"2026-02-24T07:52:17.914324+0000","last_clean":"2026-02-24T07:52:17.914324+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:17.914324+0000","last_undegraded":"2026-02-24T07:52:17.914324+0000","last_fullsized":"2026-02-24T07:52:17.914324+0000","mapping_epoch":57,"log_start":"61'27357","ondisk_log_start":"61'27357","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224133120,"num_objects":3420,"num_object_clones":0,"num_object_copies":10260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27360,"num_write_kb":218880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'28760","reported_seq":28778,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.795707+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:17.795707+0000","last_peered":"2026-02-24T07:52:17.795707+0000","last_clean":"2026-02-24T07:52:17.795707+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:17.795707+0000","last_undegraded":"2026-02-24T07:52:17.795707+0000","last_fullsized":"2026-02-24T07:52:17.795707+0000","mapping_epoch":57,"log_start":"61'28752","ondisk_log_start":"61'28752","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235601920,"num_objects":3595,"num_object_clones":0,"num_object_copies":10785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28760,"num_write_kb":230080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'27179","reported_seq":27188,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949885+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:17.949885+0000","last_peered":"2026-02-24T07:52:17.949885+0000","last_clean":"2026-02-24T07:52:17.949885+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:17.949885+0000","last_undegraded":"2026-02-24T07:52:17.949885+0000","last_fullsized":"2026-02-24T07:52:17.949885+0000","mapping_epoch":57,"log_start":"61'27169","ondisk_log_start":"61'27169","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222650368,"num_objects":3398,"num_object_clones":0,"num_object_copies":10194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27179,"num_write_kb":217432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'27624","reported_seq":27628,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.806982+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:17.806982+0000","last_peered":"2026-02-24T07:52:17.806982+0000","last_clean":"2026-02-24T07:52:17.806982+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:17.806982+0000","last_undegraded":"2026-02-24T07:52:17.806982+0000","last_fullsized":"2026-02-24T07:52:17.806982+0000","mapping_epoch":57,"log_start":"61'27608","ondisk_log_start":"61'27608","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226295808,"num_objects":3453,"num_object_clones":0,"num_object_copies":10359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27624,"num_write_kb":220992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'27112","reported_seq":27108,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.949627+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:17.949627+0000","last_peered":"2026-02-24T07:52:17.949627+0000","last_clean":"2026-02-24T07:52:17.949627+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:17.949627+0000","last_undegraded":"2026-02-24T07:52:17.949627+0000","last_fullsized":"2026-02-24T07:52:17.949627+0000","mapping_epoch":57,"log_start":"61'27080","ondisk_log_start":"61'27080","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222101504,"num_objects":3389,"num_object_clones":0,"num_object_copies":10167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27112,"num_write_kb":216896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'28328","reported_seq":28346,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.794891+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:17.794891+0000","last_peered":"2026-02-24T07:52:17.794891+0000","last_clean":"2026-02-24T07:52:17.794891+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:17.794891+0000","last_undegraded":"2026-02-24T07:52:17.794891+0000","last_fullsized":"2026-02-24T07:52:17.794891+0000","mapping_epoch":57,"log_start":"61'28292","ondisk_log_start":"61'28292","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":3000,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232062976,"num_objects":3541,"num_object_clones":0,"num_object_copies":10623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28328,"num_write_kb":226624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'27664","reported_seq":27678,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.807431+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:17.807431+0000","last_peered":"2026-02-24T07:52:17.807431+0000","last_clean":"2026-02-24T07:52:17.807431+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:17.807431+0000","last_undegraded":"2026-02-24T07:52:17.807431+0000","last_fullsized":"2026-02-24T07:52:17.807431+0000","mapping_epoch":57,"log_start":"61'27656","ondisk_log_start":"61'27656","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226623488,"num_objects":3458,"num_object_clones":0,"num_object_copies":10374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27664,"num_write_kb":221312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'27560","reported_seq":27566,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:52:17.804353+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:17.804353+0000","last_peered":"2026-02-24T07:52:17.804353+0000","last_clean":"2026-02-24T07:52:17.804353+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:17.804353+0000","last_undegraded":"2026-02-24T07:52:17.804353+0000","last_fullsized":"2026-02-24T07:52:17.804353+0000","mapping_epoch":57,"log_start":"61'27544","ondisk_log_start":"61'27544","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225771520,"num_objects":3445,"num_object_clones":0,"num_object_copies":10335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27560,"num_write_kb":220480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":286,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T07:51:44.872958+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:51:44.872958+0000","last_peered":"2026-02-24T07:51:44.872958+0000","last_clean":"2026-02-24T07:51:44.872958+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:51:44.872958+0000","last_undegraded":"2026-02-24T07:51:44.872958+0000","last_fullsized":"2026-02-24T07:51:44.872958+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":3651026944,"num_objects":55711,"num_object_clones":0,"num_object_copies":167133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445682,"num_write_kb":3565456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10952335360,"data_stored":10952335360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":239,"ondisk_log_size":239,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4033516,"kb_used_data":2622872,"kb_used_omap":6,"kb_used_meta":1410617,"kb_avail":729969684,"statfs":{"total":751619276800,"available":747488956416,"internally_reserved":0,"allocated":2685820928,"data_stored":2685406775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6149,"internal_metadata":1444472827},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,10,5,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3977372,"kb_used_data":3072384,"kb_used_omap":5,"kb_used_meta":904954,"kb_avail":730025828,"statfs":{"total":751619276800,"available":747546447872,"internally_reserved":0,"allocated":3146121216,"data_stored":3145707063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6123,"internal_metadata":926672917},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3357448,"kb_used_data":2219060,"kb_used_omap":11,"kb_used_meta":1138356,"kb_avail":730645752,"statfs":{"total":751619276800,"available":748181250048,"internally_reserved":0,"allocated":2272317440,"data_stored":2271906839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12270,"internal_metadata":1165676562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,15,8,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4093356,"kb_used_data":2642456,"kb_used_omap":12,"kb_used_meta":1450867,"kb_avail":729909844,"statfs":{"total":751619276800,"available":747427680256,"internally_reserved":0,"allocated":2705874944,"data_stored":2705460791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12929,"internal_metadata":1485688191},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,3,38,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2729025536,"data_stored":2729025536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2291048448,"data_stored":2291048448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3204186112,"data_stored":3204186112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2728075264,"data_stored":2728075264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:23.582 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:52:23.583 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:23.583 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:52:23.583 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:23.729 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:23.859 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:23.856+0000 7f2f69173640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:23.859 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:23.857+0000 7f2f69173640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:23.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 128 509414 509286 81.1937 81.2734 0.0137535 0.0123129 2026-02-24T07:52:24.028 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:24.028 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:24.039 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:23 trial016 ceph-mon[39544]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:24.077 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2026-02-24T07:52:23.784572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4079649312,"num_objects":62244,"num_object_clones":0,"num_object_copies":186732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62244,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":498067,"num_write_kb":3985606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":17082284,"kb_used_data":11825052,"kb_used_omap":46,"kb_used_meta":5257105,"kb_avail":2918930516,"statfs":{"total":3006477107200,"available":2988984848384,"internally_reserved":0,"allocated":12108853248,"data_stored":12107074124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47903,"internal_metadata":5383275745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,4,0,5,8,4,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":428032000,"num_objects":6531,"num_object_clones":0,"num_object_copies":19593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52250,"num_write_kb":418000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.881704"},"pg_stats":[{"pgid":"4.f","version":"65'31408","reported_seq":31434,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.914254+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:22.914254+0000","last_peered":"2026-02-24T07:52:22.914254+0000","last_clean":"2026-02-24T07:52:22.914254+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:22.914254+0000","last_undegraded":"2026-02-24T07:52:22.914254+0000","last_fullsized":"2026-02-24T07:52:22.914254+0000","mapping_epoch":57,"log_start":"65'31400","ondisk_log_start":"65'31400","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257294336,"num_objects":3926,"num_object_clones":0,"num_object_copies":11778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31408,"num_write_kb":251264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'31752","reported_seq":31778,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.796997+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:22.796997+0000","last_peered":"2026-02-24T07:52:22.796997+0000","last_clean":"2026-02-24T07:52:22.796997+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:22.796997+0000","last_undegraded":"2026-02-24T07:52:22.796997+0000","last_fullsized":"2026-02-24T07:52:22.796997+0000","mapping_epoch":57,"log_start":"65'31747","ondisk_log_start":"65'31747","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260112384,"num_objects":3969,"num_object_clones":0,"num_object_copies":11907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3969,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31752,"num_write_kb":254016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'30560","reported_seq":30586,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.805530+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:22.805530+0000","last_peered":"2026-02-24T07:52:22.805530+0000","last_clean":"2026-02-24T07:52:22.805530+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:22.805530+0000","last_undegraded":"2026-02-24T07:52:22.805530+0000","last_fullsized":"2026-02-24T07:52:22.805530+0000","mapping_epoch":57,"log_start":"65'30555","ondisk_log_start":"65'30555","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250347520,"num_objects":3820,"num_object_clones":0,"num_object_copies":11460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30560,"num_write_kb":244480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'31128","reported_seq":31154,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.765418+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:22.765418+0000","last_peered":"2026-02-24T07:52:22.765418+0000","last_clean":"2026-02-24T07:52:22.765418+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:22.765418+0000","last_undegraded":"2026-02-24T07:52:22.765418+0000","last_fullsized":"2026-02-24T07:52:22.765418+0000","mapping_epoch":57,"log_start":"65'31120","ondisk_log_start":"65'31120","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255000576,"num_objects":3891,"num_object_clones":0,"num_object_copies":11673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31128,"num_write_kb":249024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'31216","reported_seq":31237,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.806577+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:22.806577+0000","last_peered":"2026-02-24T07:52:22.806577+0000","last_clean":"2026-02-24T07:52:22.806577+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:22.806577+0000","last_undegraded":"2026-02-24T07:52:22.806577+0000","last_fullsized":"2026-02-24T07:52:22.806577+0000","mapping_epoch":57,"log_start":"65'31208","ondisk_log_start":"65'31208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255721472,"num_objects":3902,"num_object_clones":0,"num_object_copies":11706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31216,"num_write_kb":249728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'30536","reported_seq":30562,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.784724+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:22.784724+0000","last_peered":"2026-02-24T07:52:22.784724+0000","last_clean":"2026-02-24T07:52:22.784724+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:22.784724+0000","last_undegraded":"2026-02-24T07:52:22.784724+0000","last_fullsized":"2026-02-24T07:52:22.784724+0000","mapping_epoch":57,"log_start":"65'30532","ondisk_log_start":"65'30532","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250150912,"num_objects":3817,"num_object_clones":0,"num_object_copies":11451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30536,"num_write_kb":244288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'31432","reported_seq":31458,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.791646+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:22.791646+0000","last_peered":"2026-02-24T07:52:22.791646+0000","last_clean":"2026-02-24T07:52:22.791646+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:22.791646+0000","last_undegraded":"2026-02-24T07:52:22.791646+0000","last_fullsized":"2026-02-24T07:52:22.791646+0000","mapping_epoch":57,"log_start":"65'31416","ondisk_log_start":"65'31416","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257490944,"num_objects":3929,"num_object_clones":0,"num_object_copies":11787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31432,"num_write_kb":251456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'31956","reported_seq":31970,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.800296+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:22.800296+0000","last_peered":"2026-02-24T07:52:22.800296+0000","last_clean":"2026-02-24T07:52:22.800296+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:22.800296+0000","last_undegraded":"2026-02-24T07:52:22.800296+0000","last_fullsized":"2026-02-24T07:52:22.800296+0000","mapping_epoch":57,"log_start":"65'31943","ondisk_log_start":"65'31943","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261783552,"num_objects":3995,"num_object_clones":0,"num_object_copies":11985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31956,"num_write_kb":255648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'30608","reported_seq":30634,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.950552+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:22.950552+0000","last_peered":"2026-02-24T07:52:22.950552+0000","last_clean":"2026-02-24T07:52:22.950552+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:22.950552+0000","last_undegraded":"2026-02-24T07:52:22.950552+0000","last_fullsized":"2026-02-24T07:52:22.950552+0000","mapping_epoch":57,"log_start":"65'30605","ondisk_log_start":"65'30605","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250740736,"num_objects":3826,"num_object_clones":0,"num_object_copies":11478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":244864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'32128","reported_seq":32154,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.802613+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:22.802613+0000","last_peered":"2026-02-24T07:52:22.802613+0000","last_clean":"2026-02-24T07:52:22.802613+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:22.802613+0000","last_undegraded":"2026-02-24T07:52:22.802613+0000","last_fullsized":"2026-02-24T07:52:22.802613+0000","mapping_epoch":57,"log_start":"65'32112","ondisk_log_start":"65'32112","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":4016,"num_object_clones":0,"num_object_copies":12048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4016,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32128,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'30536","reported_seq":30558,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.951101+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:22.951101+0000","last_peered":"2026-02-24T07:52:22.951101+0000","last_clean":"2026-02-24T07:52:22.951101+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:22.951101+0000","last_undegraded":"2026-02-24T07:52:22.951101+0000","last_fullsized":"2026-02-24T07:52:22.951101+0000","mapping_epoch":57,"log_start":"65'30529","ondisk_log_start":"65'30529","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250150912,"num_objects":3817,"num_object_clones":0,"num_object_copies":11451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30536,"num_write_kb":244288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'30968","reported_seq":30988,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.808938+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:22.808938+0000","last_peered":"2026-02-24T07:52:22.808938+0000","last_clean":"2026-02-24T07:52:22.808938+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:22.808938+0000","last_undegraded":"2026-02-24T07:52:22.808938+0000","last_fullsized":"2026-02-24T07:52:22.808938+0000","mapping_epoch":57,"log_start":"65'30960","ondisk_log_start":"65'30960","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253689856,"num_objects":3871,"num_object_clones":0,"num_object_copies":11613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30968,"num_write_kb":247744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'30376","reported_seq":30402,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.936592+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:22.936592+0000","last_peered":"2026-02-24T07:52:22.936592+0000","last_clean":"2026-02-24T07:52:22.936592+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:22.936592+0000","last_undegraded":"2026-02-24T07:52:22.936592+0000","last_fullsized":"2026-02-24T07:52:22.936592+0000","mapping_epoch":57,"log_start":"65'30367","ondisk_log_start":"65'30367","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248840192,"num_objects":3797,"num_object_clones":0,"num_object_copies":11391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30376,"num_write_kb":243008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'31568","reported_seq":31594,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.766073+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:22.766073+0000","last_peered":"2026-02-24T07:52:22.766073+0000","last_clean":"2026-02-24T07:52:22.766073+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:22.766073+0000","last_undegraded":"2026-02-24T07:52:22.766073+0000","last_fullsized":"2026-02-24T07:52:22.766073+0000","mapping_epoch":57,"log_start":"65'31558","ondisk_log_start":"65'31558","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258605056,"num_objects":3946,"num_object_clones":0,"num_object_copies":11838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31568,"num_write_kb":252544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'30920","reported_seq":30946,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.795495+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:22.795495+0000","last_peered":"2026-02-24T07:52:22.795495+0000","last_clean":"2026-02-24T07:52:22.795495+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:22.795495+0000","last_undegraded":"2026-02-24T07:52:22.795495+0000","last_fullsized":"2026-02-24T07:52:22.795495+0000","mapping_epoch":57,"log_start":"65'30912","ondisk_log_start":"65'30912","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253296640,"num_objects":3865,"num_object_clones":0,"num_object_copies":11595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30920,"num_write_kb":247360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'30840","reported_seq":30866,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:22.782460+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:22.782460+0000","last_peered":"2026-02-24T07:52:22.782460+0000","last_clean":"2026-02-24T07:52:22.782460+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:22.782460+0000","last_undegraded":"2026-02-24T07:52:22.782460+0000","last_fullsized":"2026-02-24T07:52:22.782460+0000","mapping_epoch":57,"log_start":"65'30832","ondisk_log_start":"65'30832","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252641280,"num_objects":3855,"num_object_clones":0,"num_object_copies":11565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30840,"num_write_kb":246720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":294,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:21.912057+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:52:21.912057+0000","last_peered":"2026-02-24T07:52:21.912057+0000","last_clean":"2026-02-24T07:52:21.912057+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:21.912057+0000","last_undegraded":"2026-02-24T07:52:21.912057+0000","last_fullsized":"2026-02-24T07:52:21.912057+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":4079058944,"num_objects":62242,"num_object_clones":0,"num_object_copies":186726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497932,"num_write_kb":3983456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12235882496,"data_stored":12235882496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215174,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4435532,"kb_used_data":2934648,"kb_used_omap":8,"kb_used_meta":1500855,"kb_avail":729567668,"statfs":{"total":751619276800,"available":747077292032,"internally_reserved":0,"allocated":3005079552,"data_stored":3004633883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8757,"internal_metadata":1536875979},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,0,5,8,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4476484,"kb_used_data":3445168,"kb_used_omap":8,"kb_used_meta":1031287,"kb_avail":729526716,"statfs":{"total":751619276800,"available":747035357184,"internally_reserved":0,"allocated":3527852032,"data_stored":3527406363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8731,"internal_metadata":1056038373},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3689832,"kb_used_data":2479252,"kb_used_omap":14,"kb_used_meta":1210545,"kb_avail":730313368,"statfs":{"total":751619276800,"available":747840888832,"internally_reserved":0,"allocated":2538754048,"data_stored":2538311931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14878,"internal_metadata":1239598562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4480436,"kb_used_data":2965984,"kb_used_omap":15,"kb_used_meta":1514416,"kb_avail":729522764,"statfs":{"total":751619276800,"available":747031310336,"internally_reserved":0,"allocated":3037167616,"data_stored":3036721947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15537,"internal_metadata":1550762831},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,0,0,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3054854144,"data_stored":3054854144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2552823808,"data_stored":2552823808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3578388480,"data_stored":3578388480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3049816064,"data_stored":3049816064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:24.079 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:52:24.079 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 121 2026-02-24T07:52:24.238 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:24.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:24.363+0000 7f3d868dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:24.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:24.363+0000 7f3d868dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:24.522 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:52:24.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:24.919 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:24.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 520101 519973 81.2395 83.4922 0.016874 0.0123067 2026-02-24T07:52:25.074 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:25.193 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:24 trial016 ceph-mon[39544]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:25.193 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:24 trial016 ceph-mon[39544]: pgmap v208: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.70k op/s 2026-02-24T07:52:25.193 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3131863409' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "121"} : dispatch 2026-02-24T07:52:25.193 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:25.203 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:25.201+0000 7f8720845640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:25.204 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:25.201+0000 7f8720845640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:25.223 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:25.223 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:25.242 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:25.242 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:25.266 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:25.267 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:25.297 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:25.297 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:25.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 530466 530338 81.2342 80.9766 0.0053123 0.0123074 2026-02-24T07:52:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:25 trial016 ceph-mon[39544]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2731522720' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:26.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 541151 541023 81.2772 83.4766 0.00890988 0.0123008 2026-02-24T07:52:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:26 trial016 ceph-mon[39544]: pgmap v209: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.71k op/s 2026-02-24T07:52:27.344 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:27.500 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:27.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:27.618+0000 7fa065e5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:27.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:27.619+0000 7fa065e5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:27.637 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:27.637 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:27.660 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:27.660 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:27.677 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:27.677 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:27.697 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:27.697 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:27.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 127 551841 551714 81.3195 83.5234 0.0101255 0.0122948 2026-02-24T07:52:28.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1551397398' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:28.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 128 562801 562673 81.399 85.6172 0.0104805 0.0122826 2026-02-24T07:52:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:28 trial016 ceph-mon[39544]: pgmap v210: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.63k op/s 2026-02-24T07:52:29.567 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:29.567 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:29.567 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-24T07:52:29.568 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:29.724 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:29.746 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:29.852 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:29.850+0000 7fa92257d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:29.852 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:29.850+0000 7fa92257d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:29.909 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:29.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 574103 573975 81.5242 88.2969 0.0262884 0.0122632 2026-02-24T07:52:30.009 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:30.009 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:30.042 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:30.040+0000 7f7b7556d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:30.043 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:30.040+0000 7f7b7556d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:30.061 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:30.061 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:30.062 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2026-02-24T07:52:29.785322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4512162336,"num_objects":68845,"num_object_clones":0,"num_object_copies":206535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68845,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":550864,"num_write_kb":4407982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18465596,"kb_used_data":13062180,"kb_used_omap":46,"kb_used_meta":5403281,"kb_avail":2917547204,"statfs":{"total":3006477107200,"available":2987568336896,"internally_reserved":0,"allocated":13375672320,"data_stored":13373893196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47903,"internal_metadata":5532959969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,7,17,22,26,2,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":860545024,"num_objects":13132,"num_object_clones":0,"num_object_copies":39396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105047,"num_write_kb":840376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.878778"},"pg_stats":[{"pgid":"4.f","version":"65'34848","reported_seq":34866,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.953118+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:27.953118+0000","last_peered":"2026-02-24T07:52:27.953118+0000","last_clean":"2026-02-24T07:52:27.953118+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:27.953118+0000","last_undegraded":"2026-02-24T07:52:27.953118+0000","last_fullsized":"2026-02-24T07:52:27.953118+0000","mapping_epoch":57,"log_start":"65'34833","ondisk_log_start":"65'34833","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285474816,"num_objects":4356,"num_object_clones":0,"num_object_copies":13068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34848,"num_write_kb":278784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'35248","reported_seq":35274,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.786896+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:27.786896+0000","last_peered":"2026-02-24T07:52:27.786896+0000","last_clean":"2026-02-24T07:52:27.786896+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:27.786896+0000","last_undegraded":"2026-02-24T07:52:27.786896+0000","last_fullsized":"2026-02-24T07:52:27.786896+0000","mapping_epoch":57,"log_start":"65'35232","ondisk_log_start":"65'35232","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288751616,"num_objects":4406,"num_object_clones":0,"num_object_copies":13218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35248,"num_write_kb":281984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'33774","reported_seq":33794,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.802456+0000","last_change":"2026-02-24T07:51:33.854134+0000","last_active":"2026-02-24T07:52:27.802456+0000","last_peered":"2026-02-24T07:52:27.802456+0000","last_clean":"2026-02-24T07:52:27.802456+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:27.802456+0000","last_undegraded":"2026-02-24T07:52:27.802456+0000","last_fullsized":"2026-02-24T07:52:27.802456+0000","mapping_epoch":57,"log_start":"65'33760","ondisk_log_start":"65'33760","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.674905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276676608,"num_objects":4222,"num_object_clones":0,"num_object_copies":12666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33774,"num_write_kb":270192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'34400","reported_seq":34426,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.796787+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:27.796787+0000","last_peered":"2026-02-24T07:52:27.796787+0000","last_clean":"2026-02-24T07:52:27.796787+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:27.796787+0000","last_undegraded":"2026-02-24T07:52:27.796787+0000","last_fullsized":"2026-02-24T07:52:27.796787+0000","mapping_epoch":57,"log_start":"65'34384","ondisk_log_start":"65'34384","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281804800,"num_objects":4300,"num_object_clones":0,"num_object_copies":12900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34400,"num_write_kb":275200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'34615","reported_seq":34636,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.806113+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:27.806113+0000","last_peered":"2026-02-24T07:52:27.806113+0000","last_clean":"2026-02-24T07:52:27.806113+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:27.806113+0000","last_undegraded":"2026-02-24T07:52:27.806113+0000","last_fullsized":"2026-02-24T07:52:27.806113+0000","mapping_epoch":57,"log_start":"65'34605","ondisk_log_start":"65'34605","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283566080,"num_objects":4327,"num_object_clones":0,"num_object_copies":12981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34615,"num_write_kb":276920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'33968","reported_seq":33994,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.770280+0000","last_change":"2026-02-24T07:51:33.852347+0000","last_active":"2026-02-24T07:52:27.770280+0000","last_peered":"2026-02-24T07:52:27.770280+0000","last_clean":"2026-02-24T07:52:27.770280+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:27.770280+0000","last_undegraded":"2026-02-24T07:52:27.770280+0000","last_fullsized":"2026-02-24T07:52:27.770280+0000","mapping_epoch":57,"log_start":"65'33944","ondisk_log_start":"65'33944","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:34.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278265856,"num_objects":4246,"num_object_clones":0,"num_object_copies":12738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33968,"num_write_kb":271744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'34656","reported_seq":34682,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.797890+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:27.797890+0000","last_peered":"2026-02-24T07:52:27.797890+0000","last_clean":"2026-02-24T07:52:27.797890+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:27.797890+0000","last_undegraded":"2026-02-24T07:52:27.797890+0000","last_fullsized":"2026-02-24T07:52:27.797890+0000","mapping_epoch":57,"log_start":"65'34648","ondisk_log_start":"65'34648","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283901952,"num_objects":4332,"num_object_clones":0,"num_object_copies":12996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34656,"num_write_kb":277248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'35187","reported_seq":35210,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.798306+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:27.798306+0000","last_peered":"2026-02-24T07:52:27.798306+0000","last_clean":"2026-02-24T07:52:27.798306+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:27.798306+0000","last_undegraded":"2026-02-24T07:52:27.798306+0000","last_fullsized":"2026-02-24T07:52:27.798306+0000","mapping_epoch":57,"log_start":"65'35176","ondisk_log_start":"65'35176","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288251904,"num_objects":4399,"num_object_clones":0,"num_object_copies":13197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35187,"num_write_kb":281496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'33696","reported_seq":33722,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.941213+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:27.941213+0000","last_peered":"2026-02-24T07:52:27.941213+0000","last_clean":"2026-02-24T07:52:27.941213+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:27.941213+0000","last_undegraded":"2026-02-24T07:52:27.941213+0000","last_fullsized":"2026-02-24T07:52:27.941213+0000","mapping_epoch":57,"log_start":"65'33688","ondisk_log_start":"65'33688","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276037632,"num_objects":4212,"num_object_clones":0,"num_object_copies":12636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33696,"num_write_kb":269568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'35368","reported_seq":35394,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.786759+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:27.786759+0000","last_peered":"2026-02-24T07:52:27.786759+0000","last_clean":"2026-02-24T07:52:27.786759+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:27.786759+0000","last_undegraded":"2026-02-24T07:52:27.786759+0000","last_fullsized":"2026-02-24T07:52:27.786759+0000","mapping_epoch":57,"log_start":"65'35360","ondisk_log_start":"65'35360","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289734656,"num_objects":4421,"num_object_clones":0,"num_object_copies":13263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35368,"num_write_kb":282944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'33704","reported_seq":33730,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.933015+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:27.933015+0000","last_peered":"2026-02-24T07:52:27.933015+0000","last_clean":"2026-02-24T07:52:27.933015+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:27.933015+0000","last_undegraded":"2026-02-24T07:52:27.933015+0000","last_fullsized":"2026-02-24T07:52:27.933015+0000","mapping_epoch":57,"log_start":"65'33690","ondisk_log_start":"65'33690","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276103168,"num_objects":4213,"num_object_clones":0,"num_object_copies":12639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33704,"num_write_kb":269632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'34312","reported_seq":34338,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.778033+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:27.778033+0000","last_peered":"2026-02-24T07:52:27.778033+0000","last_clean":"2026-02-24T07:52:27.778033+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:27.778033+0000","last_undegraded":"2026-02-24T07:52:27.778033+0000","last_fullsized":"2026-02-24T07:52:27.778033+0000","mapping_epoch":57,"log_start":"65'34304","ondisk_log_start":"65'34304","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281083904,"num_objects":4289,"num_object_clones":0,"num_object_copies":12867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34312,"num_write_kb":274496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'33764","reported_seq":33778,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.953035+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:27.953035+0000","last_peered":"2026-02-24T07:52:27.953035+0000","last_clean":"2026-02-24T07:52:27.953035+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:27.953035+0000","last_undegraded":"2026-02-24T07:52:27.953035+0000","last_fullsized":"2026-02-24T07:52:27.953035+0000","mapping_epoch":57,"log_start":"65'33748","ondisk_log_start":"65'33748","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276594688,"num_objects":4221,"num_object_clones":0,"num_object_copies":12663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33764,"num_write_kb":270112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'34848","reported_seq":34874,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.787718+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:27.787718+0000","last_peered":"2026-02-24T07:52:27.787718+0000","last_clean":"2026-02-24T07:52:27.787718+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:27.787718+0000","last_undegraded":"2026-02-24T07:52:27.787718+0000","last_fullsized":"2026-02-24T07:52:27.787718+0000","mapping_epoch":57,"log_start":"65'34824","ondisk_log_start":"65'34824","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285474816,"num_objects":4356,"num_object_clones":0,"num_object_copies":13068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34848,"num_write_kb":278784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'34237","reported_seq":34258,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.807441+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:27.807441+0000","last_peered":"2026-02-24T07:52:27.807441+0000","last_clean":"2026-02-24T07:52:27.807441+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:27.807441+0000","last_undegraded":"2026-02-24T07:52:27.807441+0000","last_fullsized":"2026-02-24T07:52:27.807441+0000","mapping_epoch":57,"log_start":"65'34225","ondisk_log_start":"65'34225","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280469504,"num_objects":4280,"num_object_clones":0,"num_object_copies":12840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34237,"num_write_kb":273896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'34104","reported_seq":34130,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:27.798939+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:27.798939+0000","last_peered":"2026-02-24T07:52:27.798939+0000","last_clean":"2026-02-24T07:52:27.798939+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:27.798939+0000","last_undegraded":"2026-02-24T07:52:27.798939+0000","last_fullsized":"2026-02-24T07:52:27.798939+0000","mapping_epoch":57,"log_start":"65'34088","ondisk_log_start":"65'34088","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279379968,"num_objects":4263,"num_object_clones":0,"num_object_copies":12789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34104,"num_write_kb":272832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":294,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T07:52:21.912057+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:52:21.912057+0000","last_peered":"2026-02-24T07:52:21.912057+0000","last_clean":"2026-02-24T07:52:21.912057+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:21.912057+0000","last_undegraded":"2026-02-24T07:52:21.912057+0000","last_fullsized":"2026-02-24T07:52:21.912057+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":4511571968,"num_objects":68843,"num_object_clones":0,"num_object_copies":206529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550729,"num_write_kb":4405832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13534027776,"data_stored":13534027776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215175,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4790924,"kb_used_data":3239280,"kb_used_omap":8,"kb_used_meta":1551607,"kb_avail":729212276,"statfs":{"total":751619276800,"available":746713370624,"internally_reserved":0,"allocated":3317022720,"data_stored":3316577051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8757,"internal_metadata":1588846027},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,7,14,18],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4943548,"kb_used_data":3803944,"kb_used_omap":8,"kb_used_meta":1139575,"kb_avail":729059652,"statfs":{"total":751619276800,"available":746557083648,"internally_reserved":0,"allocated":3895238656,"data_stored":3894792987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8731,"internal_metadata":1166925285},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,10,8,8,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4027552,"kb_used_data":2744780,"kb_used_omap":14,"kb_used_meta":1282737,"kb_avail":729975648,"statfs":{"total":751619276800,"available":747495063552,"internally_reserved":0,"allocated":2810654720,"data_stored":2810212603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14878,"internal_metadata":1313523170},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4703572,"kb_used_data":3274176,"kb_used_omap":15,"kb_used_meta":1429360,"kb_avail":729299628,"statfs":{"total":751619276800,"available":746802819072,"internally_reserved":0,"allocated":3352756224,"data_stored":3352310555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15537,"internal_metadata":1463665487},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,0,0,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3375644672,"data_stored":3375644672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2825084928,"data_stored":2825084928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3956965376,"data_stored":3956965376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3376332800,"data_stored":3376332800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:30.064 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 26 2026-02-24T07:52:30.079 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:30.079 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:30.095 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:30.095 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:30.111 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:30.112 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:30.216 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:30.353 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:30.350+0000 7fd779fa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:30.353 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:30.351+0000 7fd779fa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:30.506 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:52:30.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:30.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 585422 585294 81.6474 88.4297 0.00731699 0.0122446 2026-02-24T07:52:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:30 trial016 ceph-mon[39544]: pgmap v211: 17 pgs: 17 active+clean; 4.2 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 92 MiB/s wr, 11.83k op/s 2026-02-24T07:52:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1018195101' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3700226810' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T07:52:31.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 127 596353 596226 81.7133 85.4062 0.0153812 0.0122354 2026-02-24T07:52:32.166 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:32.194 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:31 trial016 ceph-mon[39544]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:32.323 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:32.444 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:32.441+0000 7ff6adf55640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:32.444 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:32.441+0000 7ff6adf55640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:32.462 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:32.463 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:32.477 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:32.477 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:32.511 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:32.511 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:32.538 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:32.538 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:32.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 607601 607474 81.8194 87.875 0.00220539 0.0122195 2026-02-24T07:52:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:32 trial016 ceph-mon[39544]: pgmap v212: 17 pgs: 17 active+clean; 4.2 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.50k op/s 2026-02-24T07:52:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1734093482' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:33.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 127 618899 618772 81.9285 88.2656 0.0224535 0.0122022 2026-02-24T07:52:34.585 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:34.740 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:34.946 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:52:34.945658+0000 min lat: 0.000567362 max lat: 0.0854784 avg lat: 0.0121985 2026-02-24T07:52:34.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:52:34.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 127 629350 629223 81.9237 81.6484 0.0319768 0.0121985 2026-02-24T07:52:35.143 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:34 trial016 ceph-mon[39544]: pgmap v213: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 106 MiB/s wr, 13.52k op/s 2026-02-24T07:52:35.144 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:35.206 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:35.140+0000 7fee71f49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:35.206 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:35.141+0000 7fee71f49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:35.207 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:35.207 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:35.207 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:35.207 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:35.213 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:35.214 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:35.228 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:35.229 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:35.550 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:35.550 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:52:35.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 637188 637060 81.5844 61.2266 0.00487212 0.0122543 2026-02-24T07:52:36.123 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:36.241 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:35 trial016 ceph-mon[39544]: 4.d scrub starts 2026-02-24T07:52:36.241 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/266325647' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:36.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:35 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:52:36.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:35 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:52:36.662 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:36.587+0000 7f67626b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:36.662 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:36.588+0000 7f67626b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:36.930 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:52:36.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 646086 645958 81.3891 69.5156 0.00717754 0.0122838 2026-02-24T07:52:37.189 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:36 trial016 ceph-mon[39544]: pgmap v214: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 9.02k op/s 2026-02-24T07:52:37.190 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:36 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:52:37.190 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:36 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:52:37.190 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4046137924' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:52:37.652 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:52:37.808 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:37.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 654461 654333 81.1357 65.4297 0.00655811 0.012322 2026-02-24T07:52:38.062 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:38.176 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:37 trial016 ceph-mon[39544]: 4.d scrub ok 2026-02-24T07:52:38.176 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:37 trial016 ceph-mon[39544]: 4.a scrub starts 2026-02-24T07:52:38.177 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4046137924' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:52:38.177 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:37 trial016 ceph-mon[39544]: osdmap e66: 4 total, 4 up, 4 in 2026-02-24T07:52:38.304 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:38.226+0000 7feb03270640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:38.304 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:38.226+0000 7feb03270640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:38.332 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:38.888 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:38.889 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:38.828+0000 7f8060e22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:38.889 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:38.828+0000 7f8060e22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:38.889 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:38.900 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:38.900 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:38.922 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:38.922 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:38.935 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:52:38.940 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:38.940 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:38.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 128 662780 662652 80.8834 64.9922 0.00887461 0.0123603 2026-02-24T07:52:39.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:38 trial016 ceph-mon[39544]: pgmap v216: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.83k op/s 2026-02-24T07:52:39.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:38 trial016 ceph-mon[39544]: 4.a scrub ok 2026-02-24T07:52:39.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3001297950' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:52:39.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1711423571' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:39.434 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:52:39.581 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:39.713 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:39.709+0000 7ff8e5e16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:39.713 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:39.710+0000 7ff8e5e16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:39.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 127 672295 672168 80.7827 74.3438 0.0133888 0.0123763 2026-02-24T07:52:40.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3001297950' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:52:40.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:39 trial016 ceph-mon[39544]: osdmap e67: 4 total, 4 up, 4 in 2026-02-24T07:52:40.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:39 trial016 ceph-mon[39544]: osdmap e68: 4 total, 4 up, 4 in 2026-02-24T07:52:40.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2493119438' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:52:40.827 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:52:40.878 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:52:40.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 683438 683310 80.8775 87.0469 0.00885621 0.0123614 2026-02-24T07:52:41.028 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:41.080 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:40 trial016 ceph-mon[39544]: pgmap v218: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 100 MiB/s wr, 12.84k op/s 2026-02-24T07:52:41.080 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:40 trial016 ceph-mon[39544]: 4.5 scrub starts 2026-02-24T07:52:41.080 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2493119438' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:52:41.080 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:40 trial016 ceph-mon[39544]: osdmap e69: 4 total, 4 up, 4 in 2026-02-24T07:52:41.155 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:41.151+0000 7f20e38ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:41.155 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:41.152+0000 7f20e38ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:41.523 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:41.674 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:41.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:41.804+0000 7fa949a36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:41.809 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:41.805+0000 7fa949a36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:41.829 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:41.829 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:41.849 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:41.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:41.868 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:41.869 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:41.886 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:41.886 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:41.941 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:52:41.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 128 694241 694113 80.93 84.3984 0.00536671 0.0123542 2026-02-24T07:52:41.991 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:52:41.991 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:42.058 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:41 trial016 ceph-mon[39544]: 4.5 scrub ok 2026-02-24T07:52:42.059 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3767946892' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:52:42.059 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1690562613' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:42.180 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:42.304 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:42.300+0000 7f5df1c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:42.304 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:42.300+0000 7f5df1c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:42.453 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:42.453 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:42.506 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2026-02-24T07:52:41.940216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5353611808,"num_objects":81684,"num_object_clones":0,"num_object_copies":245052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81684,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":653580,"num_write_kb":5229710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20917708,"kb_used_data":15551932,"kb_used_omap":48,"kb_used_meta":5365647,"kb_avail":2915095092,"statfs":{"total":3006477107200,"available":2985057374208,"internally_reserved":0,"allocated":15925178368,"data_stored":15923383486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49207,"internal_metadata":5494423497},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,0,7,32,11,16,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":386891776,"num_objects":5902,"num_object_clones":0,"num_object_copies":17706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47228,"num_write_kb":377824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.153730"},"pg_stats":[{"pgid":"4.f","version":"66'41344","reported_seq":41372,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.943057+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:37.943057+0000","last_peered":"2026-02-24T07:52:37.943057+0000","last_clean":"2026-02-24T07:52:37.943057+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:37.943057+0000","last_undegraded":"2026-02-24T07:52:37.943057+0000","last_fullsized":"2026-02-24T07:52:37.943057+0000","mapping_epoch":57,"log_start":"66'41334","ondisk_log_start":"66'41334","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338690048,"num_objects":5168,"num_object_clones":0,"num_object_copies":15504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41344,"num_write_kb":330752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'41592","reported_seq":41615,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.794112+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:37.794112+0000","last_peered":"2026-02-24T07:52:37.794112+0000","last_clean":"2026-02-24T07:52:37.794112+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:37.794112+0000","last_undegraded":"2026-02-24T07:52:37.794112+0000","last_fullsized":"2026-02-24T07:52:37.794112+0000","mapping_epoch":57,"log_start":"66'41584","ondisk_log_start":"66'41584","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":15597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41592,"num_write_kb":332736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"66'40241","reported_seq":40325,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800517+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:52:37.800517+0000","last_peered":"2026-02-24T07:52:37.800517+0000","last_clean":"2026-02-24T07:52:37.800517+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:37.800517+0000","last_undegraded":"2026-02-24T07:52:37.800517+0000","last_fullsized":"2026-02-24T07:52:37.800517+0000","mapping_epoch":57,"log_start":"66'40238","ondisk_log_start":"66'40238","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329654272,"num_objects":5031,"num_object_clones":0,"num_object_copies":15093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40241,"num_write_kb":321928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"66'40712","reported_seq":40740,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800114+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:37.800114+0000","last_peered":"2026-02-24T07:52:37.800114+0000","last_clean":"2026-02-24T07:52:37.800114+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:37.800114+0000","last_undegraded":"2026-02-24T07:52:37.800114+0000","last_fullsized":"2026-02-24T07:52:37.800114+0000","mapping_epoch":57,"log_start":"66'40694","ondisk_log_start":"66'40694","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333512704,"num_objects":5089,"num_object_clones":0,"num_object_copies":15267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40712,"num_write_kb":325696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"66'41168","reported_seq":41196,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.797028+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:37.797028+0000","last_peered":"2026-02-24T07:52:37.797028+0000","last_clean":"2026-02-24T07:52:37.797028+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:37.797028+0000","last_undegraded":"2026-02-24T07:52:37.797028+0000","last_fullsized":"2026-02-24T07:52:37.797028+0000","mapping_epoch":57,"log_start":"66'41162","ondisk_log_start":"66'41162","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41168,"num_write_kb":329344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'40734","reported_seq":40798,"reported_epoch":66,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:52:37.795449+0000","last_change":"2026-02-24T07:52:36.898107+0000","last_active":"2026-02-24T07:52:37.795449+0000","last_peered":"2026-02-24T07:52:37.795449+0000","last_clean":"2026-02-24T07:52:37.795449+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:37.795449+0000","last_undegraded":"2026-02-24T07:52:37.795449+0000","last_fullsized":"2026-02-24T07:52:37.795449+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":3699,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333692928,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40734,"num_write_kb":325872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"66'41032","reported_seq":41060,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.799675+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:37.799675+0000","last_peered":"2026-02-24T07:52:37.799675+0000","last_clean":"2026-02-24T07:52:37.799675+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:37.799675+0000","last_undegraded":"2026-02-24T07:52:37.799675+0000","last_fullsized":"2026-02-24T07:52:37.799675+0000","mapping_epoch":57,"log_start":"66'41016","ondisk_log_start":"66'41016","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336134144,"num_objects":5129,"num_object_clones":0,"num_object_copies":15387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41032,"num_write_kb":328256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'41832","reported_seq":41860,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.796423+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:37.796423+0000","last_peered":"2026-02-24T07:52:37.796423+0000","last_clean":"2026-02-24T07:52:37.796423+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:37.796423+0000","last_undegraded":"2026-02-24T07:52:37.796423+0000","last_fullsized":"2026-02-24T07:52:37.796423+0000","mapping_epoch":57,"log_start":"66'41824","ondisk_log_start":"66'41824","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342687744,"num_objects":5229,"num_object_clones":0,"num_object_copies":15687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41832,"num_write_kb":334656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"66'40224","reported_seq":40252,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.954415+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:37.954415+0000","last_peered":"2026-02-24T07:52:37.954415+0000","last_clean":"2026-02-24T07:52:37.954415+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:37.954415+0000","last_undegraded":"2026-02-24T07:52:37.954415+0000","last_fullsized":"2026-02-24T07:52:37.954415+0000","mapping_epoch":57,"log_start":"66'40208","ondisk_log_start":"66'40208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329515008,"num_objects":5028,"num_object_clones":0,"num_object_copies":15084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40224,"num_write_kb":321792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"66'41582","reported_seq":41603,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.806785+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:37.806785+0000","last_peered":"2026-02-24T07:52:37.806785+0000","last_clean":"2026-02-24T07:52:37.806785+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:37.806785+0000","last_undegraded":"2026-02-24T07:52:37.806785+0000","last_fullsized":"2026-02-24T07:52:37.806785+0000","mapping_epoch":57,"log_start":"66'41569","ondisk_log_start":"66'41569","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340639744,"num_objects":5198,"num_object_clones":0,"num_object_copies":15594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41582,"num_write_kb":332656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'39728","reported_seq":39748,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.953379+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:37.953379+0000","last_peered":"2026-02-24T07:52:37.953379+0000","last_clean":"2026-02-24T07:52:37.953379+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:37.953379+0000","last_undegraded":"2026-02-24T07:52:37.953379+0000","last_fullsized":"2026-02-24T07:52:37.953379+0000","mapping_epoch":57,"log_start":"66'39718","ondisk_log_start":"66'39718","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325451776,"num_objects":4966,"num_object_clones":0,"num_object_copies":14898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39728,"num_write_kb":317824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'40736","reported_seq":40764,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.812578+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:37.812578+0000","last_peered":"2026-02-24T07:52:37.812578+0000","last_clean":"2026-02-24T07:52:37.812578+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:37.812578+0000","last_undegraded":"2026-02-24T07:52:37.812578+0000","last_fullsized":"2026-02-24T07:52:37.812578+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333709312,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40736,"num_write_kb":325888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"66'40336","reported_seq":40364,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.938987+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:37.938987+0000","last_peered":"2026-02-24T07:52:37.938987+0000","last_clean":"2026-02-24T07:52:37.938987+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:37.938987+0000","last_undegraded":"2026-02-24T07:52:37.938987+0000","last_fullsized":"2026-02-24T07:52:37.938987+0000","mapping_epoch":57,"log_start":"66'40328","ondisk_log_start":"66'40328","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330432512,"num_objects":5042,"num_object_clones":0,"num_object_copies":15126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40336,"num_write_kb":322688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"66'41144","reported_seq":41172,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.778335+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:37.778335+0000","last_peered":"2026-02-24T07:52:37.778335+0000","last_clean":"2026-02-24T07:52:37.778335+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:37.778335+0000","last_undegraded":"2026-02-24T07:52:37.778335+0000","last_fullsized":"2026-02-24T07:52:37.778335+0000","mapping_epoch":57,"log_start":"66'41128","ondisk_log_start":"66'41128","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337051648,"num_objects":5143,"num_object_clones":0,"num_object_copies":15429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41144,"num_write_kb":329152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"66'40624","reported_seq":40652,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.779041+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:37.779041+0000","last_peered":"2026-02-24T07:52:37.779041+0000","last_clean":"2026-02-24T07:52:37.779041+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:37.779041+0000","last_undegraded":"2026-02-24T07:52:37.779041+0000","last_fullsized":"2026-02-24T07:52:37.779041+0000","mapping_epoch":57,"log_start":"66'40616","ondisk_log_start":"66'40616","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332791808,"num_objects":5078,"num_object_clones":0,"num_object_copies":15234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40624,"num_write_kb":324992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"66'40416","reported_seq":40442,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.804044+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:37.804044+0000","last_peered":"2026-02-24T07:52:37.804044+0000","last_clean":"2026-02-24T07:52:37.804044+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:37.804044+0000","last_undegraded":"2026-02-24T07:52:37.804044+0000","last_fullsized":"2026-02-24T07:52:37.804044+0000","mapping_epoch":57,"log_start":"66'40399","ondisk_log_start":"66'40399","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331087872,"num_objects":5052,"num_object_clones":0,"num_object_copies":15156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40416,"num_write_kb":323328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":296,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:36.929355+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:52:36.929355+0000","last_peered":"2026-02-24T07:52:36.929355+0000","last_clean":"2026-02-24T07:52:36.929355+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:36.929355+0000","last_undegraded":"2026-02-24T07:52:36.929355+0000","last_fullsized":"2026-02-24T07:52:36.929355+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":5353021440,"num_objects":81682,"num_object_clones":0,"num_object_copies":245046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653445,"num_write_kb":5227560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16057942016,"data_stored":16057942016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4806388,"kb_used_data":3869920,"kb_used_omap":8,"kb_used_meta":936439,"kb_avail":729196812,"statfs":{"total":751619276800,"available":746697535488,"internally_reserved":0,"allocated":3962798080,"data_stored":3962352411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8757,"internal_metadata":958913995},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,0,0,6,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5908876,"kb_used_data":4534648,"kb_used_omap":8,"kb_used_meta":1374199,"kb_avail":728094324,"statfs":{"total":751619276800,"available":745568587776,"internally_reserved":0,"allocated":4643479552,"data_stored":4643033883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8731,"internal_metadata":1407180261},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,7,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4703428,"kb_used_data":3258224,"kb_used_omap":15,"kb_used_meta":1445168,"kb_avail":729299772,"statfs":{"total":751619276800,"available":746802966528,"internally_reserved":0,"allocated":3336421376,"data_stored":3335971380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16182,"internal_metadata":1479852234},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,0,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5499016,"kb_used_data":3889140,"kb_used_omap":15,"kb_used_meta":1609840,"kb_avail":728504184,"statfs":{"total":751619276800,"available":745988284416,"internally_reserved":0,"allocated":3982479360,"data_stored":3982025812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15537,"internal_metadata":1648477007},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,9,0,0,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4004798464,"data_stored":4004798464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3349929984,"data_stored":3349929984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4695539712,"data_stored":4695539712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4007673856,"data_stored":4007673856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:42.508 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:42.692 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:42.817 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:42.814+0000 7f6e1a8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:42.818 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:42.814+0000 7f6e1a8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:42.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 127 704695 704568 80.9409 81.6797 0.012719 0.0123527 2026-02-24T07:52:42.963 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:42.964 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:42.976 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:42 trial016 ceph-mon[39544]: pgmap v221: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.72k op/s 2026-02-24T07:52:42.976 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3767946892' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:52:42.976 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:42 trial016 ceph-mon[39544]: osdmap e70: 4 total, 4 up, 4 in 2026-02-24T07:52:43.012 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2026-02-24T07:52:41.940216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5353611808,"num_objects":81684,"num_object_clones":0,"num_object_copies":245052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81684,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":653580,"num_write_kb":5229710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20917708,"kb_used_data":15551932,"kb_used_omap":48,"kb_used_meta":5365647,"kb_avail":2915095092,"statfs":{"total":3006477107200,"available":2985057374208,"internally_reserved":0,"allocated":15925178368,"data_stored":15923383486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49207,"internal_metadata":5494423497},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,0,7,32,11,16,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":386891776,"num_objects":5902,"num_object_clones":0,"num_object_copies":17706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47228,"num_write_kb":377824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.153730"},"pg_stats":[{"pgid":"4.f","version":"66'41344","reported_seq":41372,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.943057+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:37.943057+0000","last_peered":"2026-02-24T07:52:37.943057+0000","last_clean":"2026-02-24T07:52:37.943057+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:37.943057+0000","last_undegraded":"2026-02-24T07:52:37.943057+0000","last_fullsized":"2026-02-24T07:52:37.943057+0000","mapping_epoch":57,"log_start":"66'41334","ondisk_log_start":"66'41334","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338690048,"num_objects":5168,"num_object_clones":0,"num_object_copies":15504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41344,"num_write_kb":330752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'41592","reported_seq":41615,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.794112+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:37.794112+0000","last_peered":"2026-02-24T07:52:37.794112+0000","last_clean":"2026-02-24T07:52:37.794112+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:37.794112+0000","last_undegraded":"2026-02-24T07:52:37.794112+0000","last_fullsized":"2026-02-24T07:52:37.794112+0000","mapping_epoch":57,"log_start":"66'41584","ondisk_log_start":"66'41584","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":15597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41592,"num_write_kb":332736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"66'40241","reported_seq":40325,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800517+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:52:37.800517+0000","last_peered":"2026-02-24T07:52:37.800517+0000","last_clean":"2026-02-24T07:52:37.800517+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:37.800517+0000","last_undegraded":"2026-02-24T07:52:37.800517+0000","last_fullsized":"2026-02-24T07:52:37.800517+0000","mapping_epoch":57,"log_start":"66'40238","ondisk_log_start":"66'40238","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329654272,"num_objects":5031,"num_object_clones":0,"num_object_copies":15093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40241,"num_write_kb":321928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"66'40712","reported_seq":40740,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800114+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:37.800114+0000","last_peered":"2026-02-24T07:52:37.800114+0000","last_clean":"2026-02-24T07:52:37.800114+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:37.800114+0000","last_undegraded":"2026-02-24T07:52:37.800114+0000","last_fullsized":"2026-02-24T07:52:37.800114+0000","mapping_epoch":57,"log_start":"66'40694","ondisk_log_start":"66'40694","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333512704,"num_objects":5089,"num_object_clones":0,"num_object_copies":15267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40712,"num_write_kb":325696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"66'41168","reported_seq":41196,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.797028+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:37.797028+0000","last_peered":"2026-02-24T07:52:37.797028+0000","last_clean":"2026-02-24T07:52:37.797028+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:37.797028+0000","last_undegraded":"2026-02-24T07:52:37.797028+0000","last_fullsized":"2026-02-24T07:52:37.797028+0000","mapping_epoch":57,"log_start":"66'41162","ondisk_log_start":"66'41162","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41168,"num_write_kb":329344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'40734","reported_seq":40798,"reported_epoch":66,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:52:37.795449+0000","last_change":"2026-02-24T07:52:36.898107+0000","last_active":"2026-02-24T07:52:37.795449+0000","last_peered":"2026-02-24T07:52:37.795449+0000","last_clean":"2026-02-24T07:52:37.795449+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:37.795449+0000","last_undegraded":"2026-02-24T07:52:37.795449+0000","last_fullsized":"2026-02-24T07:52:37.795449+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":3699,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333692928,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40734,"num_write_kb":325872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"66'41032","reported_seq":41060,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.799675+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:37.799675+0000","last_peered":"2026-02-24T07:52:37.799675+0000","last_clean":"2026-02-24T07:52:37.799675+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:37.799675+0000","last_undegraded":"2026-02-24T07:52:37.799675+0000","last_fullsized":"2026-02-24T07:52:37.799675+0000","mapping_epoch":57,"log_start":"66'41016","ondisk_log_start":"66'41016","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336134144,"num_objects":5129,"num_object_clones":0,"num_object_copies":15387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41032,"num_write_kb":328256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'41832","reported_seq":41860,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.796423+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:37.796423+0000","last_peered":"2026-02-24T07:52:37.796423+0000","last_clean":"2026-02-24T07:52:37.796423+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:37.796423+0000","last_undegraded":"2026-02-24T07:52:37.796423+0000","last_fullsized":"2026-02-24T07:52:37.796423+0000","mapping_epoch":57,"log_start":"66'41824","ondisk_log_start":"66'41824","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342687744,"num_objects":5229,"num_object_clones":0,"num_object_copies":15687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41832,"num_write_kb":334656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"66'40224","reported_seq":40252,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.954415+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:37.954415+0000","last_peered":"2026-02-24T07:52:37.954415+0000","last_clean":"2026-02-24T07:52:37.954415+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:37.954415+0000","last_undegraded":"2026-02-24T07:52:37.954415+0000","last_fullsized":"2026-02-24T07:52:37.954415+0000","mapping_epoch":57,"log_start":"66'40208","ondisk_log_start":"66'40208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329515008,"num_objects":5028,"num_object_clones":0,"num_object_copies":15084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40224,"num_write_kb":321792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"66'41582","reported_seq":41603,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.806785+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:37.806785+0000","last_peered":"2026-02-24T07:52:37.806785+0000","last_clean":"2026-02-24T07:52:37.806785+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:37.806785+0000","last_undegraded":"2026-02-24T07:52:37.806785+0000","last_fullsized":"2026-02-24T07:52:37.806785+0000","mapping_epoch":57,"log_start":"66'41569","ondisk_log_start":"66'41569","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340639744,"num_objects":5198,"num_object_clones":0,"num_object_copies":15594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41582,"num_write_kb":332656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'39728","reported_seq":39748,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.953379+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:37.953379+0000","last_peered":"2026-02-24T07:52:37.953379+0000","last_clean":"2026-02-24T07:52:37.953379+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:37.953379+0000","last_undegraded":"2026-02-24T07:52:37.953379+0000","last_fullsized":"2026-02-24T07:52:37.953379+0000","mapping_epoch":57,"log_start":"66'39718","ondisk_log_start":"66'39718","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325451776,"num_objects":4966,"num_object_clones":0,"num_object_copies":14898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39728,"num_write_kb":317824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'40736","reported_seq":40764,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.812578+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:37.812578+0000","last_peered":"2026-02-24T07:52:37.812578+0000","last_clean":"2026-02-24T07:52:37.812578+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:37.812578+0000","last_undegraded":"2026-02-24T07:52:37.812578+0000","last_fullsized":"2026-02-24T07:52:37.812578+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333709312,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40736,"num_write_kb":325888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"66'40336","reported_seq":40364,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.938987+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:37.938987+0000","last_peered":"2026-02-24T07:52:37.938987+0000","last_clean":"2026-02-24T07:52:37.938987+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:37.938987+0000","last_undegraded":"2026-02-24T07:52:37.938987+0000","last_fullsized":"2026-02-24T07:52:37.938987+0000","mapping_epoch":57,"log_start":"66'40328","ondisk_log_start":"66'40328","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330432512,"num_objects":5042,"num_object_clones":0,"num_object_copies":15126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40336,"num_write_kb":322688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"66'41144","reported_seq":41172,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.778335+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:37.778335+0000","last_peered":"2026-02-24T07:52:37.778335+0000","last_clean":"2026-02-24T07:52:37.778335+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:37.778335+0000","last_undegraded":"2026-02-24T07:52:37.778335+0000","last_fullsized":"2026-02-24T07:52:37.778335+0000","mapping_epoch":57,"log_start":"66'41128","ondisk_log_start":"66'41128","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337051648,"num_objects":5143,"num_object_clones":0,"num_object_copies":15429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41144,"num_write_kb":329152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"66'40624","reported_seq":40652,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.779041+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:37.779041+0000","last_peered":"2026-02-24T07:52:37.779041+0000","last_clean":"2026-02-24T07:52:37.779041+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:37.779041+0000","last_undegraded":"2026-02-24T07:52:37.779041+0000","last_fullsized":"2026-02-24T07:52:37.779041+0000","mapping_epoch":57,"log_start":"66'40616","ondisk_log_start":"66'40616","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332791808,"num_objects":5078,"num_object_clones":0,"num_object_copies":15234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40624,"num_write_kb":324992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"66'40416","reported_seq":40442,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.804044+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:37.804044+0000","last_peered":"2026-02-24T07:52:37.804044+0000","last_clean":"2026-02-24T07:52:37.804044+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:37.804044+0000","last_undegraded":"2026-02-24T07:52:37.804044+0000","last_fullsized":"2026-02-24T07:52:37.804044+0000","mapping_epoch":57,"log_start":"66'40399","ondisk_log_start":"66'40399","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331087872,"num_objects":5052,"num_object_clones":0,"num_object_copies":15156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40416,"num_write_kb":323328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":296,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:36.929355+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:52:36.929355+0000","last_peered":"2026-02-24T07:52:36.929355+0000","last_clean":"2026-02-24T07:52:36.929355+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:36.929355+0000","last_undegraded":"2026-02-24T07:52:36.929355+0000","last_fullsized":"2026-02-24T07:52:36.929355+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":5353021440,"num_objects":81682,"num_object_clones":0,"num_object_copies":245046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653445,"num_write_kb":5227560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16057942016,"data_stored":16057942016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4806388,"kb_used_data":3869920,"kb_used_omap":8,"kb_used_meta":936439,"kb_avail":729196812,"statfs":{"total":751619276800,"available":746697535488,"internally_reserved":0,"allocated":3962798080,"data_stored":3962352411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8757,"internal_metadata":958913995},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,0,0,6,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5908876,"kb_used_data":4534648,"kb_used_omap":8,"kb_used_meta":1374199,"kb_avail":728094324,"statfs":{"total":751619276800,"available":745568587776,"internally_reserved":0,"allocated":4643479552,"data_stored":4643033883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8731,"internal_metadata":1407180261},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,7,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4703428,"kb_used_data":3258224,"kb_used_omap":15,"kb_used_meta":1445168,"kb_avail":729299772,"statfs":{"total":751619276800,"available":746802966528,"internally_reserved":0,"allocated":3336421376,"data_stored":3335971380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16182,"internal_metadata":1479852234},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,0,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5499016,"kb_used_data":3889140,"kb_used_omap":15,"kb_used_meta":1609840,"kb_avail":728504184,"statfs":{"total":751619276800,"available":745988284416,"internally_reserved":0,"allocated":3982479360,"data_stored":3982025812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15537,"internal_metadata":1648477007},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,9,0,0,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4004798464,"data_stored":4004798464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3349929984,"data_stored":3349929984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4695539712,"data_stored":4695539712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4007673856,"data_stored":4007673856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:43.014 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:52:43.014 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:43.015 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T07:52:43.015 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:43.158 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:43.289 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:43.285+0000 7fd71ad9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:43.289 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:43.286+0000 7fd71ad9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:43.426 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:43.426 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:43.477 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2026-02-24T07:52:41.940216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5353611808,"num_objects":81684,"num_object_clones":0,"num_object_copies":245052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81684,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":653580,"num_write_kb":5229710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20917708,"kb_used_data":15551932,"kb_used_omap":48,"kb_used_meta":5365647,"kb_avail":2915095092,"statfs":{"total":3006477107200,"available":2985057374208,"internally_reserved":0,"allocated":15925178368,"data_stored":15923383486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49207,"internal_metadata":5494423497},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,0,7,32,11,16,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":386891776,"num_objects":5902,"num_object_clones":0,"num_object_copies":17706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47228,"num_write_kb":377824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.153730"},"pg_stats":[{"pgid":"4.f","version":"66'41344","reported_seq":41372,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.943057+0000","last_change":"2026-02-24T07:51:33.853166+0000","last_active":"2026-02-24T07:52:37.943057+0000","last_peered":"2026-02-24T07:52:37.943057+0000","last_clean":"2026-02-24T07:52:37.943057+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:37.943057+0000","last_undegraded":"2026-02-24T07:52:37.943057+0000","last_fullsized":"2026-02-24T07:52:37.943057+0000","mapping_epoch":57,"log_start":"66'41334","ondisk_log_start":"66'41334","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:44.660641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338690048,"num_objects":5168,"num_object_clones":0,"num_object_copies":15504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41344,"num_write_kb":330752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'41592","reported_seq":41615,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.794112+0000","last_change":"2026-02-24T07:51:33.852239+0000","last_active":"2026-02-24T07:52:37.794112+0000","last_peered":"2026-02-24T07:52:37.794112+0000","last_clean":"2026-02-24T07:52:37.794112+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:37.794112+0000","last_undegraded":"2026-02-24T07:52:37.794112+0000","last_fullsized":"2026-02-24T07:52:37.794112+0000","mapping_epoch":57,"log_start":"66'41584","ondisk_log_start":"66'41584","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:47.140566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":15597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41592,"num_write_kb":332736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"66'40241","reported_seq":40325,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800517+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:52:37.800517+0000","last_peered":"2026-02-24T07:52:37.800517+0000","last_clean":"2026-02-24T07:52:37.800517+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:37.800517+0000","last_undegraded":"2026-02-24T07:52:37.800517+0000","last_fullsized":"2026-02-24T07:52:37.800517+0000","mapping_epoch":57,"log_start":"66'40238","ondisk_log_start":"66'40238","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329654272,"num_objects":5031,"num_object_clones":0,"num_object_copies":15093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40241,"num_write_kb":321928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"66'40712","reported_seq":40740,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.800114+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:37.800114+0000","last_peered":"2026-02-24T07:52:37.800114+0000","last_clean":"2026-02-24T07:52:37.800114+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:37.800114+0000","last_undegraded":"2026-02-24T07:52:37.800114+0000","last_fullsized":"2026-02-24T07:52:37.800114+0000","mapping_epoch":57,"log_start":"66'40694","ondisk_log_start":"66'40694","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333512704,"num_objects":5089,"num_object_clones":0,"num_object_copies":15267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40712,"num_write_kb":325696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"66'41168","reported_seq":41196,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.797028+0000","last_change":"2026-02-24T07:51:33.853289+0000","last_active":"2026-02-24T07:52:37.797028+0000","last_peered":"2026-02-24T07:52:37.797028+0000","last_clean":"2026-02-24T07:52:37.797028+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:37.797028+0000","last_undegraded":"2026-02-24T07:52:37.797028+0000","last_fullsized":"2026-02-24T07:52:37.797028+0000","mapping_epoch":57,"log_start":"66'41162","ondisk_log_start":"66'41162","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:42.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41168,"num_write_kb":329344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'40734","reported_seq":40798,"reported_epoch":66,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:52:37.795449+0000","last_change":"2026-02-24T07:52:36.898107+0000","last_active":"2026-02-24T07:52:37.795449+0000","last_peered":"2026-02-24T07:52:37.795449+0000","last_clean":"2026-02-24T07:52:37.795449+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:37.795449+0000","last_undegraded":"2026-02-24T07:52:37.795449+0000","last_fullsized":"2026-02-24T07:52:37.795449+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":3699,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333692928,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40734,"num_write_kb":325872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"66'41032","reported_seq":41060,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.799675+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:37.799675+0000","last_peered":"2026-02-24T07:52:37.799675+0000","last_clean":"2026-02-24T07:52:37.799675+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:37.799675+0000","last_undegraded":"2026-02-24T07:52:37.799675+0000","last_fullsized":"2026-02-24T07:52:37.799675+0000","mapping_epoch":57,"log_start":"66'41016","ondisk_log_start":"66'41016","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336134144,"num_objects":5129,"num_object_clones":0,"num_object_copies":15387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41032,"num_write_kb":328256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'41832","reported_seq":41860,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.796423+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:37.796423+0000","last_peered":"2026-02-24T07:52:37.796423+0000","last_clean":"2026-02-24T07:52:37.796423+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:37.796423+0000","last_undegraded":"2026-02-24T07:52:37.796423+0000","last_fullsized":"2026-02-24T07:52:37.796423+0000","mapping_epoch":57,"log_start":"66'41824","ondisk_log_start":"66'41824","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342687744,"num_objects":5229,"num_object_clones":0,"num_object_copies":15687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41832,"num_write_kb":334656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"66'40224","reported_seq":40252,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.954415+0000","last_change":"2026-02-24T07:51:33.853419+0000","last_active":"2026-02-24T07:52:37.954415+0000","last_peered":"2026-02-24T07:52:37.954415+0000","last_clean":"2026-02-24T07:52:37.954415+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:37.954415+0000","last_undegraded":"2026-02-24T07:52:37.954415+0000","last_fullsized":"2026-02-24T07:52:37.954415+0000","mapping_epoch":57,"log_start":"66'40208","ondisk_log_start":"66'40208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:45.933173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329515008,"num_objects":5028,"num_object_clones":0,"num_object_copies":15084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40224,"num_write_kb":321792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"66'41582","reported_seq":41603,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.806785+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:37.806785+0000","last_peered":"2026-02-24T07:52:37.806785+0000","last_clean":"2026-02-24T07:52:37.806785+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:37.806785+0000","last_undegraded":"2026-02-24T07:52:37.806785+0000","last_fullsized":"2026-02-24T07:52:37.806785+0000","mapping_epoch":57,"log_start":"66'41569","ondisk_log_start":"66'41569","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340639744,"num_objects":5198,"num_object_clones":0,"num_object_copies":15594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41582,"num_write_kb":332656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'39728","reported_seq":39748,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.953379+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:37.953379+0000","last_peered":"2026-02-24T07:52:37.953379+0000","last_clean":"2026-02-24T07:52:37.953379+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:37.953379+0000","last_undegraded":"2026-02-24T07:52:37.953379+0000","last_fullsized":"2026-02-24T07:52:37.953379+0000","mapping_epoch":57,"log_start":"66'39718","ondisk_log_start":"66'39718","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.047824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325451776,"num_objects":4966,"num_object_clones":0,"num_object_copies":14898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39728,"num_write_kb":317824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'40736","reported_seq":40764,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.812578+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:37.812578+0000","last_peered":"2026-02-24T07:52:37.812578+0000","last_clean":"2026-02-24T07:52:37.812578+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:37.812578+0000","last_undegraded":"2026-02-24T07:52:37.812578+0000","last_fullsized":"2026-02-24T07:52:37.812578+0000","mapping_epoch":57,"log_start":"66'40728","ondisk_log_start":"66'40728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333709312,"num_objects":5092,"num_object_clones":0,"num_object_copies":15276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40736,"num_write_kb":325888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"66'40336","reported_seq":40364,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.938987+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:37.938987+0000","last_peered":"2026-02-24T07:52:37.938987+0000","last_clean":"2026-02-24T07:52:37.938987+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:37.938987+0000","last_undegraded":"2026-02-24T07:52:37.938987+0000","last_fullsized":"2026-02-24T07:52:37.938987+0000","mapping_epoch":57,"log_start":"66'40328","ondisk_log_start":"66'40328","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330432512,"num_objects":5042,"num_object_clones":0,"num_object_copies":15126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40336,"num_write_kb":322688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"66'41144","reported_seq":41172,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.778335+0000","last_change":"2026-02-24T07:51:33.852579+0000","last_active":"2026-02-24T07:52:37.778335+0000","last_peered":"2026-02-24T07:52:37.778335+0000","last_clean":"2026-02-24T07:52:37.778335+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:37.778335+0000","last_undegraded":"2026-02-24T07:52:37.778335+0000","last_fullsized":"2026-02-24T07:52:37.778335+0000","mapping_epoch":57,"log_start":"66'41128","ondisk_log_start":"66'41128","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:41.634769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337051648,"num_objects":5143,"num_object_clones":0,"num_object_copies":15429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41144,"num_write_kb":329152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"66'40624","reported_seq":40652,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.779041+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:37.779041+0000","last_peered":"2026-02-24T07:52:37.779041+0000","last_clean":"2026-02-24T07:52:37.779041+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:37.779041+0000","last_undegraded":"2026-02-24T07:52:37.779041+0000","last_fullsized":"2026-02-24T07:52:37.779041+0000","mapping_epoch":57,"log_start":"66'40616","ondisk_log_start":"66'40616","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:50.392479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332791808,"num_objects":5078,"num_object_clones":0,"num_object_copies":15234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40624,"num_write_kb":324992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"66'40416","reported_seq":40442,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:37.804044+0000","last_change":"2026-02-24T07:51:33.854511+0000","last_active":"2026-02-24T07:52:37.804044+0000","last_peered":"2026-02-24T07:52:37.804044+0000","last_clean":"2026-02-24T07:52:37.804044+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:37.804044+0000","last_undegraded":"2026-02-24T07:52:37.804044+0000","last_fullsized":"2026-02-24T07:52:37.804044+0000","mapping_epoch":57,"log_start":"66'40399","ondisk_log_start":"66'40399","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:39.266774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331087872,"num_objects":5052,"num_object_clones":0,"num_object_copies":15156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40416,"num_write_kb":323328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":296,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-24T07:52:36.929355+0000","last_change":"2026-02-24T07:51:41.333948+0000","last_active":"2026-02-24T07:52:36.929355+0000","last_peered":"2026-02-24T07:52:36.929355+0000","last_clean":"2026-02-24T07:52:36.929355+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:36.929355+0000","last_undegraded":"2026-02-24T07:52:36.929355+0000","last_fullsized":"2026-02-24T07:52:36.929355+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:51:41.333914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:51:41.333914+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:48.290477+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":5353021440,"num_objects":81682,"num_object_clones":0,"num_object_copies":245046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653445,"num_write_kb":5227560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16057942016,"data_stored":16057942016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4806388,"kb_used_data":3869920,"kb_used_omap":8,"kb_used_meta":936439,"kb_avail":729196812,"statfs":{"total":751619276800,"available":746697535488,"internally_reserved":0,"allocated":3962798080,"data_stored":3962352411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8757,"internal_metadata":958913995},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,0,0,6,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5908876,"kb_used_data":4534648,"kb_used_omap":8,"kb_used_meta":1374199,"kb_avail":728094324,"statfs":{"total":751619276800,"available":745568587776,"internally_reserved":0,"allocated":4643479552,"data_stored":4643033883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8731,"internal_metadata":1407180261},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,7,9,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4703428,"kb_used_data":3258224,"kb_used_omap":15,"kb_used_meta":1445168,"kb_avail":729299772,"statfs":{"total":751619276800,"available":746802966528,"internally_reserved":0,"allocated":3336421376,"data_stored":3335971380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16182,"internal_metadata":1479852234},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,0,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5499016,"kb_used_data":3889140,"kb_used_omap":15,"kb_used_meta":1609840,"kb_avail":728504184,"statfs":{"total":751619276800,"available":745988284416,"internally_reserved":0,"allocated":3982479360,"data_stored":3982025812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15537,"internal_metadata":1648477007},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,9,0,0,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3376,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4004798464,"data_stored":4004798464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3349929984,"data_stored":3349929984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4695539712,"data_stored":4695539712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4007673856,"data_stored":4007673856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:43.478 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:52:43.479 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 36 2026-02-24T07:52:43.630 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:43.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:43.761+0000 7fab9bd7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:43.764 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:43.761+0000 7fab9bd7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:43.931 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:52:43.932 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:43.947 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 127 714877 714750 80.9206 79.5469 0.0114761 0.0123551 2026-02-24T07:52:44.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:43 trial016 ceph-mon[39544]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:44.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:43 trial016 ceph-mon[39544]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:44.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:43 trial016 ceph-mon[39544]: 4.b scrub starts 2026-02-24T07:52:44.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1434737205' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:52:44.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:52:44.399 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:44.838 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:44.825+0000 7f8c90e2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:44.838 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:44.826+0000 7f8c90e2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:44.861 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:44.862 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:44.878 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:44.878 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:44.908 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:44.908 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:44.924 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:44.924 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:44.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 127 722386 722259 80.6026 58.6641 0.017483 0.0124039 2026-02-24T07:52:45.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:45.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:44 trial016 ceph-mon[39544]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:45.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:44 trial016 ceph-mon[39544]: pgmap v223: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.31k op/s 2026-02-24T07:52:45.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:44 trial016 ceph-mon[39544]: 4.1 scrub starts 2026-02-24T07:52:45.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:44 trial016 ceph-mon[39544]: osdmap e71: 4 total, 4 up, 4 in 2026-02-24T07:52:45.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/187166175' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:45.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 732222 732094 80.5495 76.8359 0.00441738 0.0124125 2026-02-24T07:52:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:45 trial016 ceph-mon[39544]: 4.b scrub ok 2026-02-24T07:52:46.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 127 742886 742759 80.5879 83.3203 0.0121451 0.0124064 2026-02-24T07:52:47.222 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:47.249 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:46 trial016 ceph-mon[39544]: pgmap v225: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.39k op/s 2026-02-24T07:52:47.249 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:46 trial016 ceph-mon[39544]: 4.1 scrub ok 2026-02-24T07:52:47.373 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:47.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:47.501+0000 7f46a4519640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:47.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:47.502+0000 7f46a4519640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:47.519 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:47.520 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:47.537 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:47.537 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:47.599 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:47.599 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:47.630 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:47.630 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:47.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 753510 753382 80.6207 82.9922 0.0154842 0.0124012 2026-02-24T07:52:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:47 trial016 ceph-mon[39544]: 4.f scrub starts 2026-02-24T07:52:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:47 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:52:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:47 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:52:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1486126125' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:48.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 127 763935 763808 80.6319 81.4531 0.0112468 0.0123998 2026-02-24T07:52:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: 4.7 scrub starts 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: 4.f scrub ok 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: pgmap v226: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.19k op/s 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: 4.e scrub starts 2026-02-24T07:52:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:48 trial016 ceph-mon[39544]: 4.7 scrub ok 2026-02-24T07:52:49.374 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:52:49.374 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:52:49.531 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:49.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:49.661+0000 7f6328150640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:49.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:49.661+0000 7f6328150640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:49.678 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:49.828 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:52:49.829 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:49.921 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:52:49.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 774511 774383 80.6583 82.6172 0.00846147 0.0123955 2026-02-24T07:52:49.956 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:49.954+0000 7f9a9bf9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:49.956 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:49.954+0000 7f9a9bf9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:49.974 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:49.974 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:49.991 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:49.991 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:50.020 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:50.020 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:50.045 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:50.045 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:49 trial016 ceph-mon[39544]: 4.e scrub ok 2026-02-24T07:52:50.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3969776984' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:52:50.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3969776984' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:52:50.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:49 trial016 ceph-mon[39544]: osdmap e72: 4 total, 4 up, 4 in 2026-02-24T07:52:50.604 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:50.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 782975 782847 80.467 66.125 0.00498114 0.0124254 2026-02-24T07:52:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:50 trial016 ceph-mon[39544]: pgmap v227: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s wr, 12.34k op/s 2026-02-24T07:52:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1178061821' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:51.172 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:51.123+0000 7f7aadd4a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:51.172 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:51.123+0000 7f7aadd4a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:51.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 128 792861 792733 80.4249 77.2344 0.00837236 0.0124318 2026-02-24T07:52:51.958 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:52:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:51 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:52:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:51 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:52:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1777828124' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:52:52.531 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:52.703 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:52.793 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:52:52.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 128 800433 800305 80.1522 59.1562 0.00434807 0.0124707 2026-02-24T07:52:53.005 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:53.018 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:52 trial016 ceph-mon[39544]: pgmap v229: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s wr, 6.09k op/s 2026-02-24T07:52:53.018 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1777828124' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:52:53.018 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:52 trial016 ceph-mon[39544]: osdmap e73: 4 total, 4 up, 4 in 2026-02-24T07:52:53.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:53.149+0000 7f7c11e4b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:53.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:53.150+0000 7f7c11e4b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:53.236 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:53.245 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:53.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:53.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 128 808200 808072 79.9056 60.6797 0.012093 0.0125126 2026-02-24T07:52:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1773063009' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:54.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:54.456+0000 7fcae544c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:54.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:54.456+0000 7fcae544c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:54.829 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:52:54.882 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:52:54.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:52:54.947574+0000 min lat: 0.000567362 max lat: 0.104008 avg lat: 0.012528 2026-02-24T07:52:54.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:52:54.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 817391 817263 79.8043 71.8047 0.00631182 0.012528 2026-02-24T07:52:55.044 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:55.095 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:52:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:52:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:52:55.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:54 trial016 ceph-mon[39544]: 4.4 scrub starts 2026-02-24T07:52:55.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:54 trial016 ceph-mon[39544]: pgmap v231: 17 pgs: 17 active+clean; 6.1 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 94 MiB/s wr, 12.02k op/s 2026-02-24T07:52:55.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3252455475' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:52:55.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3252455475' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:52:55.096 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:54 trial016 ceph-mon[39544]: osdmap e74: 4 total, 4 up, 4 in 2026-02-24T07:52:55.174 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:55.170+0000 7f4d55731640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:55.174 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:55.171+0000 7f4d55731640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:55.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 127 827842 827715 79.8271 81.6562 0.00446963 0.0125246 2026-02-24T07:52:55.962 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:52:56.015 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:52:56.016 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:56.105 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:52:56.170 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: 4.9 scrub starts 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3379315792' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: 4.4 scrub ok 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:52:56.231 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:52:56.268 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:56.310 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.307+0000 7f1a78e62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.310 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.308+0000 7f1a78e62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.403 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.401+0000 7fbba52f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.404 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.402+0000 7fbba52f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.432 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:56.432 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:56.449 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:56.450 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:56.471 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:56.472 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:56.492 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:56.492 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:56.509 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:56.510 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:56.528 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2026-02-24T07:52:55.961319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6551659040,"num_objects":99964,"num_object_clones":0,"num_object_copies":299892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99964,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":799826,"num_write_kb":6399678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24960088,"kb_used_data":19087752,"kb_used_omap":52,"kb_used_meta":5872203,"kb_avail":2911052712,"statfs":{"total":3006477107200,"available":2980917977088,"internally_reserved":0,"allocated":19545858048,"data_stored":19543834611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54201,"internal_metadata":6013135943},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,8,22,27,16,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":389013504,"num_objects":5935,"num_object_clones":0,"num_object_copies":17805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47487,"num_write_kb":379896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.134390"},"pg_stats":[{"pgid":"4.f","version":"73'50408","reported_seq":50518,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.948698+0000","last_change":"2026-02-24T07:52:47.724652+0000","last_active":"2026-02-24T07:52:52.948698+0000","last_peered":"2026-02-24T07:52:52.948698+0000","last_clean":"2026-02-24T07:52:52.948698+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:52.948698+0000","last_undegraded":"2026-02-24T07:52:52.948698+0000","last_fullsized":"2026-02-24T07:52:52.948698+0000","mapping_epoch":57,"log_start":"73'50403","ondisk_log_start":"73'50403","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47257","last_scrub_stamp":"2026-02-24T07:52:47.724211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:47.724211+0000","objects_scrubbed":5858,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:57.355345+0000","scrub_duration":1169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":18903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50408,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"73'50664","reported_seq":50759,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.805841+0000","last_change":"2026-02-24T07:52:49.116084+0000","last_active":"2026-02-24T07:52:52.805841+0000","last_peered":"2026-02-24T07:52:52.805841+0000","last_clean":"2026-02-24T07:52:52.805841+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:52.805841+0000","last_undegraded":"2026-02-24T07:52:52.805841+0000","last_fullsized":"2026-02-24T07:52:52.805841+0000","mapping_epoch":57,"log_start":"73'50647","ondisk_log_start":"73'50647","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48600","last_scrub_stamp":"2026-02-24T07:52:49.115996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:49.115996+0000","objects_scrubbed":6036,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:03.308538+0000","scrub_duration":1074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415039488,"num_objects":6333,"num_object_clones":0,"num_object_copies":18999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50664,"num_write_kb":405312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"73'49016","reported_seq":49115,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.798914+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:52:52.798914+0000","last_peered":"2026-02-24T07:52:52.798914+0000","last_clean":"2026-02-24T07:52:52.798914+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:52.798914+0000","last_undegraded":"2026-02-24T07:52:52.798914+0000","last_fullsized":"2026-02-24T07:52:52.798914+0000","mapping_epoch":57,"log_start":"73'49001","ondisk_log_start":"73'49001","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401539072,"num_objects":6127,"num_object_clones":0,"num_object_copies":18381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49016,"num_write_kb":392128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"73'50088","reported_seq":50130,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.797427+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:52.797427+0000","last_peered":"2026-02-24T07:52:52.797427+0000","last_clean":"2026-02-24T07:52:52.797427+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:52.797427+0000","last_undegraded":"2026-02-24T07:52:52.797427+0000","last_fullsized":"2026-02-24T07:52:52.797427+0000","mapping_epoch":57,"log_start":"73'50080","ondisk_log_start":"73'50080","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410320896,"num_objects":6261,"num_object_clones":0,"num_object_copies":18783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50088,"num_write_kb":400704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"73'50240","reported_seq":50346,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.805016+0000","last_change":"2026-02-24T07:52:45.288658+0000","last_active":"2026-02-24T07:52:52.805016+0000","last_peered":"2026-02-24T07:52:52.805016+0000","last_clean":"2026-02-24T07:52:52.805016+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:52.805016+0000","last_undegraded":"2026-02-24T07:52:52.805016+0000","last_fullsized":"2026-02-24T07:52:52.805016+0000","mapping_epoch":57,"log_start":"73'50232","ondisk_log_start":"73'50232","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45488","last_scrub_stamp":"2026-02-24T07:52:45.288598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.288598+0000","objects_scrubbed":5633,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:02.213552+0000","scrub_duration":1812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411566080,"num_objects":6280,"num_object_clones":0,"num_object_copies":18840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50240,"num_write_kb":401920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"73'49856","reported_seq":49958,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.777562+0000","last_change":"2026-02-24T07:52:38.032050+0000","last_active":"2026-02-24T07:52:52.777562+0000","last_peered":"2026-02-24T07:52:52.777562+0000","last_clean":"2026-02-24T07:52:52.777562+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:52.777562+0000","last_undegraded":"2026-02-24T07:52:52.777562+0000","last_fullsized":"2026-02-24T07:52:52.777562+0000","mapping_epoch":57,"log_start":"73'49848","ondisk_log_start":"73'49848","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'40834","last_scrub_stamp":"2026-02-24T07:52:38.031998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:38.031998+0000","objects_scrubbed":5063,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:48.787159+0000","scrub_duration":1134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408420352,"num_objects":6232,"num_object_clones":0,"num_object_copies":18696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49856,"num_write_kb":398848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"73'50320","reported_seq":50362,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.800263+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:52.800263+0000","last_peered":"2026-02-24T07:52:52.800263+0000","last_clean":"2026-02-24T07:52:52.800263+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:52.800263+0000","last_undegraded":"2026-02-24T07:52:52.800263+0000","last_fullsized":"2026-02-24T07:52:52.800263+0000","mapping_epoch":57,"log_start":"73'50312","ondisk_log_start":"73'50312","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412221440,"num_objects":6290,"num_object_clones":0,"num_object_copies":18870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50320,"num_write_kb":402560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"73'50792","reported_seq":50834,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.789436+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:52.789436+0000","last_peered":"2026-02-24T07:52:52.789436+0000","last_clean":"2026-02-24T07:52:52.789436+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:52.789436+0000","last_undegraded":"2026-02-24T07:52:52.789436+0000","last_fullsized":"2026-02-24T07:52:52.789436+0000","mapping_epoch":57,"log_start":"73'50775","ondisk_log_start":"73'50775","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416088064,"num_objects":6349,"num_object_clones":0,"num_object_copies":19047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50792,"num_write_kb":406336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"73'49864","reported_seq":49968,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.953127+0000","last_change":"2026-02-24T07:52:48.299843+0000","last_active":"2026-02-24T07:52:52.953127+0000","last_peered":"2026-02-24T07:52:52.953127+0000","last_clean":"2026-02-24T07:52:52.953127+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:52.953127+0000","last_undegraded":"2026-02-24T07:52:52.953127+0000","last_fullsized":"2026-02-24T07:52:52.953127+0000","mapping_epoch":57,"log_start":"73'49857","ondisk_log_start":"73'49857","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47112","last_scrub_stamp":"2026-02-24T07:52:48.299795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:48.299795+0000","objects_scrubbed":5864,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:55.078867+0000","scrub_duration":732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408485888,"num_objects":6233,"num_object_clones":0,"num_object_copies":18699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49864,"num_write_kb":398912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"73'50696","reported_seq":50738,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.812451+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:52.812451+0000","last_peered":"2026-02-24T07:52:52.812451+0000","last_clean":"2026-02-24T07:52:52.812451+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:52.812451+0000","last_undegraded":"2026-02-24T07:52:52.812451+0000","last_fullsized":"2026-02-24T07:52:52.812451+0000","mapping_epoch":57,"log_start":"73'50689","ondisk_log_start":"73'50689","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415301632,"num_objects":6337,"num_object_clones":0,"num_object_copies":19011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50696,"num_write_kb":405568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"73'48976","reported_seq":49018,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.891254+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:52.891254+0000","last_peered":"2026-02-24T07:52:52.891254+0000","last_clean":"2026-02-24T07:52:52.891254+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:52.891254+0000","last_undegraded":"2026-02-24T07:52:52.891254+0000","last_fullsized":"2026-02-24T07:52:52.891254+0000","mapping_epoch":57,"log_start":"73'48973","ondisk_log_start":"73'48973","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401211392,"num_objects":6122,"num_object_clones":0,"num_object_copies":18366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48976,"num_write_kb":391808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"73'50152","reported_seq":50194,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.785072+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:52.785072+0000","last_peered":"2026-02-24T07:52:52.785072+0000","last_clean":"2026-02-24T07:52:52.785072+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:52.785072+0000","last_undegraded":"2026-02-24T07:52:52.785072+0000","last_fullsized":"2026-02-24T07:52:52.785072+0000","mapping_epoch":57,"log_start":"73'50144","ondisk_log_start":"73'50144","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410845184,"num_objects":6269,"num_object_clones":0,"num_object_copies":18807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50152,"num_write_kb":401216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"73'49752","reported_seq":49794,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.887307+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:52.887307+0000","last_peered":"2026-02-24T07:52:52.887307+0000","last_clean":"2026-02-24T07:52:52.887307+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:52.887307+0000","last_undegraded":"2026-02-24T07:52:52.887307+0000","last_fullsized":"2026-02-24T07:52:52.887307+0000","mapping_epoch":57,"log_start":"73'49744","ondisk_log_start":"73'49744","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407568384,"num_objects":6219,"num_object_clones":0,"num_object_copies":18657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49752,"num_write_kb":398016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"73'50448","reported_seq":50555,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.794665+0000","last_change":"2026-02-24T07:52:45.824175+0000","last_active":"2026-02-24T07:52:52.794665+0000","last_peered":"2026-02-24T07:52:52.794665+0000","last_clean":"2026-02-24T07:52:52.794665+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:52.794665+0000","last_undegraded":"2026-02-24T07:52:52.794665+0000","last_fullsized":"2026-02-24T07:52:52.794665+0000","mapping_epoch":57,"log_start":"73'50440","ondisk_log_start":"73'50440","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'46040","last_scrub_stamp":"2026-02-24T07:52:45.824086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.824086+0000","objects_scrubbed":5688,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:04.551887+0000","scrub_duration":1745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413270016,"num_objects":6306,"num_object_clones":0,"num_object_copies":18918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50448,"num_write_kb":403584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"73'49307","reported_seq":49334,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.807601+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:52.807601+0000","last_peered":"2026-02-24T07:52:52.807601+0000","last_clean":"2026-02-24T07:52:52.807601+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:52.807601+0000","last_undegraded":"2026-02-24T07:52:52.807601+0000","last_fullsized":"2026-02-24T07:52:52.807601+0000","mapping_epoch":57,"log_start":"73'49291","ondisk_log_start":"73'49291","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403922944,"num_objects":6164,"num_object_clones":0,"num_object_copies":18492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49307,"num_write_kb":394456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"73'49112","reported_seq":49209,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.800269+0000","last_change":"2026-02-24T07:52:41.154511+0000","last_active":"2026-02-24T07:52:52.800269+0000","last_peered":"2026-02-24T07:52:52.800269+0000","last_clean":"2026-02-24T07:52:52.800269+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:52.800269+0000","last_undegraded":"2026-02-24T07:52:52.800269+0000","last_fullsized":"2026-02-24T07:52:52.800269+0000","mapping_epoch":57,"log_start":"73'49105","ondisk_log_start":"73'49105","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'42242","last_scrub_stamp":"2026-02-24T07:52:41.154472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:41.154472+0000","objects_scrubbed":5238,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:09.371415+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402325504,"num_objects":6139,"num_object_clones":0,"num_object_copies":18417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49112,"num_write_kb":392896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":318,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:51.958960+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:52:51.958960+0000","last_peered":"2026-02-24T07:52:51.958960+0000","last_clean":"2026-02-24T07:52:51.958960+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:51.958960+0000","last_undegraded":"2026-02-24T07:52:51.958960+0000","last_fullsized":"2026-02-24T07:52:51.958960+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6551068672,"num_objects":99962,"num_object_clones":0,"num_object_copies":299886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799691,"num_write_kb":6397528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19654950912,"data_stored":19654950912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11911,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5966432,"kb_used_data":4741196,"kb_used_omap":13,"kb_used_meta":1225202,"kb_avail":728036768,"statfs":{"total":751619276800,"available":745509650432,"internally_reserved":0,"allocated":4854984704,"data_stored":4854483866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14031,"internal_metadata":1254607153},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,16,16,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7266780,"kb_used_data":5567240,"kb_used_omap":12,"kb_used_meta":1699507,"kb_avail":726736420,"statfs":{"total":751619276800,"available":744178094080,"internally_reserved":0,"allocated":5700853760,"data_stored":5700345043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12643,"internal_metadata":1740295837},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,7,15,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5605720,"kb_used_data":3997316,"kb_used_omap":20,"kb_used_meta":1608363,"kb_avail":728397480,"statfs":{"total":751619276800,"available":745879019520,"internally_reserved":0,"allocated":4093251584,"data_stored":4092746419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20746,"internal_metadata":1646964470},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6121156,"kb_used_data":4782000,"kb_used_omap":6,"kb_used_meta":1339129,"kb_avail":727882044,"statfs":{"total":751619276800,"available":745351213056,"internally_reserved":0,"allocated":4896768000,"data_stored":4896259283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6781,"internal_metadata":1371268483},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,7,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11911,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4904697856,"data_stored":4904697856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4105986048,"data_stored":4105986048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5741355008,"data_stored":5741355008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4902912000,"data_stored":4902912000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:56.530 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:52:56.677 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:56.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.805+0000 7f8e1eedb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:56.805+0000 7f8e1eedb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:56.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 837901 837773 79.8118 78.5781 0.00959089 0.0125272 2026-02-24T07:52:56.965 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:52:56.965 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:52:57.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:56 trial016 ceph-mon[39544]: pgmap v233: 17 pgs: 17 active+clean; 6.1 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.91k op/s 2026-02-24T07:52:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3379315792' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:52:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:56 trial016 ceph-mon[39544]: osdmap e75: 4 total, 4 up, 4 in 2026-02-24T07:52:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/497695469' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:57.713 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2026-02-24T07:52:55.961319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6551659040,"num_objects":99964,"num_object_clones":0,"num_object_copies":299892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99964,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":799826,"num_write_kb":6399678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24960088,"kb_used_data":19087752,"kb_used_omap":52,"kb_used_meta":5872203,"kb_avail":2911052712,"statfs":{"total":3006477107200,"available":2980917977088,"internally_reserved":0,"allocated":19545858048,"data_stored":19543834611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54201,"internal_metadata":6013135943},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,8,22,27,16,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":389013504,"num_objects":5935,"num_object_clones":0,"num_object_copies":17805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47487,"num_write_kb":379896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.134390"},"pg_stats":[{"pgid":"4.f","version":"73'50408","reported_seq":50518,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.948698+0000","last_change":"2026-02-24T07:52:47.724652+0000","last_active":"2026-02-24T07:52:52.948698+0000","last_peered":"2026-02-24T07:52:52.948698+0000","last_clean":"2026-02-24T07:52:52.948698+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:52:52.948698+0000","last_undegraded":"2026-02-24T07:52:52.948698+0000","last_fullsized":"2026-02-24T07:52:52.948698+0000","mapping_epoch":57,"log_start":"73'50403","ondisk_log_start":"73'50403","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47257","last_scrub_stamp":"2026-02-24T07:52:47.724211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:47.724211+0000","objects_scrubbed":5858,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:57.355345+0000","scrub_duration":1169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":18903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50408,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"73'50664","reported_seq":50759,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.805841+0000","last_change":"2026-02-24T07:52:49.116084+0000","last_active":"2026-02-24T07:52:52.805841+0000","last_peered":"2026-02-24T07:52:52.805841+0000","last_clean":"2026-02-24T07:52:52.805841+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:52:52.805841+0000","last_undegraded":"2026-02-24T07:52:52.805841+0000","last_fullsized":"2026-02-24T07:52:52.805841+0000","mapping_epoch":57,"log_start":"73'50647","ondisk_log_start":"73'50647","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48600","last_scrub_stamp":"2026-02-24T07:52:49.115996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:49.115996+0000","objects_scrubbed":6036,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:03.308538+0000","scrub_duration":1074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415039488,"num_objects":6333,"num_object_clones":0,"num_object_copies":18999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50664,"num_write_kb":405312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"73'49016","reported_seq":49115,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.798914+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:52:52.798914+0000","last_peered":"2026-02-24T07:52:52.798914+0000","last_clean":"2026-02-24T07:52:52.798914+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:52:52.798914+0000","last_undegraded":"2026-02-24T07:52:52.798914+0000","last_fullsized":"2026-02-24T07:52:52.798914+0000","mapping_epoch":57,"log_start":"73'49001","ondisk_log_start":"73'49001","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401539072,"num_objects":6127,"num_object_clones":0,"num_object_copies":18381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49016,"num_write_kb":392128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"73'50088","reported_seq":50130,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.797427+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:52:52.797427+0000","last_peered":"2026-02-24T07:52:52.797427+0000","last_clean":"2026-02-24T07:52:52.797427+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:52:52.797427+0000","last_undegraded":"2026-02-24T07:52:52.797427+0000","last_fullsized":"2026-02-24T07:52:52.797427+0000","mapping_epoch":57,"log_start":"73'50080","ondisk_log_start":"73'50080","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:02.151975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410320896,"num_objects":6261,"num_object_clones":0,"num_object_copies":18783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50088,"num_write_kb":400704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"73'50240","reported_seq":50346,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.805016+0000","last_change":"2026-02-24T07:52:45.288658+0000","last_active":"2026-02-24T07:52:52.805016+0000","last_peered":"2026-02-24T07:52:52.805016+0000","last_clean":"2026-02-24T07:52:52.805016+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:52:52.805016+0000","last_undegraded":"2026-02-24T07:52:52.805016+0000","last_fullsized":"2026-02-24T07:52:52.805016+0000","mapping_epoch":57,"log_start":"73'50232","ondisk_log_start":"73'50232","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45488","last_scrub_stamp":"2026-02-24T07:52:45.288598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.288598+0000","objects_scrubbed":5633,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:02.213552+0000","scrub_duration":1812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411566080,"num_objects":6280,"num_object_clones":0,"num_object_copies":18840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50240,"num_write_kb":401920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"73'49856","reported_seq":49958,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.777562+0000","last_change":"2026-02-24T07:52:38.032050+0000","last_active":"2026-02-24T07:52:52.777562+0000","last_peered":"2026-02-24T07:52:52.777562+0000","last_clean":"2026-02-24T07:52:52.777562+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:52:52.777562+0000","last_undegraded":"2026-02-24T07:52:52.777562+0000","last_fullsized":"2026-02-24T07:52:52.777562+0000","mapping_epoch":57,"log_start":"73'49848","ondisk_log_start":"73'49848","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'40834","last_scrub_stamp":"2026-02-24T07:52:38.031998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:38.031998+0000","objects_scrubbed":5063,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:48.787159+0000","scrub_duration":1134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408420352,"num_objects":6232,"num_object_clones":0,"num_object_copies":18696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49856,"num_write_kb":398848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"73'50320","reported_seq":50362,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.800263+0000","last_change":"2026-02-24T07:51:33.852496+0000","last_active":"2026-02-24T07:52:52.800263+0000","last_peered":"2026-02-24T07:52:52.800263+0000","last_clean":"2026-02-24T07:52:52.800263+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:52:52.800263+0000","last_undegraded":"2026-02-24T07:52:52.800263+0000","last_fullsized":"2026-02-24T07:52:52.800263+0000","mapping_epoch":57,"log_start":"73'50312","ondisk_log_start":"73'50312","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:52.875651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412221440,"num_objects":6290,"num_object_clones":0,"num_object_copies":18870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50320,"num_write_kb":402560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"73'50792","reported_seq":50834,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.789436+0000","last_change":"2026-02-24T07:51:33.853972+0000","last_active":"2026-02-24T07:52:52.789436+0000","last_peered":"2026-02-24T07:52:52.789436+0000","last_clean":"2026-02-24T07:52:52.789436+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:52:52.789436+0000","last_undegraded":"2026-02-24T07:52:52.789436+0000","last_fullsized":"2026-02-24T07:52:52.789436+0000","mapping_epoch":57,"log_start":"73'50775","ondisk_log_start":"73'50775","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:58.518022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416088064,"num_objects":6349,"num_object_clones":0,"num_object_copies":19047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50792,"num_write_kb":406336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"73'49864","reported_seq":49968,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.953127+0000","last_change":"2026-02-24T07:52:48.299843+0000","last_active":"2026-02-24T07:52:52.953127+0000","last_peered":"2026-02-24T07:52:52.953127+0000","last_clean":"2026-02-24T07:52:52.953127+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:52:52.953127+0000","last_undegraded":"2026-02-24T07:52:52.953127+0000","last_fullsized":"2026-02-24T07:52:52.953127+0000","mapping_epoch":57,"log_start":"73'49857","ondisk_log_start":"73'49857","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47112","last_scrub_stamp":"2026-02-24T07:52:48.299795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:48.299795+0000","objects_scrubbed":5864,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:55.078867+0000","scrub_duration":732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408485888,"num_objects":6233,"num_object_clones":0,"num_object_copies":18699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49864,"num_write_kb":398912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"73'50696","reported_seq":50738,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.812451+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:52:52.812451+0000","last_peered":"2026-02-24T07:52:52.812451+0000","last_clean":"2026-02-24T07:52:52.812451+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:52:52.812451+0000","last_undegraded":"2026-02-24T07:52:52.812451+0000","last_fullsized":"2026-02-24T07:52:52.812451+0000","mapping_epoch":57,"log_start":"73'50689","ondisk_log_start":"73'50689","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:00.828701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415301632,"num_objects":6337,"num_object_clones":0,"num_object_copies":19011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50696,"num_write_kb":405568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"73'48976","reported_seq":49018,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.891254+0000","last_change":"2026-02-24T07:51:33.853082+0000","last_active":"2026-02-24T07:52:52.891254+0000","last_peered":"2026-02-24T07:52:52.891254+0000","last_clean":"2026-02-24T07:52:52.891254+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:52:52.891254+0000","last_undegraded":"2026-02-24T07:52:52.891254+0000","last_fullsized":"2026-02-24T07:52:52.891254+0000","mapping_epoch":57,"log_start":"73'48973","ondisk_log_start":"73'48973","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401211392,"num_objects":6122,"num_object_clones":0,"num_object_copies":18366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48976,"num_write_kb":391808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"73'50152","reported_seq":50194,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.785072+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:52:52.785072+0000","last_peered":"2026-02-24T07:52:52.785072+0000","last_clean":"2026-02-24T07:52:52.785072+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:52:52.785072+0000","last_undegraded":"2026-02-24T07:52:52.785072+0000","last_fullsized":"2026-02-24T07:52:52.785072+0000","mapping_epoch":57,"log_start":"73'50144","ondisk_log_start":"73'50144","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:52:55.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410845184,"num_objects":6269,"num_object_clones":0,"num_object_copies":18807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50152,"num_write_kb":401216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"73'49752","reported_seq":49794,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.887307+0000","last_change":"2026-02-24T07:51:33.852635+0000","last_active":"2026-02-24T07:52:52.887307+0000","last_peered":"2026-02-24T07:52:52.887307+0000","last_clean":"2026-02-24T07:52:52.887307+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:52:52.887307+0000","last_undegraded":"2026-02-24T07:52:52.887307+0000","last_fullsized":"2026-02-24T07:52:52.887307+0000","mapping_epoch":57,"log_start":"73'49744","ondisk_log_start":"73'49744","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:01.887413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407568384,"num_objects":6219,"num_object_clones":0,"num_object_copies":18657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49752,"num_write_kb":398016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"73'50448","reported_seq":50555,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.794665+0000","last_change":"2026-02-24T07:52:45.824175+0000","last_active":"2026-02-24T07:52:52.794665+0000","last_peered":"2026-02-24T07:52:52.794665+0000","last_clean":"2026-02-24T07:52:52.794665+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:52:52.794665+0000","last_undegraded":"2026-02-24T07:52:52.794665+0000","last_fullsized":"2026-02-24T07:52:52.794665+0000","mapping_epoch":57,"log_start":"73'50440","ondisk_log_start":"73'50440","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'46040","last_scrub_stamp":"2026-02-24T07:52:45.824086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.824086+0000","objects_scrubbed":5688,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:04.551887+0000","scrub_duration":1745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413270016,"num_objects":6306,"num_object_clones":0,"num_object_copies":18918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50448,"num_write_kb":403584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"73'49307","reported_seq":49334,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.807601+0000","last_change":"2026-02-24T07:51:33.852932+0000","last_active":"2026-02-24T07:52:52.807601+0000","last_peered":"2026-02-24T07:52:52.807601+0000","last_clean":"2026-02-24T07:52:52.807601+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:52:52.807601+0000","last_undegraded":"2026-02-24T07:52:52.807601+0000","last_fullsized":"2026-02-24T07:52:52.807601+0000","mapping_epoch":57,"log_start":"73'49291","ondisk_log_start":"73'49291","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403922944,"num_objects":6164,"num_object_clones":0,"num_object_copies":18492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49307,"num_write_kb":394456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"73'49112","reported_seq":49209,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:52.800269+0000","last_change":"2026-02-24T07:52:41.154511+0000","last_active":"2026-02-24T07:52:52.800269+0000","last_peered":"2026-02-24T07:52:52.800269+0000","last_clean":"2026-02-24T07:52:52.800269+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:52:52.800269+0000","last_undegraded":"2026-02-24T07:52:52.800269+0000","last_fullsized":"2026-02-24T07:52:52.800269+0000","mapping_epoch":57,"log_start":"73'49105","ondisk_log_start":"73'49105","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'42242","last_scrub_stamp":"2026-02-24T07:52:41.154472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:41.154472+0000","objects_scrubbed":5238,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:09.371415+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402325504,"num_objects":6139,"num_object_clones":0,"num_object_copies":18417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49112,"num_write_kb":392896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":318,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T07:52:51.958960+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:52:51.958960+0000","last_peered":"2026-02-24T07:52:51.958960+0000","last_clean":"2026-02-24T07:52:51.958960+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:51.958960+0000","last_undegraded":"2026-02-24T07:52:51.958960+0000","last_fullsized":"2026-02-24T07:52:51.958960+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6551068672,"num_objects":99962,"num_object_clones":0,"num_object_copies":299886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799691,"num_write_kb":6397528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19654950912,"data_stored":19654950912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11911,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5966432,"kb_used_data":4741196,"kb_used_omap":13,"kb_used_meta":1225202,"kb_avail":728036768,"statfs":{"total":751619276800,"available":745509650432,"internally_reserved":0,"allocated":4854984704,"data_stored":4854483866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14031,"internal_metadata":1254607153},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,16,16,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7266780,"kb_used_data":5567240,"kb_used_omap":12,"kb_used_meta":1699507,"kb_avail":726736420,"statfs":{"total":751619276800,"available":744178094080,"internally_reserved":0,"allocated":5700853760,"data_stored":5700345043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12643,"internal_metadata":1740295837},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,7,15,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5605720,"kb_used_data":3997316,"kb_used_omap":20,"kb_used_meta":1608363,"kb_avail":728397480,"statfs":{"total":751619276800,"available":745879019520,"internally_reserved":0,"allocated":4093251584,"data_stored":4092746419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20746,"internal_metadata":1646964470},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6121156,"kb_used_data":4782000,"kb_used_omap":6,"kb_used_meta":1339129,"kb_avail":727882044,"statfs":{"total":751619276800,"available":745351213056,"internally_reserved":0,"allocated":4896768000,"data_stored":4896259283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6781,"internal_metadata":1371268483},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,7,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11911,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4904697856,"data_stored":4904697856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4105986048,"data_stored":4105986048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5741355008,"data_stored":5741355008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4902912000,"data_stored":4902912000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:52:57.715 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:52:57.715 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:52:57.715 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:52:57.716 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:52:57.867 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:57.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 128 846762 846634 79.6842 69.2266 0.0142239 0.0125474 2026-02-24T07:52:58.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:57 trial016 ceph-mon[39544]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:58.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:57 trial016 ceph-mon[39544]: 4.9 scrub ok 2026-02-24T07:52:58.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:57 trial016 ceph-mon[39544]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:52:58.363 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.347+0000 7faab8b20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.363 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.348+0000 7faab8b20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.387 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:52:58.387 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:52:58.388 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:52:58.487 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:52:58.488 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:52:58.488 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:52:58.564 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:52:58.646 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:58.715 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:58.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.780+0000 7feec4c91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.780+0000 7feec4c91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:52:58.811 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:52:58.842 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.840+0000 7fedb6e9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.842 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:58.840+0000 7fedb6e9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:58.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:52:58.848 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:52:58.848 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:52:58.857 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:52:58.857 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:52:58.874 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:52:58.874 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:52:58.908 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:52:58.908 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:52:58.935 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:52:58.935 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:52:58.948 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 127 856098 855971 79.6039 72.9453 0.0126788 0.0125601 2026-02-24T07:52:59.001 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:59.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:58 trial016 ceph-mon[39544]: pgmap v235: 17 pgs: 17 active+clean; 6.1 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.91k op/s 2026-02-24T07:52:59.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:52:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3383461550' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:52:59.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:59.125+0000 7f7583186640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:59.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:59.126+0000 7f7583186640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:52:59.176 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:52:59.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:52:59.214 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:52:59.215 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:52:59.409 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:52:59.541 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:59.538+0000 7f56e3712640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:59.541 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:52:59.538+0000 7f56e3712640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:52:59.564 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:52:59.564 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:52:59.565 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:52:59.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:52:59.605 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:52:59.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 127 867155 867028 79.6836 86.3828 0.0260025 0.0125466 2026-02-24T07:53:00.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 128 877216 877088 79.6708 78.5938 0.0101883 0.0125494 2026-02-24T07:53:00.987 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:01.140 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:01.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:00 trial016 ceph-mon[39544]: pgmap v236: 17 pgs: 17 active+clean; 6.5 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 93 MiB/s wr, 11.93k op/s 2026-02-24T07:53:01.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:00 trial016 ceph-mon[39544]: osdmap e76: 4 total, 4 up, 4 in 2026-02-24T07:53:01.265 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:01.262+0000 7f63f4b94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:01.265 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:01.262+0000 7f63f4b94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:01.279 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:01.280 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:01.293 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:01.294 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:01.363 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:01.363 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:01.384 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:01.384 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:01.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 887386 887258 79.6683 79.4531 0.0113816 0.0125499 2026-02-24T07:53:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:01 trial016 ceph-mon[39544]: 4.8 scrub starts 2026-02-24T07:53:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2834395734' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:01 trial016 ceph-mon[39544]: 4.0 scrub starts 2026-02-24T07:53:02.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 127 898009 897882 79.706 83 0.0162042 0.012544 2026-02-24T07:53:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:02 trial016 ceph-mon[39544]: pgmap v238: 17 pgs: 17 active+clean; 6.5 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.59k op/s 2026-02-24T07:53:03.431 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:03.583 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:03.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 907273 907145 79.6235 72.3672 0.0473549 0.0125544 2026-02-24T07:53:04.011 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:04.007+0000 7f6f1bd7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:04.011 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:04.008+0000 7f6f1bd7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:04.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:03 trial016 ceph-mon[39544]: 4.2 scrub starts 2026-02-24T07:53:04.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:03 trial016 ceph-mon[39544]: 4.8 scrub ok 2026-02-24T07:53:04.012 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:03 trial016 ceph-mon[39544]: 4.0 scrub ok 2026-02-24T07:53:04.012 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:03 trial016 ceph-mon[39544]: 4.c scrub starts 2026-02-24T07:53:04.028 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:04.029 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:04.049 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:04.049 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:04.065 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:04.065 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:04.079 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:04.079 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:04.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:04.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:04.607 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:53:04.607 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:04.762 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:04.886 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:04.883+0000 7fb0f6792640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:04.886 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:04.883+0000 7fb0f6792640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:04.887 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:04 trial016 ceph-mon[39544]: pgmap v239: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.8 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s wr, 12.14k op/s 2026-02-24T07:53:04.887 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1619177562' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:04.887 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:04 trial016 ceph-mon[39544]: 4.2 scrub ok 2026-02-24T07:53:04.887 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:04 trial016 ceph-mon[39544]: 4.3 scrub starts 2026-02-24T07:53:04.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 7 916009 916002 79.5076 69.1953 0.00729702 0.0125757 2026-02-24T07:53:05.018 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:05.019 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:05.056 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2026-02-24T07:53:03.789962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7347323424,"num_objects":112105,"num_object_clones":0,"num_object_copies":336315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112105,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":896953,"num_write_kb":7176694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":27435044,"kb_used_data":21381908,"kb_used_omap":59,"kb_used_meta":6052996,"kb_avail":2908577756,"statfs":{"total":3006477107200,"available":2978383622144,"internally_reserved":0,"allocated":21895073792,"data_stored":21892947896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60725,"internal_metadata":6198268619},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":795664384,"num_objects":12141,"num_object_clones":0,"num_object_copies":36423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97127,"num_write_kb":777016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001012"},"pg_stats":[{"pgid":"4.f","version":"76'56840","reported_seq":56956,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.916550+0000","last_change":"2026-02-24T07:52:47.724652+0000","last_active":"2026-02-24T07:53:02.916550+0000","last_peered":"2026-02-24T07:53:02.916550+0000","last_clean":"2026-02-24T07:53:02.916550+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:53:02.916550+0000","last_undegraded":"2026-02-24T07:53:02.916550+0000","last_fullsized":"2026-02-24T07:53:02.916550+0000","mapping_epoch":57,"log_start":"76'56832","ondisk_log_start":"76'56832","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47257","last_scrub_stamp":"2026-02-24T07:52:47.724211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:47.724211+0000","objects_scrubbed":5858,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:57.355345+0000","scrub_duration":1169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465633280,"num_objects":7105,"num_object_clones":0,"num_object_copies":21315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56840,"num_write_kb":454720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'56912","reported_seq":57023,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.803498+0000","last_change":"2026-02-24T07:52:49.116084+0000","last_active":"2026-02-24T07:53:02.803498+0000","last_peered":"2026-02-24T07:53:02.803498+0000","last_clean":"2026-02-24T07:53:02.803498+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:53:02.803498+0000","last_undegraded":"2026-02-24T07:53:02.803498+0000","last_fullsized":"2026-02-24T07:53:02.803498+0000","mapping_epoch":57,"log_start":"76'56886","ondisk_log_start":"76'56886","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48600","last_scrub_stamp":"2026-02-24T07:52:49.115996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:49.115996+0000","objects_scrubbed":6036,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:03.308538+0000","scrub_duration":1074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466223104,"num_objects":7114,"num_object_clones":0,"num_object_copies":21342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56912,"num_write_kb":455296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'54928","reported_seq":55033,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.777928+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:53:02.777928+0000","last_peered":"2026-02-24T07:53:02.777928+0000","last_clean":"2026-02-24T07:53:02.777928+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:53:02.777928+0000","last_undegraded":"2026-02-24T07:53:02.777928+0000","last_fullsized":"2026-02-24T07:53:02.777928+0000","mapping_epoch":57,"log_start":"76'54920","ondisk_log_start":"76'54920","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449970176,"num_objects":6866,"num_object_clones":0,"num_object_copies":20598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54928,"num_write_kb":439424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"76'56304","reported_seq":56352,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.794444+0000","last_change":"2026-02-24T07:51:33.854548+0000","last_active":"2026-02-24T07:53:02.794444+0000","last_peered":"2026-02-24T07:53:02.794444+0000","last_clean":"2026-02-24T07:53:02.794444+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:53:02.794444+0000","last_undegraded":"2026-02-24T07:53:02.794444+0000","last_fullsized":"2026-02-24T07:53:02.794444+0000","mapping_epoch":57,"log_start":"76'56296","ondisk_log_start":"76'56296","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461242368,"num_objects":7038,"num_object_clones":0,"num_object_copies":21114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56304,"num_write_kb":450432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"76'56216","reported_seq":56328,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.814071+0000","last_change":"2026-02-24T07:52:45.288658+0000","last_active":"2026-02-24T07:53:02.814071+0000","last_peered":"2026-02-24T07:53:02.814071+0000","last_clean":"2026-02-24T07:53:02.814071+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:53:02.814071+0000","last_undegraded":"2026-02-24T07:53:02.814071+0000","last_fullsized":"2026-02-24T07:53:02.814071+0000","mapping_epoch":57,"log_start":"76'56208","ondisk_log_start":"76'56208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45488","last_scrub_stamp":"2026-02-24T07:52:45.288598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.288598+0000","objects_scrubbed":5633,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:02.213552+0000","scrub_duration":1812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460521472,"num_objects":7027,"num_object_clones":0,"num_object_copies":21081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7027,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56216,"num_write_kb":449728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'55720","reported_seq":55828,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.791387+0000","last_change":"2026-02-24T07:52:38.032050+0000","last_active":"2026-02-24T07:53:02.791387+0000","last_peered":"2026-02-24T07:53:02.791387+0000","last_clean":"2026-02-24T07:53:02.791387+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:53:02.791387+0000","last_undegraded":"2026-02-24T07:53:02.791387+0000","last_fullsized":"2026-02-24T07:53:02.791387+0000","mapping_epoch":57,"log_start":"76'55696","ondisk_log_start":"76'55696","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'40834","last_scrub_stamp":"2026-02-24T07:52:38.031998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:38.031998+0000","objects_scrubbed":5063,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:48.787159+0000","scrub_duration":1134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456458240,"num_objects":6965,"num_object_clones":0,"num_object_copies":20895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55720,"num_write_kb":445760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'56232","reported_seq":56354,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.795936+0000","last_change":"2026-02-24T07:52:56.604640+0000","last_active":"2026-02-24T07:53:02.795936+0000","last_peered":"2026-02-24T07:53:02.795936+0000","last_clean":"2026-02-24T07:53:02.795936+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:53:02.795936+0000","last_undegraded":"2026-02-24T07:53:02.795936+0000","last_fullsized":"2026-02-24T07:53:02.795936+0000","mapping_epoch":57,"log_start":"76'56224","ondisk_log_start":"76'56224","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'52480","last_scrub_stamp":"2026-02-24T07:52:56.604568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:56.604568+0000","objects_scrubbed":6510,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:17.917474+0000","scrub_duration":1591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460652544,"num_objects":7029,"num_object_clones":0,"num_object_copies":21087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56232,"num_write_kb":449856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'56840","reported_seq":56967,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.812083+0000","last_change":"2026-02-24T07:53:02.633428+0000","last_active":"2026-02-24T07:53:02.812083+0000","last_peered":"2026-02-24T07:53:02.812083+0000","last_clean":"2026-02-24T07:53:02.812083+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:53:02.812083+0000","last_undegraded":"2026-02-24T07:53:02.812083+0000","last_fullsized":"2026-02-24T07:53:02.812083+0000","mapping_epoch":57,"log_start":"76'56824","ondisk_log_start":"76'56824","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'56712","last_scrub_stamp":"2026-02-24T07:53:02.633376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:02.633376+0000","objects_scrubbed":7029,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:15.245724+0000","scrub_duration":1653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465633280,"num_objects":7105,"num_object_clones":0,"num_object_copies":21315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56840,"num_write_kb":454720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"76'56032","reported_seq":56148,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.956361+0000","last_change":"2026-02-24T07:52:48.299843+0000","last_active":"2026-02-24T07:53:02.956361+0000","last_peered":"2026-02-24T07:53:02.956361+0000","last_clean":"2026-02-24T07:53:02.956361+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:53:02.956361+0000","last_undegraded":"2026-02-24T07:53:02.956361+0000","last_fullsized":"2026-02-24T07:53:02.956361+0000","mapping_epoch":57,"log_start":"76'56021","ondisk_log_start":"76'56021","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47112","last_scrub_stamp":"2026-02-24T07:52:48.299795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:48.299795+0000","objects_scrubbed":5864,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:55.078867+0000","scrub_duration":732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459014144,"num_objects":7004,"num_object_clones":0,"num_object_copies":21012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56032,"num_write_kb":448256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'56736","reported_seq":56784,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.812714+0000","last_change":"2026-02-24T07:51:33.853072+0000","last_active":"2026-02-24T07:53:02.812714+0000","last_peered":"2026-02-24T07:53:02.812714+0000","last_clean":"2026-02-24T07:53:02.812714+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:53:02.812714+0000","last_undegraded":"2026-02-24T07:53:02.812714+0000","last_fullsized":"2026-02-24T07:53:02.812714+0000","mapping_epoch":57,"log_start":"76'56728","ondisk_log_start":"76'56728","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":464781312,"num_objects":7092,"num_object_clones":0,"num_object_copies":21276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56736,"num_write_kb":453888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'55232","reported_seq":55338,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.959610+0000","last_change":"2026-02-24T07:52:55.375256+0000","last_active":"2026-02-24T07:53:02.959610+0000","last_peered":"2026-02-24T07:53:02.959610+0000","last_clean":"2026-02-24T07:53:02.959610+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:53:02.959610+0000","last_undegraded":"2026-02-24T07:53:02.959610+0000","last_fullsized":"2026-02-24T07:53:02.959610+0000","mapping_epoch":57,"log_start":"76'55208","ondisk_log_start":"76'55208","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'50392","last_scrub_stamp":"2026-02-24T07:52:55.375207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:55.375207+0000","objects_scrubbed":6207,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:05.319148+0000","scrub_duration":1820,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452460544,"num_objects":6904,"num_object_clones":0,"num_object_copies":20712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55232,"num_write_kb":441856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"76'55896","reported_seq":55939,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.821611+0000","last_change":"2026-02-24T07:51:33.852986+0000","last_active":"2026-02-24T07:53:02.821611+0000","last_peered":"2026-02-24T07:53:02.821611+0000","last_clean":"2026-02-24T07:53:02.821611+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:53:02.821611+0000","last_undegraded":"2026-02-24T07:53:02.821611+0000","last_fullsized":"2026-02-24T07:53:02.821611+0000","mapping_epoch":57,"log_start":"76'55888","ondisk_log_start":"76'55888","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457900032,"num_objects":6987,"num_object_clones":0,"num_object_copies":20961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55896,"num_write_kb":447168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"76'55682","reported_seq":55734,"reported_epoch":76,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:53:02.959654+0000","last_change":"2026-02-24T07:53:02.609448+0000","last_active":"2026-02-24T07:53:02.959654+0000","last_peered":"2026-02-24T07:53:02.959654+0000","last_clean":"2026-02-24T07:53:02.959654+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:53:02.959654+0000","last_undegraded":"2026-02-24T07:53:02.959654+0000","last_fullsized":"2026-02-24T07:53:02.959654+0000","mapping_epoch":57,"log_start":"76'55662","ondisk_log_start":"76'55662","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":1850,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456146944,"num_objects":6961,"num_object_clones":0,"num_object_copies":20883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55682,"num_write_kb":445456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"76'56856","reported_seq":56968,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.807598+0000","last_change":"2026-02-24T07:52:45.824175+0000","last_active":"2026-02-24T07:53:02.807598+0000","last_peered":"2026-02-24T07:53:02.807598+0000","last_clean":"2026-02-24T07:53:02.807598+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:53:02.807598+0000","last_undegraded":"2026-02-24T07:53:02.807598+0000","last_fullsized":"2026-02-24T07:53:02.807598+0000","mapping_epoch":57,"log_start":"76'56840","ondisk_log_start":"76'56840","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'46040","last_scrub_stamp":"2026-02-24T07:52:45.824086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.824086+0000","objects_scrubbed":5688,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:04.551887+0000","scrub_duration":1745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465764352,"num_objects":7107,"num_object_clones":0,"num_object_copies":21321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56856,"num_write_kb":454848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"76'55480","reported_seq":55591,"reported_epoch":76,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:53:02.821716+0000","last_change":"2026-02-24T07:53:01.539187+0000","last_active":"2026-02-24T07:53:02.821716+0000","last_peered":"2026-02-24T07:53:02.821716+0000","last_clean":"2026-02-24T07:53:02.821716+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:53:02.821716+0000","last_undegraded":"2026-02-24T07:53:02.821716+0000","last_fullsized":"2026-02-24T07:53:02.821716+0000","mapping_epoch":57,"log_start":"76'55471","ondisk_log_start":"76'55471","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":6599,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454492160,"num_objects":6935,"num_object_clones":0,"num_object_copies":20805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55480,"num_write_kb":443840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"76'54912","reported_seq":55020,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:02.805824+0000","last_change":"2026-02-24T07:52:41.154511+0000","last_active":"2026-02-24T07:53:02.805824+0000","last_peered":"2026-02-24T07:53:02.805824+0000","last_clean":"2026-02-24T07:53:02.805824+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:53:02.805824+0000","last_undegraded":"2026-02-24T07:53:02.805824+0000","last_fullsized":"2026-02-24T07:53:02.805824+0000","mapping_epoch":57,"log_start":"76'54904","ondisk_log_start":"76'54904","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'42242","last_scrub_stamp":"2026-02-24T07:52:41.154472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:41.154472+0000","objects_scrubbed":5238,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:09.371415+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449839104,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54912,"num_write_kb":439296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":324,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:52:59.829389+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:52:59.829389+0000","last_peered":"2026-02-24T07:52:59.829389+0000","last_clean":"2026-02-24T07:52:59.829389+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:59.829389+0000","last_undegraded":"2026-02-24T07:52:59.829389+0000","last_fullsized":"2026-02-24T07:52:59.829389+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":7346733056,"num_objects":112103,"num_object_clones":0,"num_object_copies":336309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896818,"num_write_kb":7174544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22039937024,"data_stored":22039937024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6707728,"kb_used_data":5320060,"kb_used_omap":16,"kb_used_meta":1387631,"kb_avail":727295472,"statfs":{"total":751619276800,"available":744750563328,"internally_reserved":0,"allocated":5447741440,"data_stored":5447209078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16643,"internal_metadata":1420934909},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8181864,"kb_used_data":6229652,"kb_used_omap":12,"kb_used_meta":1952179,"kb_avail":725821336,"statfs":{"total":751619276800,"available":743241048064,"internally_reserved":0,"allocated":6379163648,"data_stored":6378631286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12643,"internal_metadata":1999031965},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6271060,"kb_used_data":4482176,"kb_used_omap":22,"kb_used_meta":1788841,"kb_avail":727732140,"statfs":{"total":751619276800,"available":745197711360,"internally_reserved":0,"allocated":4589748224,"data_stored":4589219414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22702,"internal_metadata":1831774034},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6274392,"kb_used_data":5350020,"kb_used_omap":8,"kb_used_meta":924343,"kb_avail":727728808,"statfs":{"total":751619276800,"available":745194299392,"internally_reserved":0,"allocated":5478420480,"data_stored":5477888118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8737,"internal_metadata":946527711},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5495701504,"data_stored":5495701504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4607868928,"data_stored":4607868928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6436487168,"data_stored":6436487168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5499879424,"data_stored":5499879424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:05.057 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:05.057 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 131 2026-02-24T07:53:05.176 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:05.199 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:05.277 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:05.275+0000 7f7c3f9fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:05.277 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:05.275+0000 7f7c3f9fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:05.386 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:05.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:05.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0093 2026-02-24T07:53:05.949 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 916009 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 79.5064 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 8.0553 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 93.9141 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 58.6641 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 10176 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 1031.08 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 12021 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 7509 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0125757 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.00774996 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.104008 2026-02-24T07:53:05.950 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000567362 2026-02-24T07:53:05.951 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:53:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:05 trial016 ceph-mon[39544]: 4.c scrub ok 2026-02-24T07:53:06.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:05 trial016 ceph-mon[39544]: 4.3 scrub ok 2026-02-24T07:53:06.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3289012142' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "131"} : dispatch 2026-02-24T07:53:06.566 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:06.721 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:06.849 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:06.846+0000 7f2e25096640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:06.849 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:06.846+0000 7f2e25096640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:06.850 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:06 trial016 ceph-mon[39544]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:06.850 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:06 trial016 ceph-mon[39544]: pgmap v240: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.8 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 77 MiB/s wr, 9.88k op/s 2026-02-24T07:53:06.850 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:06 trial016 ceph-mon[39544]: 4.6 scrub starts 2026-02-24T07:53:06.868 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:06.868 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:06.889 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:06.889 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:06.923 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:06.924 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:06.940 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:06.940 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/881716294' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:08.989 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:09.142 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:09.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:08 trial016 ceph-mon[39544]: pgmap v241: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 6.8 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.71k op/s 2026-02-24T07:53:09.271 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:09.268+0000 7f4d5807a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:09.271 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:09.268+0000 7f4d5807a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:09.286 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:09.287 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:09.299 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:09.300 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:09.405 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:09.405 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:09.447 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:09.448 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:09 trial016 ceph-mon[39544]: 4.6 scrub ok 2026-02-24T07:53:10.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3991254469' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:10.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:10.420 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:10.420 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:53:10.420 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:10.575 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:10.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:10 trial016 ceph-mon[39544]: pgmap v242: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 55 MiB/s wr, 9.20k op/s 2026-02-24T07:53:11.014 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:10.957+0000 7fc88c766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.015 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:10.957+0000 7fc88c766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.113 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:11.114 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:11.164 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2026-02-24T07:53:09.790814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6089155128,"num_objects":92908,"num_object_clones":0,"num_object_copies":278724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92908,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":937742,"num_write_kb":7330223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24766304,"kb_used_data":19123216,"kb_used_omap":59,"kb_used_meta":5642948,"kb_avail":2911246496,"statfs":{"total":3006477107200,"available":2981116411904,"internally_reserved":0,"allocated":19582173184,"data_stored":19580035072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60725,"internal_metadata":5778379467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,3,4,11,12],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-838664168,"num_objects":-12798,"num_object_clones":0,"num_object_copies":-38394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12798,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":91998,"num_write_kb":563201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001364"},"pg_stats":[{"pgid":"4.f","version":"76'59427","reported_seq":59543,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.958456+0000","last_change":"2026-02-24T07:52:47.724652+0000","last_active":"2026-02-24T07:53:07.958456+0000","last_peered":"2026-02-24T07:53:07.958456+0000","last_clean":"2026-02-24T07:53:07.958456+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:53:07.958456+0000","last_undegraded":"2026-02-24T07:53:07.958456+0000","last_fullsized":"2026-02-24T07:53:07.958456+0000","mapping_epoch":57,"log_start":"76'59424","ondisk_log_start":"76'59424","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47257","last_scrub_stamp":"2026-02-24T07:52:47.724211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:47.724211+0000","objects_scrubbed":5858,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:57.355345+0000","scrub_duration":1169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380436480,"num_objects":5805,"num_object_clones":0,"num_object_copies":17415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59427,"num_write_kb":463872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'59581","reported_seq":59689,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.807031+0000","last_change":"2026-02-24T07:52:49.116084+0000","last_active":"2026-02-24T07:53:07.807031+0000","last_peered":"2026-02-24T07:53:07.807031+0000","last_clean":"2026-02-24T07:53:07.807031+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:53:07.807031+0000","last_undegraded":"2026-02-24T07:53:07.807031+0000","last_fullsized":"2026-02-24T07:53:07.807031+0000","mapping_epoch":57,"log_start":"76'59567","ondisk_log_start":"76'59567","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48600","last_scrub_stamp":"2026-02-24T07:52:49.115996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:49.115996+0000","objects_scrubbed":6036,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:03.308538+0000","scrub_duration":1074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386859008,"num_objects":5903,"num_object_clones":0,"num_object_copies":17709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59581,"num_write_kb":465664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'57521","reported_seq":57614,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.816434+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:53:07.816434+0000","last_peered":"2026-02-24T07:53:07.816434+0000","last_clean":"2026-02-24T07:53:07.816434+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:53:07.816434+0000","last_undegraded":"2026-02-24T07:53:07.816434+0000","last_fullsized":"2026-02-24T07:53:07.816434+0000","mapping_epoch":57,"log_start":"76'57502","ondisk_log_start":"76'57502","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378011672,"num_objects":5769,"num_object_clones":0,"num_object_copies":17307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5769,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":57521,"num_write_kb":450049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"76'58721","reported_seq":58845,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.815861+0000","last_change":"2026-02-24T07:53:04.871752+0000","last_active":"2026-02-24T07:53:07.815861+0000","last_peered":"2026-02-24T07:53:07.815861+0000","last_clean":"2026-02-24T07:53:07.815861+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:53:07.815861+0000","last_undegraded":"2026-02-24T07:53:07.815861+0000","last_fullsized":"2026-02-24T07:53:07.815861+0000","mapping_epoch":57,"log_start":"76'58714","ondisk_log_start":"76'58714","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'57376","last_scrub_stamp":"2026-02-24T07:53:04.871720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:04.871720+0000","objects_scrubbed":7107,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:34.839138+0000","scrub_duration":1834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384237568,"num_objects":5863,"num_object_clones":0,"num_object_copies":17589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5863,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58721,"num_write_kb":459264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"76'58665","reported_seq":58776,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.810890+0000","last_change":"2026-02-24T07:52:45.288658+0000","last_active":"2026-02-24T07:53:07.810890+0000","last_peered":"2026-02-24T07:53:07.810890+0000","last_clean":"2026-02-24T07:53:07.810890+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:53:07.810890+0000","last_undegraded":"2026-02-24T07:53:07.810890+0000","last_fullsized":"2026-02-24T07:53:07.810890+0000","mapping_epoch":57,"log_start":"76'58656","ondisk_log_start":"76'58656","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45488","last_scrub_stamp":"2026-02-24T07:52:45.288598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.288598+0000","objects_scrubbed":5633,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:02.213552+0000","scrub_duration":1812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380239872,"num_objects":5802,"num_object_clones":0,"num_object_copies":17406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58665,"num_write_kb":458432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'58380","reported_seq":58484,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.807320+0000","last_change":"2026-02-24T07:52:38.032050+0000","last_active":"2026-02-24T07:53:07.807320+0000","last_peered":"2026-02-24T07:53:07.807320+0000","last_clean":"2026-02-24T07:53:07.807320+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:53:07.807320+0000","last_undegraded":"2026-02-24T07:53:07.807320+0000","last_fullsized":"2026-02-24T07:53:07.807320+0000","mapping_epoch":57,"log_start":"76'58368","ondisk_log_start":"76'58368","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'40834","last_scrub_stamp":"2026-02-24T07:52:38.031998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:38.031998+0000","objects_scrubbed":5063,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:48.787159+0000","scrub_duration":1134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381812736,"num_objects":5826,"num_object_clones":0,"num_object_copies":17478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58380,"num_write_kb":456576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'58680","reported_seq":58796,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.801989+0000","last_change":"2026-02-24T07:52:56.604640+0000","last_active":"2026-02-24T07:53:07.801989+0000","last_peered":"2026-02-24T07:53:07.801989+0000","last_clean":"2026-02-24T07:53:07.801989+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:53:07.801989+0000","last_undegraded":"2026-02-24T07:53:07.801989+0000","last_fullsized":"2026-02-24T07:53:07.801989+0000","mapping_epoch":57,"log_start":"76'58668","ondisk_log_start":"76'58668","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'52480","last_scrub_stamp":"2026-02-24T07:52:56.604568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:56.604568+0000","objects_scrubbed":6510,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:17.917474+0000","scrub_duration":1591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381026304,"num_objects":5814,"num_object_clones":0,"num_object_copies":17442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58680,"num_write_kb":458624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'59349","reported_seq":59467,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.815740+0000","last_change":"2026-02-24T07:53:02.633428+0000","last_active":"2026-02-24T07:53:07.815740+0000","last_peered":"2026-02-24T07:53:07.815740+0000","last_clean":"2026-02-24T07:53:07.815740+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:53:07.815740+0000","last_undegraded":"2026-02-24T07:53:07.815740+0000","last_fullsized":"2026-02-24T07:53:07.815740+0000","mapping_epoch":57,"log_start":"76'59337","ondisk_log_start":"76'59337","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'56712","last_scrub_stamp":"2026-02-24T07:53:02.633376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:02.633376+0000","objects_scrubbed":7029,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:15.245724+0000","scrub_duration":1653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387317760,"num_objects":5910,"num_object_clones":0,"num_object_copies":17730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59349,"num_write_kb":464064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"76'58452","reported_seq":58568,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.958786+0000","last_change":"2026-02-24T07:52:48.299843+0000","last_active":"2026-02-24T07:53:07.958786+0000","last_peered":"2026-02-24T07:53:07.958786+0000","last_clean":"2026-02-24T07:53:07.958786+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:53:07.958786+0000","last_undegraded":"2026-02-24T07:53:07.958786+0000","last_fullsized":"2026-02-24T07:53:07.958786+0000","mapping_epoch":57,"log_start":"76'58446","ondisk_log_start":"76'58446","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47112","last_scrub_stamp":"2026-02-24T07:52:48.299795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:48.299795+0000","objects_scrubbed":5864,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:55.078867+0000","scrub_duration":732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374734848,"num_objects":5718,"num_object_clones":0,"num_object_copies":17154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58452,"num_write_kb":456320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'59416","reported_seq":59497,"reported_epoch":76,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:53:07.813448+0000","last_change":"2026-02-24T07:53:06.525377+0000","last_active":"2026-02-24T07:53:07.813448+0000","last_peered":"2026-02-24T07:53:07.813448+0000","last_clean":"2026-02-24T07:53:07.813448+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:53:07.813448+0000","last_undegraded":"2026-02-24T07:53:07.813448+0000","last_fullsized":"2026-02-24T07:53:07.813448+0000","mapping_epoch":57,"log_start":"76'59404","ondisk_log_start":"76'59404","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:51:32.839332+0000","objects_scrubbed":3499,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384106496,"num_objects":5861,"num_object_clones":0,"num_object_copies":17583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59416,"num_write_kb":464192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'57717","reported_seq":57836,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.956928+0000","last_change":"2026-02-24T07:52:55.375256+0000","last_active":"2026-02-24T07:53:07.956928+0000","last_peered":"2026-02-24T07:53:07.956928+0000","last_clean":"2026-02-24T07:53:07.956928+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:53:07.956928+0000","last_undegraded":"2026-02-24T07:53:07.956928+0000","last_fullsized":"2026-02-24T07:53:07.956928+0000","mapping_epoch":57,"log_start":"76'57714","ondisk_log_start":"76'57714","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'50392","last_scrub_stamp":"2026-02-24T07:52:55.375207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:55.375207+0000","objects_scrubbed":6207,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:05.319148+0000","scrub_duration":1820,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368050176,"num_objects":5616,"num_object_clones":0,"num_object_copies":16848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57717,"num_write_kb":450368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"76'58456","reported_seq":58575,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.811281+0000","last_change":"2026-02-24T07:53:05.193299+0000","last_active":"2026-02-24T07:53:07.811281+0000","last_peered":"2026-02-24T07:53:07.811281+0000","last_clean":"2026-02-24T07:53:07.811281+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:53:07.811281+0000","last_undegraded":"2026-02-24T07:53:07.811281+0000","last_fullsized":"2026-02-24T07:53:07.811281+0000","mapping_epoch":57,"log_start":"76'58446","ondisk_log_start":"76'58446","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'57144","last_scrub_stamp":"2026-02-24T07:53:05.193234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:05.193234+0000","objects_scrubbed":7140,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:25.629953+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382140416,"num_objects":5831,"num_object_clones":0,"num_object_copies":17493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58456,"num_write_kb":457152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"76'58388","reported_seq":58516,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.957285+0000","last_change":"2026-02-24T07:53:04.243045+0000","last_active":"2026-02-24T07:53:07.957285+0000","last_peered":"2026-02-24T07:53:07.957285+0000","last_clean":"2026-02-24T07:53:07.957285+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:53:07.957285+0000","last_undegraded":"2026-02-24T07:53:07.957285+0000","last_fullsized":"2026-02-24T07:53:07.957285+0000","mapping_epoch":57,"log_start":"76'58382","ondisk_log_start":"76'58382","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'56544","last_scrub_stamp":"2026-02-24T07:53:04.242887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:04.242887+0000","objects_scrubbed":7000,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.160943+0000","scrub_duration":1634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374800384,"num_objects":5719,"num_object_clones":0,"num_object_copies":17157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58388,"num_write_kb":455872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"76'59443","reported_seq":59545,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.806357+0000","last_change":"2026-02-24T07:52:45.824175+0000","last_active":"2026-02-24T07:53:07.806357+0000","last_peered":"2026-02-24T07:53:07.806357+0000","last_clean":"2026-02-24T07:53:07.806357+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:53:07.806357+0000","last_undegraded":"2026-02-24T07:53:07.806357+0000","last_fullsized":"2026-02-24T07:53:07.806357+0000","mapping_epoch":57,"log_start":"76'59430","ondisk_log_start":"76'59430","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'46040","last_scrub_stamp":"2026-02-24T07:52:45.824086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.824086+0000","objects_scrubbed":5688,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:04.551887+0000","scrub_duration":1745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389488640,"num_objects":5944,"num_object_clones":0,"num_object_copies":17832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59443,"num_write_kb":464968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"76'57950","reported_seq":58074,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.809140+0000","last_change":"2026-02-24T07:53:02.870979+0000","last_active":"2026-02-24T07:53:07.809140+0000","last_peered":"2026-02-24T07:53:07.809140+0000","last_clean":"2026-02-24T07:53:07.809140+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:53:07.809140+0000","last_undegraded":"2026-02-24T07:53:07.809140+0000","last_fullsized":"2026-02-24T07:53:07.809140+0000","mapping_epoch":57,"log_start":"76'57942","ondisk_log_start":"76'57942","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'55512","last_scrub_stamp":"2026-02-24T07:53:02.870902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:02.870902+0000","objects_scrubbed":6887,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:14.871226+0000","scrub_duration":1332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379912192,"num_objects":5797,"num_object_clones":0,"num_object_copies":17391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57950,"num_write_kb":453312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"76'57461","reported_seq":57563,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:07.816562+0000","last_change":"2026-02-24T07:52:41.154511+0000","last_active":"2026-02-24T07:53:07.816562+0000","last_peered":"2026-02-24T07:53:07.816562+0000","last_clean":"2026-02-24T07:53:07.816562+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:53:07.816562+0000","last_undegraded":"2026-02-24T07:53:07.816562+0000","last_fullsized":"2026-02-24T07:53:07.816562+0000","mapping_epoch":57,"log_start":"76'57445","ondisk_log_start":"76'57445","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'42242","last_scrub_stamp":"2026-02-24T07:52:41.154472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:41.154472+0000","objects_scrubbed":5238,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:09.371415+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375390208,"num_objects":5728,"num_object_clones":0,"num_object_copies":17184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57461,"num_write_kb":449344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":324,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:52:59.829389+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:52:59.829389+0000","last_peered":"2026-02-24T07:52:59.829389+0000","last_clean":"2026-02-24T07:52:59.829389+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:59.829389+0000","last_undegraded":"2026-02-24T07:52:59.829389+0000","last_fullsized":"2026-02-24T07:52:59.829389+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6088564760,"num_objects":92906,"num_object_clones":0,"num_object_copies":278718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92906,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":937607,"num_write_kb":7328073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18274881536,"data_stored":18274869320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6387084,"kb_used_data":4926520,"kb_used_omap":16,"kb_used_meta":1460527,"kb_avail":727616116,"statfs":{"total":751619276800,"available":745078902784,"internally_reserved":0,"allocated":5044756480,"data_stored":5044220046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16643,"internal_metadata":1495580413},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7106380,"kb_used_data":5745400,"kb_used_omap":12,"kb_used_meta":1360947,"kb_avail":726896820,"statfs":{"total":751619276800,"available":744342343680,"internally_reserved":0,"allocated":5883289600,"data_stored":5882753166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12643,"internal_metadata":1393610397},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,3,4,11,12],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5664636,"kb_used_data":3821608,"kb_used_omap":22,"kb_used_meta":1842985,"kb_avail":728338564,"statfs":{"total":751619276800,"available":745818689536,"internally_reserved":0,"allocated":3913326592,"data_stored":3912797782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22702,"internal_metadata":1887217490},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705749,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5608204,"kb_used_data":4629688,"kb_used_omap":8,"kb_used_meta":978487,"kb_avail":728394996,"statfs":{"total":751619276800,"available":745876475904,"internally_reserved":0,"allocated":4740800512,"data_stored":4740264078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8737,"internal_metadata":1001971167},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4570427392,"data_stored":4570423320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3754557440,"data_stored":3754557440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5361577984,"data_stored":5361573912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4588318720,"data_stored":4588314648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:11.166 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:11.166 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 141 2026-02-24T07:53:11.316 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:11.456 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:11.453+0000 7fa11576c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.457 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:11.454+0000 7fa11576c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.500 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:11.610 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:11.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:11.656 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:11.785 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:11.783+0000 7f8a437fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.786 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:11.784+0000 7f8a437fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:11.805 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:11.805 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:11.820 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:11.820 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:11.925 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:11.925 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:11.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/122715662' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "141"} : dispatch 2026-02-24T07:53:11.925 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3391896474' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:11.950 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:11.950 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:12 trial016 ceph-mon[39544]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:12 trial016 ceph-mon[39544]: pgmap v243: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 46 MiB/s wr, 7.69k op/s 2026-02-24T07:53:13.994 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:14.150 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:14.546 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:14.486+0000 7ff9bf4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:14.546 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:14.486+0000 7ff9bf4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:14.546 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:14.546 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:14.547 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:14.547 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:14.557 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:14.557 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:14.578 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:14.578 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:15.040 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:15.040 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:14 trial016 ceph-mon[39544]: pgmap v244: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 46 MiB/s wr, 12.21k op/s 2026-02-24T07:53:15.040 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/50694056' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:16.555 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 114502 objects 2026-02-24T07:53:16.555 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :10.6032 2026-02-24T07:53:16.655 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:16.655 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:16.655 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-24T07:53:16.655 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:16.777 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:17.010 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:16 trial016 ceph-mon[39544]: pgmap v245: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 7.94k op/s 2026-02-24T07:53:17.065 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:17.222 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.166+0000 7f2761b6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:17.222 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.166+0000 7f2761b6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:17.239 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:17.284 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:17.285 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:17.732 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2026-02-24T07:53:15.791638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2516591160,"num_objects":38395,"num_object_clones":0,"num_object_copies":115185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38395,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":992255,"num_write_kb":7330223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13789856,"kb_used_data":8760208,"kb_used_omap":43,"kb_used_meta":5029396,"kb_avail":2922222944,"statfs":{"total":3006477107200,"available":2992356294656,"internally_reserved":0,"allocated":8970452992,"data_stored":8968314880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44141,"internal_metadata":5150102419},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,4,19,16,40,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4830732264,"num_objects":-73710,"num_object_clones":0,"num_object_copies":-221130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-73710,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":95302,"num_write_kb":153529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"4.f","version":"76'62890","reported_seq":63005,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.960303+0000","last_change":"2026-02-24T07:52:47.724652+0000","last_active":"2026-02-24T07:53:12.960303+0000","last_peered":"2026-02-24T07:53:12.960303+0000","last_clean":"2026-02-24T07:53:12.960303+0000","last_became_active":"2026-02-24T07:51:33.852895+0000","last_became_peered":"2026-02-24T07:51:33.852895+0000","last_unstale":"2026-02-24T07:53:12.960303+0000","last_undegraded":"2026-02-24T07:53:12.960303+0000","last_fullsized":"2026-02-24T07:53:12.960303+0000","mapping_epoch":57,"log_start":"76'62887","ondisk_log_start":"76'62887","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47257","last_scrub_stamp":"2026-02-24T07:52:47.724211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:47.724211+0000","objects_scrubbed":5858,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:57.355345+0000","scrub_duration":1169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153485312,"num_objects":2342,"num_object_clones":0,"num_object_copies":7026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62890,"num_write_kb":463872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'63080","reported_seq":63186,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.810298+0000","last_change":"2026-02-24T07:52:49.116084+0000","last_active":"2026-02-24T07:53:12.810298+0000","last_peered":"2026-02-24T07:53:12.810298+0000","last_clean":"2026-02-24T07:53:12.810298+0000","last_became_active":"2026-02-24T07:51:33.851931+0000","last_became_peered":"2026-02-24T07:51:33.851931+0000","last_unstale":"2026-02-24T07:53:12.810298+0000","last_undegraded":"2026-02-24T07:53:12.810298+0000","last_fullsized":"2026-02-24T07:53:12.810298+0000","mapping_epoch":57,"log_start":"76'63067","ondisk_log_start":"76'63067","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48600","last_scrub_stamp":"2026-02-24T07:52:49.115996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:49.115996+0000","objects_scrubbed":6036,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:03.308538+0000","scrub_duration":1074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157548544,"num_objects":2404,"num_object_clones":0,"num_object_copies":7212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63080,"num_write_kb":465664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'60905","reported_seq":61009,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.801950+0000","last_change":"2026-02-24T07:52:36.414034+0000","last_active":"2026-02-24T07:53:12.801950+0000","last_peered":"2026-02-24T07:53:12.801950+0000","last_clean":"2026-02-24T07:53:12.801950+0000","last_became_active":"2026-02-24T07:51:33.853785+0000","last_became_peered":"2026-02-24T07:51:33.853785+0000","last_unstale":"2026-02-24T07:53:12.801950+0000","last_undegraded":"2026-02-24T07:53:12.801950+0000","last_fullsized":"2026-02-24T07:53:12.801950+0000","mapping_epoch":57,"log_start":"76'60896","ondisk_log_start":"76'60896","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39504","last_scrub_stamp":"2026-02-24T07:52:36.413929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:36.413929+0000","objects_scrubbed":4896,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:51.499137+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156237848,"num_objects":2385,"num_object_clones":0,"num_object_copies":7155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60905,"num_write_kb":450049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"76'62123","reported_seq":62249,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.800915+0000","last_change":"2026-02-24T07:53:04.871752+0000","last_active":"2026-02-24T07:53:12.800915+0000","last_peered":"2026-02-24T07:53:12.800915+0000","last_clean":"2026-02-24T07:53:12.800915+0000","last_became_active":"2026-02-24T07:51:33.854349+0000","last_became_peered":"2026-02-24T07:51:33.854349+0000","last_unstale":"2026-02-24T07:53:12.800915+0000","last_undegraded":"2026-02-24T07:53:12.800915+0000","last_fullsized":"2026-02-24T07:53:12.800915+0000","mapping_epoch":57,"log_start":"76'62119","ondisk_log_start":"76'62119","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'57376","last_scrub_stamp":"2026-02-24T07:53:04.871720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:04.871720+0000","objects_scrubbed":7107,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:34.839138+0000","scrub_duration":1834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161284096,"num_objects":2461,"num_object_clones":0,"num_object_copies":7383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62123,"num_write_kb":459264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"76'62078","reported_seq":62188,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.809430+0000","last_change":"2026-02-24T07:52:45.288658+0000","last_active":"2026-02-24T07:53:12.809430+0000","last_peered":"2026-02-24T07:53:12.809430+0000","last_clean":"2026-02-24T07:53:12.809430+0000","last_became_active":"2026-02-24T07:51:33.852915+0000","last_became_peered":"2026-02-24T07:51:33.852915+0000","last_unstale":"2026-02-24T07:53:12.809430+0000","last_undegraded":"2026-02-24T07:53:12.809430+0000","last_fullsized":"2026-02-24T07:53:12.809430+0000","mapping_epoch":57,"log_start":"76'62074","ondisk_log_start":"76'62074","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45488","last_scrub_stamp":"2026-02-24T07:52:45.288598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.288598+0000","objects_scrubbed":5633,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:02.213552+0000","scrub_duration":1812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156565504,"num_objects":2389,"num_object_clones":0,"num_object_copies":7167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62078,"num_write_kb":458432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'61762","reported_seq":61859,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.809970+0000","last_change":"2026-02-24T07:52:38.032050+0000","last_active":"2026-02-24T07:53:12.809970+0000","last_peered":"2026-02-24T07:53:12.809970+0000","last_clean":"2026-02-24T07:53:12.809970+0000","last_became_active":"2026-02-24T07:51:33.852064+0000","last_became_peered":"2026-02-24T07:51:33.852064+0000","last_unstale":"2026-02-24T07:53:12.809970+0000","last_undegraded":"2026-02-24T07:53:12.809970+0000","last_fullsized":"2026-02-24T07:53:12.809970+0000","mapping_epoch":57,"log_start":"76'61746","ondisk_log_start":"76'61746","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'40834","last_scrub_stamp":"2026-02-24T07:52:38.031998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:38.031998+0000","objects_scrubbed":5063,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:48.787159+0000","scrub_duration":1134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160169984,"num_objects":2444,"num_object_clones":0,"num_object_copies":7332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61762,"num_write_kb":456576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'62089","reported_seq":62205,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.804212+0000","last_change":"2026-02-24T07:52:56.604640+0000","last_active":"2026-02-24T07:53:12.804212+0000","last_peered":"2026-02-24T07:53:12.804212+0000","last_clean":"2026-02-24T07:53:12.804212+0000","last_became_active":"2026-02-24T07:51:33.852221+0000","last_became_peered":"2026-02-24T07:51:33.852221+0000","last_unstale":"2026-02-24T07:53:12.804212+0000","last_undegraded":"2026-02-24T07:53:12.804212+0000","last_fullsized":"2026-02-24T07:53:12.804212+0000","mapping_epoch":57,"log_start":"76'62079","ondisk_log_start":"76'62079","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'52480","last_scrub_stamp":"2026-02-24T07:52:56.604568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:56.604568+0000","objects_scrubbed":6510,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:17.917474+0000","scrub_duration":1591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157614080,"num_objects":2405,"num_object_clones":0,"num_object_copies":7215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62089,"num_write_kb":458624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'62843","reported_seq":62969,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.801216+0000","last_change":"2026-02-24T07:53:02.633428+0000","last_active":"2026-02-24T07:53:12.801216+0000","last_peered":"2026-02-24T07:53:12.801216+0000","last_clean":"2026-02-24T07:53:12.801216+0000","last_became_active":"2026-02-24T07:51:33.853703+0000","last_became_peered":"2026-02-24T07:51:33.853703+0000","last_unstale":"2026-02-24T07:53:12.801216+0000","last_undegraded":"2026-02-24T07:53:12.801216+0000","last_fullsized":"2026-02-24T07:53:12.801216+0000","mapping_epoch":57,"log_start":"76'62840","ondisk_log_start":"76'62840","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'56712","last_scrub_stamp":"2026-02-24T07:53:02.633376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:02.633376+0000","objects_scrubbed":7029,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:15.245724+0000","scrub_duration":1653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158334976,"num_objects":2416,"num_object_clones":0,"num_object_copies":7248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62843,"num_write_kb":464064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"76'61806","reported_seq":61922,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.955108+0000","last_change":"2026-02-24T07:52:48.299843+0000","last_active":"2026-02-24T07:53:12.955108+0000","last_peered":"2026-02-24T07:53:12.955108+0000","last_clean":"2026-02-24T07:53:12.955108+0000","last_became_active":"2026-02-24T07:51:33.853223+0000","last_became_peered":"2026-02-24T07:51:33.853223+0000","last_unstale":"2026-02-24T07:53:12.955108+0000","last_undegraded":"2026-02-24T07:53:12.955108+0000","last_fullsized":"2026-02-24T07:53:12.955108+0000","mapping_epoch":57,"log_start":"76'61803","ondisk_log_start":"76'61803","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'47112","last_scrub_stamp":"2026-02-24T07:52:48.299795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:48.299795+0000","objects_scrubbed":5864,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:55.078867+0000","scrub_duration":732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154927104,"num_objects":2364,"num_object_clones":0,"num_object_copies":7092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61806,"num_write_kb":456320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'62863","reported_seq":62990,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.809450+0000","last_change":"2026-02-24T07:53:08.859655+0000","last_active":"2026-02-24T07:53:12.809450+0000","last_peered":"2026-02-24T07:53:12.809450+0000","last_clean":"2026-02-24T07:53:12.809450+0000","last_became_active":"2026-02-24T07:51:33.852705+0000","last_became_peered":"2026-02-24T07:51:33.852705+0000","last_unstale":"2026-02-24T07:53:12.809450+0000","last_undegraded":"2026-02-24T07:53:12.809450+0000","last_fullsized":"2026-02-24T07:53:12.809450+0000","mapping_epoch":57,"log_start":"76'62851","ondisk_log_start":"76'62851","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'60141","last_scrub_stamp":"2026-02-24T07:53:08.859612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:08.859612+0000","objects_scrubbed":5910,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.527398+0000","scrub_duration":2334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158203904,"num_objects":2414,"num_object_clones":0,"num_object_copies":7242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62863,"num_write_kb":464192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'60996","reported_seq":61111,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.957794+0000","last_change":"2026-02-24T07:52:55.375256+0000","last_active":"2026-02-24T07:53:12.957794+0000","last_peered":"2026-02-24T07:53:12.957794+0000","last_clean":"2026-02-24T07:53:12.957794+0000","last_became_active":"2026-02-24T07:51:33.852735+0000","last_became_peered":"2026-02-24T07:51:33.852735+0000","last_unstale":"2026-02-24T07:53:12.957794+0000","last_undegraded":"2026-02-24T07:53:12.957794+0000","last_fullsized":"2026-02-24T07:53:12.957794+0000","mapping_epoch":57,"log_start":"76'60991","ondisk_log_start":"76'60991","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'50392","last_scrub_stamp":"2026-02-24T07:52:55.375207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:55.375207+0000","objects_scrubbed":6207,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:05.319148+0000","scrub_duration":1820,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153157632,"num_objects":2337,"num_object_clones":0,"num_object_copies":7011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60996,"num_write_kb":450368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"76'61843","reported_seq":61968,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.809836+0000","last_change":"2026-02-24T07:53:05.193299+0000","last_active":"2026-02-24T07:53:12.809836+0000","last_peered":"2026-02-24T07:53:12.809836+0000","last_clean":"2026-02-24T07:53:12.809836+0000","last_became_active":"2026-02-24T07:51:33.852536+0000","last_became_peered":"2026-02-24T07:51:33.852536+0000","last_unstale":"2026-02-24T07:53:12.809836+0000","last_undegraded":"2026-02-24T07:53:12.809836+0000","last_fullsized":"2026-02-24T07:53:12.809836+0000","mapping_epoch":57,"log_start":"76'61833","ondisk_log_start":"76'61833","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'57144","last_scrub_stamp":"2026-02-24T07:53:05.193234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:05.193234+0000","objects_scrubbed":7140,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:25.629953+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160169984,"num_objects":2444,"num_object_clones":0,"num_object_copies":7332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61843,"num_write_kb":457152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"76'61753","reported_seq":61881,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.954979+0000","last_change":"2026-02-24T07:53:04.243045+0000","last_active":"2026-02-24T07:53:12.954979+0000","last_peered":"2026-02-24T07:53:12.954979+0000","last_clean":"2026-02-24T07:53:12.954979+0000","last_became_active":"2026-02-24T07:51:33.852382+0000","last_became_peered":"2026-02-24T07:51:33.852382+0000","last_unstale":"2026-02-24T07:53:12.954979+0000","last_undegraded":"2026-02-24T07:53:12.954979+0000","last_fullsized":"2026-02-24T07:53:12.954979+0000","mapping_epoch":57,"log_start":"76'61750","ondisk_log_start":"76'61750","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'56544","last_scrub_stamp":"2026-02-24T07:53:04.242887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:04.242887+0000","objects_scrubbed":7000,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.160943+0000","scrub_duration":1634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154271744,"num_objects":2354,"num_object_clones":0,"num_object_copies":7062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61753,"num_write_kb":455872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"76'62896","reported_seq":63003,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.808698+0000","last_change":"2026-02-24T07:52:45.824175+0000","last_active":"2026-02-24T07:53:12.808698+0000","last_peered":"2026-02-24T07:53:12.808698+0000","last_clean":"2026-02-24T07:53:12.808698+0000","last_became_active":"2026-02-24T07:51:33.852317+0000","last_became_peered":"2026-02-24T07:51:33.852317+0000","last_unstale":"2026-02-24T07:53:12.808698+0000","last_undegraded":"2026-02-24T07:53:12.808698+0000","last_fullsized":"2026-02-24T07:53:12.808698+0000","mapping_epoch":57,"log_start":"76'62889","ondisk_log_start":"76'62889","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'46040","last_scrub_stamp":"2026-02-24T07:52:45.824086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:45.824086+0000","objects_scrubbed":5688,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:04.551887+0000","scrub_duration":1745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163192832,"num_objects":2491,"num_object_clones":0,"num_object_copies":7473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62896,"num_write_kb":464968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"76'61357","reported_seq":61481,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.809538+0000","last_change":"2026-02-24T07:53:02.870979+0000","last_active":"2026-02-24T07:53:12.809538+0000","last_peered":"2026-02-24T07:53:12.809538+0000","last_clean":"2026-02-24T07:53:12.809538+0000","last_became_active":"2026-02-24T07:51:33.852372+0000","last_became_peered":"2026-02-24T07:51:33.852372+0000","last_unstale":"2026-02-24T07:53:12.809538+0000","last_undegraded":"2026-02-24T07:53:12.809538+0000","last_fullsized":"2026-02-24T07:53:12.809538+0000","mapping_epoch":57,"log_start":"76'61354","ondisk_log_start":"76'61354","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'55512","last_scrub_stamp":"2026-02-24T07:53:02.870902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:53:02.870902+0000","objects_scrubbed":6887,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:14.871226+0000","scrub_duration":1332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156631040,"num_objects":2390,"num_object_clones":0,"num_object_copies":7170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61357,"num_write_kb":453312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"76'60836","reported_seq":60944,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:53:12.801279+0000","last_change":"2026-02-24T07:52:41.154511+0000","last_active":"2026-02-24T07:53:12.801279+0000","last_peered":"2026-02-24T07:53:12.801279+0000","last_clean":"2026-02-24T07:53:12.801279+0000","last_became_active":"2026-02-24T07:51:33.854288+0000","last_became_peered":"2026-02-24T07:51:33.854288+0000","last_unstale":"2026-02-24T07:53:12.801279+0000","last_undegraded":"2026-02-24T07:53:12.801279+0000","last_fullsized":"2026-02-24T07:53:12.801279+0000","mapping_epoch":57,"log_start":"76'60821","ondisk_log_start":"76'60821","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'42242","last_scrub_stamp":"2026-02-24T07:52:41.154472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:51:32.839332+0000","last_clean_scrub_stamp":"2026-02-24T07:52:41.154472+0000","objects_scrubbed":5238,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:09.371415+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154206208,"num_objects":2353,"num_object_clones":0,"num_object_copies":7059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60836,"num_write_kb":449344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":324,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-24T07:52:59.829389+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:52:59.829389+0000","last_peered":"2026-02-24T07:52:59.829389+0000","last_clean":"2026-02-24T07:52:59.829389+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:52:59.829389+0000","last_undegraded":"2026-02-24T07:52:59.829389+0000","last_fullsized":"2026-02-24T07:52:59.829389+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2516000792,"num_objects":38393,"num_object_clones":0,"num_object_copies":115179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38393,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":992120,"num_write_kb":7328073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7550111744,"data_stored":7550099528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3890700,"kb_used_data":2375928,"kb_used_omap":16,"kb_used_meta":1514671,"kb_avail":730112500,"statfs":{"total":751619276800,"available":747635200000,"internally_reserved":0,"allocated":2432950272,"data_stored":2432413838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16643,"internal_metadata":1551023869},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,10,16,25,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4174156,"kb_used_data":2759032,"kb_used_omap":12,"kb_used_meta":1415091,"kb_avail":729829044,"statfs":{"total":751619276800,"available":747344941056,"internally_reserved":0,"allocated":2825248768,"data_stored":2824712334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12643,"internal_metadata":1449053853},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2726204,"kb_used_data":1641128,"kb_used_omap":5,"kb_used_meta":1085050,"kb_avail":731276996,"statfs":{"total":751619276800,"available":748827643904,"internally_reserved":0,"allocated":1680515072,"data_stored":1679986262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6118,"internal_metadata":1111091226},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2998796,"kb_used_data":1984120,"kb_used_omap":8,"kb_used_meta":1014583,"kb_avail":731004404,"statfs":{"total":751619276800,"available":748548509696,"internally_reserved":0,"allocated":2031738880,"data_stored":2031202446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8737,"internal_metadata":1038933471},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,9,0,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12121,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1895378944,"data_stored":1895374872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1526923264,"data_stored":1526923264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2223255552,"data_stored":2223251480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1904553984,"data_stored":1904549912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:17.733 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 36 2026-02-24T07:53:17.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.780+0000 7f7c307e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:17.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.780+0000 7f7c307e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:17.795 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:17.796 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:17.806 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:17.806 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:17.817 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:17.817 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:17.827 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:17.827 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:17.850 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:17.949 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.947+0000 7f7df8789640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:17.950 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:17.947+0000 7f7df8789640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:18.060 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:53:18.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1925446139' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:18.615 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-24T07:53:18.616 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-24T07:53:18.734 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:18.835 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:18.832+0000 7f5ca1542640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:18.836 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:18.833+0000 7f5ca1542640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:18 trial016 ceph-mon[39544]: from='client.14956 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:19.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:18 trial016 ceph-mon[39544]: pgmap v246: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 7.94k op/s 2026-02-24T07:53:19.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3161670081' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "36"} : dispatch 2026-02-24T07:53:19.857 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_2' removed 2026-02-24T07:53:19.869 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:19.924 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:53:19.925 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:53:19.925 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-24T07:53:19.925 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_3 16 2026-02-24T07:53:19.998 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:20.042 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:20.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:20.099+0000 7f7d66580640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:20.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:20.100+0000 7f7d66580640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:20.112 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4244755107' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:53:20.114 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:20.115 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:20.125 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:20.125 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:20.137 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:20.137 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:20.146 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:20.144+0000 7f69be08e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:20.146 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:20.144+0000 7f69be08e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:20.148 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:20.148 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:20.863 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_3' created 2026-02-24T07:53:20.902 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-24T07:53:21.018 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:21.129 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:21.127+0000 7fb15932c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:21.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:20 trial016 ceph-mon[39544]: pgmap v247: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 11.14k op/s 2026-02-24T07:53:21.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4244755107' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:53:21.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:20 trial016 ceph-mon[39544]: osdmap e77: 4 total, 4 up, 4 in 2026-02-24T07:53:21.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/817466530' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:21.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1859193004' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16} : dispatch 2026-02-24T07:53:21.131 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:21.127+0000 7fb15932c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:21.864 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-24T07:53:22.185 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:22.209 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1859193004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2026-02-24T07:53:22.209 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:21 trial016 ceph-mon[39544]: osdmap e78: 4 total, 4 up, 4 in 2026-02-24T07:53:22.210 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2128413399' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:53:22.301 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:22.399 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:22.396+0000 7f5232bc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:22.399 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:22.397+0000 7f5232bc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:22.411 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:22.411 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:22.422 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:22.422 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:22.433 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:22.433 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:22.444 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:22.445 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:22.907 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2026-02-24T07:53:22.909 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:53:22.909 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:53:22.959 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:53:22.959 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:53:22.959 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_114874 2026-02-24T07:53:22.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:53:22.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:53:23.093 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:23.094 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:23.094 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:53:23.094 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:23.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:22 trial016 ceph-mon[39544]: pgmap v250: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:53:23.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2128413399' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:53:23.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:22 trial016 ceph-mon[39544]: osdmap e79: 4 total, 4 up, 4 in 2026-02-24T07:53:23.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2361666237' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:23.240 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:23.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:23.362+0000 7fc0e2d3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:23.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:23.362+0000 7fc0e2d3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:23.509 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:23.510 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:23.555 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2026-02-24T07:53:22.866683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":45,"acting":45,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5215080,"kb_used_data":5080,"kb_used_omap":52,"kb_used_meta":5209867,"kb_avail":2930797720,"statfs":{"total":3006477107200,"available":3001136865280,"internally_reserved":0,"allocated":5201920,"data_stored":3007276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53251,"internal_metadata":5334904829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2516000792,"num_objects":-38393,"num_object_clones":0,"num_object_copies":-115179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-38393,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-992120,"num_write_kb":-7328073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.074851"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869513+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:21.869513+0000","last_peered":"2026-02-24T07:53:21.869513+0000","last_clean":"2026-02-24T07:53:21.869513+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:21.869513+0000","last_undegraded":"2026-02-24T07:53:21.869513+0000","last_fullsized":"2026-02-24T07:53:21.869513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:34.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871398+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:21.871398+0000","last_peered":"2026-02-24T07:53:21.871398+0000","last_clean":"2026-02-24T07:53:21.871398+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:21.871398+0000","last_undegraded":"2026-02-24T07:53:21.871398+0000","last_fullsized":"2026-02-24T07:53:21.871398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.693183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868953+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:21.868953+0000","last_peered":"2026-02-24T07:53:21.868953+0000","last_clean":"2026-02-24T07:53:21.868953+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:21.868953+0000","last_undegraded":"2026-02-24T07:53:21.868953+0000","last_fullsized":"2026-02-24T07:53:21.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.004544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:53:20.856837+0000","last_change":"2026-02-24T07:53:20.856837+0000","last_active":"2026-02-24T07:53:20.856837+0000","last_peered":"2026-02-24T07:53:20.856837+0000","last_clean":"2026-02-24T07:53:20.856837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:53:20.856837+0000","last_undegraded":"2026-02-24T07:53:20.856837+0000","last_fullsized":"2026-02-24T07:53:20.856837+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869046+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:21.869046+0000","last_peered":"2026-02-24T07:53:21.869046+0000","last_clean":"2026-02-24T07:53:21.869046+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:21.869046+0000","last_undegraded":"2026-02-24T07:53:21.869046+0000","last_fullsized":"2026-02-24T07:53:21.869046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.676463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869443+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:21.869443+0000","last_peered":"2026-02-24T07:53:21.869443+0000","last_clean":"2026-02-24T07:53:21.869443+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:21.869443+0000","last_undegraded":"2026-02-24T07:53:21.869443+0000","last_fullsized":"2026-02-24T07:53:21.869443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:27.034875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871453+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:21.871453+0000","last_peered":"2026-02-24T07:53:21.871453+0000","last_clean":"2026-02-24T07:53:21.871453+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:21.871453+0000","last_undegraded":"2026-02-24T07:53:21.871453+0000","last_fullsized":"2026-02-24T07:53:21.871453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:41.638991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869185+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:21.869185+0000","last_peered":"2026-02-24T07:53:21.869185+0000","last_clean":"2026-02-24T07:53:21.869185+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:21.869185+0000","last_undegraded":"2026-02-24T07:53:21.869185+0000","last_fullsized":"2026-02-24T07:53:21.869185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:42.089040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871448+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:21.871448+0000","last_peered":"2026-02-24T07:53:21.871448+0000","last_clean":"2026-02-24T07:53:21.871448+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:21.871448+0000","last_undegraded":"2026-02-24T07:53:21.871448+0000","last_fullsized":"2026-02-24T07:53:21.871448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:53:20.856837+0000","last_change":"2026-02-24T07:53:20.856837+0000","last_active":"2026-02-24T07:53:20.856837+0000","last_peered":"2026-02-24T07:53:20.856837+0000","last_clean":"2026-02-24T07:53:20.856837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:53:20.856837+0000","last_undegraded":"2026-02-24T07:53:20.856837+0000","last_fullsized":"2026-02-24T07:53:20.856837+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869047+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:21.869047+0000","last_peered":"2026-02-24T07:53:21.869047+0000","last_clean":"2026-02-24T07:53:21.869047+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:21.869047+0000","last_undegraded":"2026-02-24T07:53:21.869047+0000","last_fullsized":"2026-02-24T07:53:21.869047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.936173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868973+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:21.868973+0000","last_peered":"2026-02-24T07:53:21.868973+0000","last_clean":"2026-02-24T07:53:21.868973+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:21.868973+0000","last_undegraded":"2026-02-24T07:53:21.868973+0000","last_fullsized":"2026-02-24T07:53:21.868973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.777652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871238+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:21.871238+0000","last_peered":"2026-02-24T07:53:21.871238+0000","last_clean":"2026-02-24T07:53:21.871238+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:21.871238+0000","last_undegraded":"2026-02-24T07:53:21.871238+0000","last_fullsized":"2026-02-24T07:53:21.871238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:25.531319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871461+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:21.871461+0000","last_peered":"2026-02-24T07:53:21.871461+0000","last_clean":"2026-02-24T07:53:21.871461+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:21.871461+0000","last_undegraded":"2026-02-24T07:53:21.871461+0000","last_fullsized":"2026-02-24T07:53:21.871461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.338924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868917+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:21.868917+0000","last_peered":"2026-02-24T07:53:21.868917+0000","last_clean":"2026-02-24T07:53:21.868917+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:21.868917+0000","last_undegraded":"2026-02-24T07:53:21.868917+0000","last_fullsized":"2026-02-24T07:53:21.868917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:21.700808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868344+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:21.868344+0000","last_peered":"2026-02-24T07:53:21.868344+0000","last_clean":"2026-02-24T07:53:21.868344+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:21.868344+0000","last_undegraded":"2026-02-24T07:53:21.868344+0000","last_fullsized":"2026-02-24T07:53:21.868344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:30.530259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.866798+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:21.866798+0000","last_peered":"2026-02-24T07:53:21.866798+0000","last_clean":"2026-02-24T07:53:21.866798+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:21.866798+0000","last_undegraded":"2026-02-24T07:53:21.866798+0000","last_fullsized":"2026-02-24T07:53:21.866798+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1570276,"kb_used_data":1424,"kb_used_omap":18,"kb_used_meta":1568813,"kb_avail":732432924,"statfs":{"total":751619276800,"available":750011314176,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18581,"internal_metadata":1606465387},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1470692,"kb_used_data":1424,"kb_used_omap":17,"kb_used_meta":1469230,"kb_avail":732532508,"statfs":{"total":751619276800,"available":750113288192,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1504492093},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1103932,"kb_used_data":808,"kb_used_omap":5,"kb_used_meta":1103098,"kb_avail":732899268,"statfs":{"total":751619276800,"available":750488850432,"internally_reserved":0,"allocated":827392,"data_stored":298582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6118,"internal_metadata":1129572378},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1070180,"kb_used_data":1424,"kb_used_omap":10,"kb_used_meta":1068725,"kb_avail":732933020,"statfs":{"total":751619276800,"available":750523412480,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10693,"internal_metadata":1094374971},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12256,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:23.556 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:23.556 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 151 2026-02-24T07:53:23.741 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:23.861 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:23.858+0000 7f4cd35db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:23.861 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:23.858+0000 7f4cd35db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:23.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 8862 8734 68.2289 68.2344 0.0107362 0.0145646 2026-02-24T07:53:24.002 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:24.019 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:23 trial016 ceph-mon[39544]: osdmap e80: 4 total, 4 up, 4 in 2026-02-24T07:53:24.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:24.481 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:24.625 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:24.743 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:24.740+0000 7f04f22d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:24.743 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:24.741+0000 7f04f22d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:24.788 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:24.789 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:24.802 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:24.803 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:24.815 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:24.816 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:24.845 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:24.845 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:24.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 17485 17357 67.7954 67.3672 0.0294941 0.0146419 2026-02-24T07:53:25.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:24 trial016 ceph-mon[39544]: from='client.14975 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:24 trial016 ceph-mon[39544]: pgmap v253: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:53:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/243878360' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "151"} : dispatch 2026-02-24T07:53:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2225690918' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:25.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:25.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 128 26277 26149 68.091 68.6875 0.00571387 0.0146444 2026-02-24T07:53:26.889 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:26.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 35561 35433 69.1996 72.5312 0.0214374 0.0144178 2026-02-24T07:53:27.031 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:27.130 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:26 trial016 ceph-mon[39544]: pgmap v254: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:53:27.454 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:27.410+0000 7f80ac60c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:27.454 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:27.410+0000 7f80ac60c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:27.454 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:27.454 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:27.455 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:27.455 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:27.461 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:27.461 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:27.480 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:27.480 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:27.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 127 42931 42804 66.8759 57.5859 0.0181206 0.0149268 2026-02-24T07:53:28.048 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3764429467' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:28.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 51735 51607 67.1913 68.7734 0.0088882 0.0148619 2026-02-24T07:53:29.044 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:29.045 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:29.045 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:53:29.045 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:29.185 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:29.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:28 trial016 ceph-mon[39544]: pgmap v255: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:53:29.309 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:29.307+0000 7f13a0a8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:29.309 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:29.307+0000 7f13a0a8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:29.452 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:29.452 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:29.498 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2026-02-24T07:53:27.793259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5233164,"kb_used_data":5116,"kb_used_omap":53,"kb_used_meta":5227914,"kb_avail":2930779636,"statfs":{"total":3006477107200,"available":3001118347264,"internally_reserved":0,"allocated":5238784,"data_stored":3021224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55207,"internal_metadata":5353384025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.931627"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869513+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:21.869513+0000","last_peered":"2026-02-24T07:53:21.869513+0000","last_clean":"2026-02-24T07:53:21.869513+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:21.869513+0000","last_undegraded":"2026-02-24T07:53:21.869513+0000","last_fullsized":"2026-02-24T07:53:21.869513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:34.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871398+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:21.871398+0000","last_peered":"2026-02-24T07:53:21.871398+0000","last_clean":"2026-02-24T07:53:21.871398+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:21.871398+0000","last_undegraded":"2026-02-24T07:53:21.871398+0000","last_fullsized":"2026-02-24T07:53:21.871398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.693183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868953+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:21.868953+0000","last_peered":"2026-02-24T07:53:21.868953+0000","last_clean":"2026-02-24T07:53:21.868953+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:21.868953+0000","last_undegraded":"2026-02-24T07:53:21.868953+0000","last_fullsized":"2026-02-24T07:53:21.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.004544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869223+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:21.869223+0000","last_peered":"2026-02-24T07:53:21.869223+0000","last_clean":"2026-02-24T07:53:21.869223+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:21.869223+0000","last_undegraded":"2026-02-24T07:53:21.869223+0000","last_fullsized":"2026-02-24T07:53:21.869223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:47.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869046+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:21.869046+0000","last_peered":"2026-02-24T07:53:21.869046+0000","last_clean":"2026-02-24T07:53:21.869046+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:21.869046+0000","last_undegraded":"2026-02-24T07:53:21.869046+0000","last_fullsized":"2026-02-24T07:53:21.869046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.676463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869443+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:21.869443+0000","last_peered":"2026-02-24T07:53:21.869443+0000","last_clean":"2026-02-24T07:53:21.869443+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:21.869443+0000","last_undegraded":"2026-02-24T07:53:21.869443+0000","last_fullsized":"2026-02-24T07:53:21.869443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:27.034875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871453+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:21.871453+0000","last_peered":"2026-02-24T07:53:21.871453+0000","last_clean":"2026-02-24T07:53:21.871453+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:21.871453+0000","last_undegraded":"2026-02-24T07:53:21.871453+0000","last_fullsized":"2026-02-24T07:53:21.871453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:41.638991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869185+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:21.869185+0000","last_peered":"2026-02-24T07:53:21.869185+0000","last_clean":"2026-02-24T07:53:21.869185+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:21.869185+0000","last_undegraded":"2026-02-24T07:53:21.869185+0000","last_fullsized":"2026-02-24T07:53:21.869185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:42.089040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871448+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:21.871448+0000","last_peered":"2026-02-24T07:53:21.871448+0000","last_clean":"2026-02-24T07:53:21.871448+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:21.871448+0000","last_undegraded":"2026-02-24T07:53:21.871448+0000","last_fullsized":"2026-02-24T07:53:21.871448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.891636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869457+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:21.869457+0000","last_peered":"2026-02-24T07:53:21.869457+0000","last_clean":"2026-02-24T07:53:21.869457+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:21.869457+0000","last_undegraded":"2026-02-24T07:53:21.869457+0000","last_fullsized":"2026-02-24T07:53:21.869457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.620805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.869047+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:21.869047+0000","last_peered":"2026-02-24T07:53:21.869047+0000","last_clean":"2026-02-24T07:53:21.869047+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:21.869047+0000","last_undegraded":"2026-02-24T07:53:21.869047+0000","last_fullsized":"2026-02-24T07:53:21.869047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.936173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868973+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:21.868973+0000","last_peered":"2026-02-24T07:53:21.868973+0000","last_clean":"2026-02-24T07:53:21.868973+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:21.868973+0000","last_undegraded":"2026-02-24T07:53:21.868973+0000","last_fullsized":"2026-02-24T07:53:21.868973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.777652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871238+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:21.871238+0000","last_peered":"2026-02-24T07:53:21.871238+0000","last_clean":"2026-02-24T07:53:21.871238+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:21.871238+0000","last_undegraded":"2026-02-24T07:53:21.871238+0000","last_fullsized":"2026-02-24T07:53:21.871238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:25.531319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.871461+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:21.871461+0000","last_peered":"2026-02-24T07:53:21.871461+0000","last_clean":"2026-02-24T07:53:21.871461+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:21.871461+0000","last_undegraded":"2026-02-24T07:53:21.871461+0000","last_fullsized":"2026-02-24T07:53:21.871461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.338924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868917+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:21.868917+0000","last_peered":"2026-02-24T07:53:21.868917+0000","last_clean":"2026-02-24T07:53:21.868917+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:21.868917+0000","last_undegraded":"2026-02-24T07:53:21.868917+0000","last_fullsized":"2026-02-24T07:53:21.868917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:21.700808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.868344+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:21.868344+0000","last_peered":"2026-02-24T07:53:21.868344+0000","last_clean":"2026-02-24T07:53:21.868344+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:21.868344+0000","last_undegraded":"2026-02-24T07:53:21.868344+0000","last_fullsized":"2026-02-24T07:53:21.868344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:30.530259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T07:53:21.866798+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:21.866798+0000","last_peered":"2026-02-24T07:53:21.866798+0000","last_clean":"2026-02-24T07:53:21.866798+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:21.866798+0000","last_undegraded":"2026-02-24T07:53:21.866798+0000","last_fullsized":"2026-02-24T07:53:21.866798+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1570276,"kb_used_data":1424,"kb_used_omap":18,"kb_used_meta":1568813,"kb_avail":732432924,"statfs":{"total":751619276800,"available":750011314176,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18581,"internal_metadata":1606465387},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1470692,"kb_used_data":1424,"kb_used_omap":17,"kb_used_meta":1469230,"kb_avail":732532508,"statfs":{"total":751619276800,"available":750113288192,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1504492093},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1122016,"kb_used_data":844,"kb_used_omap":7,"kb_used_meta":1121144,"kb_avail":732881184,"statfs":{"total":751619276800,"available":750470332416,"internally_reserved":0,"allocated":864256,"data_stored":312530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8074,"internal_metadata":1148051574},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1070180,"kb_used_data":1424,"kb_used_omap":10,"kb_used_meta":1068725,"kb_avail":732933020,"statfs":{"total":751619276800,"available":750523412480,"internally_reserved":0,"allocated":1458176,"data_stored":902898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10693,"internal_metadata":1094374971},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12256,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:29.499 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:29.499 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 26 2026-02-24T07:53:29.636 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:29.766 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:29.764+0000 7f5371482640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:29.767 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:29.764+0000 7f5371482640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:29.915 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:29.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:29.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 127 60287 60160 67.1376 66.8203 0.0154583 0.0148731 2026-02-24T07:53:30.073 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:30.221 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:30.345 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:30.342+0000 7f763253d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:30.345 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:30.342+0000 7f763253d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:30.385 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:30.386 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:30.398 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:30.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:30.412 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:30.412 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:30.438 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:30.438 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:30.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 68464 68336 66.7292 63.875 0.0166897 0.0149705 2026-02-24T07:53:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:30 trial016 ceph-mon[39544]: from='client.14983 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:30 trial016 ceph-mon[39544]: pgmap v256: 17 pgs: 17 active+clean; 328 MiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 41 MiB/s wr, 5.24k op/s 2026-02-24T07:53:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1833386892' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:53:31.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2434253443' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:31.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 77572 77444 67.2205 71.1562 0.00364678 0.0148626 2026-02-24T07:53:32.482 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:32.633 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:32.767 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:32.763+0000 7f8143d2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:32.767 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:32.764+0000 7f8143d2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:32.796 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:32.796 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:32.809 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:32.810 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:32.825 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:32.825 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:32.851 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:32.852 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:32.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 127 87017 86890 67.8776 73.7969 0.0229582 0.0147217 2026-02-24T07:53:33.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:32 trial016 ceph-mon[39544]: pgmap v257: 17 pgs: 17 active+clean; 328 MiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.22k op/s 2026-02-24T07:53:33.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2196084969' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:33.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 95406 95278 67.6638 65.5312 0.0245734 0.0147606 2026-02-24T07:53:34.895 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:34.953 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:34.953 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:34.953 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:53:34.953 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:34.960 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 103879 103751 67.5411 66.1953 0.0270467 0.0147894 2026-02-24T07:53:35.043 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:35.097 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:35.146 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:34 trial016 ceph-mon[39544]: pgmap v258: 17 pgs: 17 active+clean; 672 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s wr, 7.86k op/s 2026-02-24T07:53:35.146 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:35.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:35.342+0000 7f236dff1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:35.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:35.343+0000 7f236dff1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:35.392 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:35.392 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:35.396 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:35.396 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:35.408 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:35.408 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:35.427 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:35.427 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:35.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 109714 109586 65.8519 45.5859 0.00320172 0.0151701 2026-02-24T07:53:36.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:36.113+0000 7ff19a9a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:36.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:36.113+0000 7ff19a9a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:36.257 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:36.257 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:36.257 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4162355413' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:36.303 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2026-02-24T07:53:35.794340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":704266784,"num_objects":10741,"num_object_clones":0,"num_object_copies":32223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10741,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":86033,"num_write_kb":689334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7672692,"kb_used_data":1986660,"kb_used_omap":55,"kb_used_meta":5685896,"kb_avail":2928340108,"statfs":{"total":3006477107200,"available":2998620270592,"internally_reserved":0,"allocated":2034339840,"data_stored":2032092104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57169,"internal_metadata":5822357679},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,8,8,0,24,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":703676416,"num_objects":10739,"num_object_clones":0,"num_object_copies":32217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85898,"num_write_kb":687184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001613"},"pg_stats":[{"pgid":"5.f","version":"80'5159","reported_seq":5167,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.800535+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:32.800535+0000","last_peered":"2026-02-24T07:53:32.800535+0000","last_clean":"2026-02-24T07:53:32.800535+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:32.800535+0000","last_undegraded":"2026-02-24T07:53:32.800535+0000","last_fullsized":"2026-02-24T07:53:32.800535+0000","mapping_epoch":78,"log_start":"80'5152","ondisk_log_start":"80'5152","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42262528,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5159,"num_write_kb":41272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'5248","reported_seq":5262,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.767528+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:32.767528+0000","last_peered":"2026-02-24T07:53:32.767528+0000","last_clean":"2026-02-24T07:53:32.767528+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:32.767528+0000","last_undegraded":"2026-02-24T07:53:32.767528+0000","last_fullsized":"2026-02-24T07:53:32.767528+0000","mapping_epoch":78,"log_start":"80'5235","ondisk_log_start":"80'5235","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42991616,"num_objects":656,"num_object_clones":0,"num_object_copies":1968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5248,"num_write_kb":41984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'5552","reported_seq":5566,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.782652+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:32.782652+0000","last_peered":"2026-02-24T07:53:32.782652+0000","last_clean":"2026-02-24T07:53:32.782652+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:32.782652+0000","last_undegraded":"2026-02-24T07:53:32.782652+0000","last_fullsized":"2026-02-24T07:53:32.782652+0000","mapping_epoch":78,"log_start":"80'5544","ondisk_log_start":"80'5544","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5552,"num_write_kb":44416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'5656","reported_seq":5669,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.962568+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:32.962568+0000","last_peered":"2026-02-24T07:53:32.962568+0000","last_clean":"2026-02-24T07:53:32.962568+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:32.962568+0000","last_undegraded":"2026-02-24T07:53:32.962568+0000","last_fullsized":"2026-02-24T07:53:32.962568+0000","mapping_epoch":78,"log_start":"80'5648","ondisk_log_start":"80'5648","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5656,"num_write_kb":45248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'4984","reported_seq":4998,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.780200+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:32.780200+0000","last_peered":"2026-02-24T07:53:32.780200+0000","last_clean":"2026-02-24T07:53:32.780200+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:32.780200+0000","last_undegraded":"2026-02-24T07:53:32.780200+0000","last_fullsized":"2026-02-24T07:53:32.780200+0000","mapping_epoch":78,"log_start":"80'4968","ondisk_log_start":"80'4968","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40828928,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4984,"num_write_kb":39872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'5504","reported_seq":5518,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.809237+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:32.809237+0000","last_peered":"2026-02-24T07:53:32.809237+0000","last_clean":"2026-02-24T07:53:32.809237+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:32.809237+0000","last_undegraded":"2026-02-24T07:53:32.809237+0000","last_fullsized":"2026-02-24T07:53:32.809237+0000","mapping_epoch":78,"log_start":"80'5488","ondisk_log_start":"80'5488","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45088768,"num_objects":688,"num_object_clones":0,"num_object_copies":2064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5504,"num_write_kb":44032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'5436","reported_seq":5448,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.818817+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:32.818817+0000","last_peered":"2026-02-24T07:53:32.818817+0000","last_clean":"2026-02-24T07:53:32.818817+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:32.818817+0000","last_undegraded":"2026-02-24T07:53:32.818817+0000","last_fullsized":"2026-02-24T07:53:32.818817+0000","mapping_epoch":78,"log_start":"80'5432","ondisk_log_start":"80'5432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44531712,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5436,"num_write_kb":43488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'5448","reported_seq":5462,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.806667+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:32.806667+0000","last_peered":"2026-02-24T07:53:32.806667+0000","last_clean":"2026-02-24T07:53:32.806667+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:32.806667+0000","last_undegraded":"2026-02-24T07:53:32.806667+0000","last_fullsized":"2026-02-24T07:53:32.806667+0000","mapping_epoch":78,"log_start":"80'5440","ondisk_log_start":"80'5440","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5448,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'5304","reported_seq":5310,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.820664+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:32.820664+0000","last_peered":"2026-02-24T07:53:32.820664+0000","last_clean":"2026-02-24T07:53:32.820664+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:32.820664+0000","last_undegraded":"2026-02-24T07:53:32.820664+0000","last_fullsized":"2026-02-24T07:53:32.820664+0000","mapping_epoch":78,"log_start":"80'5288","ondisk_log_start":"80'5288","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43450368,"num_objects":663,"num_object_clones":0,"num_object_copies":1989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5304,"num_write_kb":42432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'5120","reported_seq":5128,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.959386+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:32.959386+0000","last_peered":"2026-02-24T07:53:32.959386+0000","last_clean":"2026-02-24T07:53:32.959386+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:32.959386+0000","last_undegraded":"2026-02-24T07:53:32.959386+0000","last_fullsized":"2026-02-24T07:53:32.959386+0000","mapping_epoch":78,"log_start":"80'5112","ondisk_log_start":"80'5112","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":640,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'5488","reported_seq":5502,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.806832+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:32.806832+0000","last_peered":"2026-02-24T07:53:32.806832+0000","last_clean":"2026-02-24T07:53:32.806832+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:32.806832+0000","last_undegraded":"2026-02-24T07:53:32.806832+0000","last_fullsized":"2026-02-24T07:53:32.806832+0000","mapping_epoch":78,"log_start":"80'5471","ondisk_log_start":"80'5471","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":686,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5488,"num_write_kb":43904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'5560","reported_seq":5574,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.808419+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:32.808419+0000","last_peered":"2026-02-24T07:53:32.808419+0000","last_clean":"2026-02-24T07:53:32.808419+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:32.808419+0000","last_undegraded":"2026-02-24T07:53:32.808419+0000","last_fullsized":"2026-02-24T07:53:32.808419+0000","mapping_epoch":78,"log_start":"80'5536","ondisk_log_start":"80'5536","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5560,"num_write_kb":44480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'5608","reported_seq":5601,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.820118+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:32.820118+0000","last_peered":"2026-02-24T07:53:32.820118+0000","last_clean":"2026-02-24T07:53:32.820118+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:32.820118+0000","last_undegraded":"2026-02-24T07:53:32.820118+0000","last_fullsized":"2026-02-24T07:53:32.820118+0000","mapping_epoch":78,"log_start":"80'5584","ondisk_log_start":"80'5584","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45940736,"num_objects":701,"num_object_clones":0,"num_object_copies":2103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5608,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'5304","reported_seq":5301,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.820080+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:32.820080+0000","last_peered":"2026-02-24T07:53:32.820080+0000","last_clean":"2026-02-24T07:53:32.820080+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:32.820080+0000","last_undegraded":"2026-02-24T07:53:32.820080+0000","last_fullsized":"2026-02-24T07:53:32.820080+0000","mapping_epoch":78,"log_start":"80'5280","ondisk_log_start":"80'5280","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43450368,"num_objects":663,"num_object_clones":0,"num_object_copies":1989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5304,"num_write_kb":42432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'5324","reported_seq":5333,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.830304+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:32.830304+0000","last_peered":"2026-02-24T07:53:32.830304+0000","last_clean":"2026-02-24T07:53:32.830304+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:32.830304+0000","last_undegraded":"2026-02-24T07:53:32.830304+0000","last_fullsized":"2026-02-24T07:53:32.830304+0000","mapping_epoch":78,"log_start":"80'5317","ondisk_log_start":"80'5317","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43614208,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5324,"num_write_kb":42592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'5203","reported_seq":5213,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:32.813566+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:32.813566+0000","last_peered":"2026-02-24T07:53:32.813566+0000","last_clean":"2026-02-24T07:53:32.813566+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:32.813566+0000","last_undegraded":"2026-02-24T07:53:32.813566+0000","last_fullsized":"2026-02-24T07:53:32.813566+0000","mapping_epoch":78,"log_start":"80'5196","ondisk_log_start":"80'5196","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42622976,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5203,"num_write_kb":41624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866907+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866907+0000","last_peered":"2026-02-24T07:53:22.866907+0000","last_clean":"2026-02-24T07:53:22.866907+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866907+0000","last_undegraded":"2026-02-24T07:53:22.866907+0000","last_fullsized":"2026-02-24T07:53:22.866907+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":703676416,"num_objects":10739,"num_object_clones":0,"num_object_copies":32217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85898,"num_write_kb":687184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2115338240,"data_stored":2115338240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2300792,"kb_used_data":551460,"kb_used_omap":18,"kb_used_meta":1749293,"kb_avail":731702408,"statfs":{"total":751619276800,"available":749263265792,"internally_reserved":0,"allocated":564695040,"data_stored":564132218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19239,"internal_metadata":1791276249},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1866064,"kb_used_data":462204,"kb_used_omap":17,"kb_used_meta":1403822,"kb_avail":732137136,"statfs":{"total":751619276800,"available":749708427264,"internally_reserved":0,"allocated":473296896,"data_stored":472734074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1437514301},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1713108,"kb_used_data":429504,"kb_used_omap":8,"kb_used_meta":1283575,"kb_avail":732290092,"statfs":{"total":751619276800,"available":749865054208,"internally_reserved":0,"allocated":439812096,"data_stored":439252826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8726,"internal_metadata":1314381290},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1792728,"kb_used_data":543492,"kb_used_omap":11,"kb_used_meta":1249204,"kb_avail":732210472,"statfs":{"total":751619276800,"available":749783523328,"internally_reserved":0,"allocated":556535808,"data_stored":555972986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11345,"internal_metadata":1279185839},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,8,8,0,16,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":574816256,"data_stored":574816256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":445308928,"data_stored":445308928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":481411072,"data_stored":481411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":613801984,"data_stored":613801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:36.304 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:36.305 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 36 2026-02-24T07:53:36.445 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:36.588 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:36.585+0000 7f88c2882640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:36.589 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:36.585+0000 7f88c2882640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:36.733 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:36.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:36.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 127 118466 118339 66.0305 68.3828 0.00343879 0.0151338 2026-02-24T07:53:37.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:36 trial016 ceph-mon[39544]: pgmap v259: 17 pgs: 17 active+clean; 672 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.16k op/s 2026-02-24T07:53:37.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/784166291' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:53:37.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 127251 127123 66.2031 68.625 0.000825301 0.0150894 2026-02-24T07:53:37.995 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:38.143 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:38.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:37 trial016 ceph-mon[39544]: from='client.14993 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:38.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:37 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:53:38.168 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:37 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:53:38.396 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:38.392+0000 7f06a8a53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:38.396 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:38.393+0000 7f06a8a53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:38.421 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:38.421 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:38.436 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:38.436 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:38.448 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:38.473 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:38.473 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:38.474 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:38.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 127 136011 135884 66.3429 68.4453 0.00998987 0.0150622 2026-02-24T07:53:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:38 trial016 ceph-mon[39544]: pgmap v260: 17 pgs: 17 active+clean; 672 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.16k op/s 2026-02-24T07:53:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4117521892' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:39.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 145067 144939 66.6014 70.7422 0.0087047 0.0150072 2026-02-24T07:53:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:39 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:53:40.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:39 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:53:40.525 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:40.675 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:40.799 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:40.795+0000 7f7cd9c96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:40.799 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:40.795+0000 7f7cd9c96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:40.828 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:40.828 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:40.840 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:40.840 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:40.869 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:40.869 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:40.884 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:40.884 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:40.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 128 153494 153366 66.5586 65.8359 0.00222468 0.0150154 2026-02-24T07:53:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:40 trial016 ceph-mon[39544]: pgmap v261: 17 pgs: 17 active+clean; 986 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.51k op/s 2026-02-24T07:53:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1156968211' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:41.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:41.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:41.778 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:53:41.778 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:41.921 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:41.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 128 161842 161714 66.4878 65.2188 0.0169238 0.015033 2026-02-24T07:53:42.046 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:42.042+0000 7fd4ba199640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:42.046 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:42.042+0000 7fd4ba199640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:42.193 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:42.194 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:42.241 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2026-02-24T07:53:41.795140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1034265120,"num_objects":15776,"num_object_clones":0,"num_object_copies":47328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15776,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":126316,"num_write_kb":1011598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8892060,"kb_used_data":2953292,"kb_used_omap":56,"kb_used_meta":5938631,"kb_avail":2927120740,"statfs":{"total":3006477107200,"available":2997371637760,"internally_reserved":0,"allocated":3024171008,"data_stored":3021923272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57821,"internal_metadata":6081158691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,3,1,44,31,42],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":690012160,"num_objects":10530,"num_object_clones":0,"num_object_copies":31590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84230,"num_write_kb":673840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001628"},"pg_stats":[{"pgid":"5.f","version":"80'7792","reported_seq":7806,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.811960+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:37.811960+0000","last_peered":"2026-02-24T07:53:37.811960+0000","last_clean":"2026-02-24T07:53:37.811960+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:37.811960+0000","last_undegraded":"2026-02-24T07:53:37.811960+0000","last_fullsized":"2026-02-24T07:53:37.811960+0000","mapping_epoch":78,"log_start":"80'7785","ondisk_log_start":"80'7785","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7792,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'7946","reported_seq":7958,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.800584+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:37.800584+0000","last_peered":"2026-02-24T07:53:37.800584+0000","last_clean":"2026-02-24T07:53:37.800584+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:37.800584+0000","last_undegraded":"2026-02-24T07:53:37.800584+0000","last_fullsized":"2026-02-24T07:53:37.800584+0000","mapping_epoch":78,"log_start":"80'7939","ondisk_log_start":"80'7939","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65093632,"num_objects":994,"num_object_clones":0,"num_object_copies":2982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7946,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'8184","reported_seq":8198,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.806455+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:37.806455+0000","last_peered":"2026-02-24T07:53:37.806455+0000","last_clean":"2026-02-24T07:53:37.806455+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:37.806455+0000","last_undegraded":"2026-02-24T07:53:37.806455+0000","last_fullsized":"2026-02-24T07:53:37.806455+0000","mapping_epoch":78,"log_start":"80'8144","ondisk_log_start":"80'8144","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8184,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'8240","reported_seq":8254,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.957628+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:37.957628+0000","last_peered":"2026-02-24T07:53:37.957628+0000","last_clean":"2026-02-24T07:53:37.957628+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:37.957628+0000","last_undegraded":"2026-02-24T07:53:37.957628+0000","last_fullsized":"2026-02-24T07:53:37.957628+0000","mapping_epoch":78,"log_start":"80'8232","ondisk_log_start":"80'8232","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67502080,"num_objects":1030,"num_object_clones":0,"num_object_copies":3090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1030,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8240,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'7616","reported_seq":7630,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.783600+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:37.783600+0000","last_peered":"2026-02-24T07:53:37.783600+0000","last_clean":"2026-02-24T07:53:37.783600+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:37.783600+0000","last_undegraded":"2026-02-24T07:53:37.783600+0000","last_fullsized":"2026-02-24T07:53:37.783600+0000","mapping_epoch":78,"log_start":"80'7600","ondisk_log_start":"80'7600","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62390272,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'7792","reported_seq":7806,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.807407+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:37.807407+0000","last_peered":"2026-02-24T07:53:37.807407+0000","last_clean":"2026-02-24T07:53:37.807407+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:37.807407+0000","last_undegraded":"2026-02-24T07:53:37.807407+0000","last_fullsized":"2026-02-24T07:53:37.807407+0000","mapping_epoch":78,"log_start":"80'7784","ondisk_log_start":"80'7784","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7792,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'7984","reported_seq":7998,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.791123+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:37.791123+0000","last_peered":"2026-02-24T07:53:37.791123+0000","last_clean":"2026-02-24T07:53:37.791123+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:37.791123+0000","last_undegraded":"2026-02-24T07:53:37.791123+0000","last_fullsized":"2026-02-24T07:53:37.791123+0000","mapping_epoch":78,"log_start":"80'7976","ondisk_log_start":"80'7976","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65404928,"num_objects":998,"num_object_clones":0,"num_object_copies":2994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7984,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'8144","reported_seq":8158,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.792595+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:37.792595+0000","last_peered":"2026-02-24T07:53:37.792595+0000","last_clean":"2026-02-24T07:53:37.792595+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:37.792595+0000","last_undegraded":"2026-02-24T07:53:37.792595+0000","last_fullsized":"2026-02-24T07:53:37.792595+0000","mapping_epoch":78,"log_start":"80'8112","ondisk_log_start":"80'8112","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66715648,"num_objects":1018,"num_object_clones":0,"num_object_copies":3054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8144,"num_write_kb":65152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'7608","reported_seq":7611,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.807085+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:37.807085+0000","last_peered":"2026-02-24T07:53:37.807085+0000","last_clean":"2026-02-24T07:53:37.807085+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:37.807085+0000","last_undegraded":"2026-02-24T07:53:37.807085+0000","last_fullsized":"2026-02-24T07:53:37.807085+0000","mapping_epoch":78,"log_start":"80'7592","ondisk_log_start":"80'7592","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7608,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'7579","reported_seq":7593,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.959499+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:37.959499+0000","last_peered":"2026-02-24T07:53:37.959499+0000","last_clean":"2026-02-24T07:53:37.959499+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:37.959499+0000","last_undegraded":"2026-02-24T07:53:37.959499+0000","last_fullsized":"2026-02-24T07:53:37.959499+0000","mapping_epoch":78,"log_start":"80'7576","ondisk_log_start":"80'7576","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62087168,"num_objects":948,"num_object_clones":0,"num_object_copies":2844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7579,"num_write_kb":60632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'7960","reported_seq":7974,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.809271+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:37.809271+0000","last_peered":"2026-02-24T07:53:37.809271+0000","last_clean":"2026-02-24T07:53:37.809271+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:37.809271+0000","last_undegraded":"2026-02-24T07:53:37.809271+0000","last_fullsized":"2026-02-24T07:53:37.809271+0000","mapping_epoch":78,"log_start":"80'7944","ondisk_log_start":"80'7944","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":2985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7960,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'7896","reported_seq":7910,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.808846+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:37.808846+0000","last_peered":"2026-02-24T07:53:37.808846+0000","last_clean":"2026-02-24T07:53:37.808846+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:37.808846+0000","last_undegraded":"2026-02-24T07:53:37.808846+0000","last_fullsized":"2026-02-24T07:53:37.808846+0000","mapping_epoch":78,"log_start":"80'7888","ondisk_log_start":"80'7888","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64684032,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7896,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'8048","reported_seq":8062,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.772782+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:37.772782+0000","last_peered":"2026-02-24T07:53:37.772782+0000","last_clean":"2026-02-24T07:53:37.772782+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:37.772782+0000","last_undegraded":"2026-02-24T07:53:37.772782+0000","last_fullsized":"2026-02-24T07:53:37.772782+0000","mapping_epoch":78,"log_start":"80'8032","ondisk_log_start":"80'8032","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65929216,"num_objects":1006,"num_object_clones":0,"num_object_copies":3018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8048,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'8016","reported_seq":8030,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.799987+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:37.799987+0000","last_peered":"2026-02-24T07:53:37.799987+0000","last_clean":"2026-02-24T07:53:37.799987+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:37.799987+0000","last_undegraded":"2026-02-24T07:53:37.799987+0000","last_fullsized":"2026-02-24T07:53:37.799987+0000","mapping_epoch":78,"log_start":"80'8008","ondisk_log_start":"80'8008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65667072,"num_objects":1002,"num_object_clones":0,"num_object_copies":3006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8016,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'7936","reported_seq":7950,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.824609+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:37.824609+0000","last_peered":"2026-02-24T07:53:37.824609+0000","last_clean":"2026-02-24T07:53:37.824609+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:37.824609+0000","last_undegraded":"2026-02-24T07:53:37.824609+0000","last_fullsized":"2026-02-24T07:53:37.824609+0000","mapping_epoch":78,"log_start":"80'7933","ondisk_log_start":"80'7933","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":992,"num_object_clones":0,"num_object_copies":2976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7936,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'7440","reported_seq":7454,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:37.793507+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:37.793507+0000","last_peered":"2026-02-24T07:53:37.793507+0000","last_clean":"2026-02-24T07:53:37.793507+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:37.793507+0000","last_undegraded":"2026-02-24T07:53:37.793507+0000","last_fullsized":"2026-02-24T07:53:37.793507+0000","mapping_epoch":78,"log_start":"80'7432","ondisk_log_start":"80'7432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7440,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866907+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866907+0000","last_peered":"2026-02-24T07:53:22.866907+0000","last_clean":"2026-02-24T07:53:22.866907+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866907+0000","last_undegraded":"2026-02-24T07:53:22.866907+0000","last_fullsized":"2026-02-24T07:53:22.866907+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1033674752,"num_objects":15774,"num_object_clones":0,"num_object_copies":47322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126181,"num_write_kb":1009448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3105210368,"data_stored":3105210368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215189,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2650552,"kb_used_data":829028,"kb_used_omap":18,"kb_used_meta":1821485,"kb_avail":731352648,"statfs":{"total":751619276800,"available":748905111552,"internally_reserved":0,"allocated":848924672,"data_stored":848361850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19239,"internal_metadata":1865200857},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,1,31,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2145536,"kb_used_data":687468,"kb_used_omap":17,"kb_used_meta":1458030,"kb_avail":731857664,"statfs":{"total":751619276800,"available":749422247936,"internally_reserved":0,"allocated":703967232,"data_stored":703404410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1493023293},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1966564,"kb_used_data":628816,"kb_used_omap":9,"kb_used_meta":1337718,"kb_avail":732036636,"statfs":{"total":751619276800,"available":749605515264,"internally_reserved":0,"allocated":643907584,"data_stored":643348314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1369824094},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2129408,"kb_used_data":807980,"kb_used_omap":11,"kb_used_meta":1321396,"kb_avail":731873792,"statfs":{"total":751619276800,"available":749438763008,"internally_reserved":0,"allocated":827371520,"data_stored":826808698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11345,"internal_metadata":1353110447},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,13,19,42],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":845774848,"data_stored":845774848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":648781824,"data_stored":648781824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":709468160,"data_stored":709468160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":901185536,"data_stored":901185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:42.242 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:42.242 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 46 2026-02-24T07:53:42.384 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:42.513 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:42.509+0000 7f5ae8cf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:42.514 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:42.510+0000 7f5ae8cf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:42.645 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:42.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:42.932 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:42.961 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:53:42.960574+0000 min lat: 0.000558626 max lat: 0.0979723 avg lat: 0.0150423 2026-02-24T07:53:42.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:53:42.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 128 170270 170142 66.4554 65.8438 0.0067325 0.0150423 2026-02-24T07:53:43.078 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:43.140 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:42 trial016 ceph-mon[39544]: pgmap v262: 17 pgs: 17 active+clean; 986 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.02k op/s 2026-02-24T07:53:43.140 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/862386065' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T07:53:43.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:43.206+0000 7f1926769640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:43.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:43.207+0000 7f1926769640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:43.230 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:43.231 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:43.244 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:43.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:43.256 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:43.257 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:43.274 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:43.274 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:43.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 127 179007 178880 66.5413 68.2656 0.0283955 0.0150208 2026-02-24T07:53:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:43 trial016 ceph-mon[39544]: from='client.15001 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1924989810' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:44.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 127 187854 187727 66.6582 69.1172 0.00888254 0.0149957 2026-02-24T07:53:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:44 trial016 ceph-mon[39544]: pgmap v263: 17 pgs: 17 active+clean; 1.3 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 83 MiB/s wr, 10.59k op/s 2026-02-24T07:53:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:45.319 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:45.467 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:45.899 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:45.896+0000 7f3026a15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:45.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:45.897+0000 7f3026a15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:45.919 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:45.919 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:45.932 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:45.933 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:45.950 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:45.950 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:45.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 127 195926 195799 66.5016 63.0625 0.0145303 0.01503 2026-02-24T07:53:45.975 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:45.975 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:46.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 128 204681 204553 66.5801 68.3906 0.0070656 0.01501 2026-02-24T07:53:47.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:46 trial016 ceph-mon[39544]: pgmap v264: 17 pgs: 17 active+clean; 1.3 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.93k op/s 2026-02-24T07:53:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3312839397' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:47.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:47.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:47.689 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_3 2026-02-24T07:53:47.690 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:47.832 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:47.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 127 213302 213175 66.6111 67.3594 0.00667696 0.0150062 2026-02-24T07:53:47.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:47.962+0000 7f5b1f158640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:47.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:47.963+0000 7f5b1f158640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:48.019 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:48.114 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:48.115 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:48.165 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2026-02-24T07:53:47.795902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385873952,"num_objects":21142,"num_object_clones":0,"num_object_copies":63426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21142,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":169237,"num_write_kb":1354966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9775964,"kb_used_data":3981836,"kb_used_omap":57,"kb_used_meta":5793990,"kb_avail":2926236836,"statfs":{"total":3006477107200,"available":2996466520064,"internally_reserved":0,"allocated":4077400064,"data_stored":4075152328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58473,"internal_metadata":5933046679},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,10,2,9,24,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":681607168,"num_objects":10401,"num_object_clones":0,"num_object_copies":31203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83204,"num_write_kb":665632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001561"},"pg_stats":[{"pgid":"5.f","version":"80'10336","reported_seq":10350,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.813489+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:42.813489+0000","last_peered":"2026-02-24T07:53:42.813489+0000","last_clean":"2026-02-24T07:53:42.813489+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:42.813489+0000","last_undegraded":"2026-02-24T07:53:42.813489+0000","last_fullsized":"2026-02-24T07:53:42.813489+0000","mapping_epoch":78,"log_start":"80'10332","ondisk_log_start":"80'10332","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84672512,"num_objects":1292,"num_object_clones":0,"num_object_copies":3876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10336,"num_write_kb":82688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'10496","reported_seq":10510,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.772103+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:42.772103+0000","last_peered":"2026-02-24T07:53:42.772103+0000","last_clean":"2026-02-24T07:53:42.772103+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:42.772103+0000","last_undegraded":"2026-02-24T07:53:42.772103+0000","last_fullsized":"2026-02-24T07:53:42.772103+0000","mapping_epoch":78,"log_start":"80'10480","ondisk_log_start":"80'10480","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":1312,"num_object_clones":0,"num_object_copies":3936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10496,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'11056","reported_seq":11070,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.816460+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:42.816460+0000","last_peered":"2026-02-24T07:53:42.816460+0000","last_clean":"2026-02-24T07:53:42.816460+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:42.816460+0000","last_undegraded":"2026-02-24T07:53:42.816460+0000","last_fullsized":"2026-02-24T07:53:42.816460+0000","mapping_epoch":78,"log_start":"80'11024","ondisk_log_start":"80'11024","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90570752,"num_objects":1382,"num_object_clones":0,"num_object_copies":4146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11056,"num_write_kb":88448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'10952","reported_seq":10963,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.959955+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:42.959955+0000","last_peered":"2026-02-24T07:53:42.959955+0000","last_clean":"2026-02-24T07:53:42.959955+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:42.959955+0000","last_undegraded":"2026-02-24T07:53:42.959955+0000","last_fullsized":"2026-02-24T07:53:42.959955+0000","mapping_epoch":78,"log_start":"80'10914","ondisk_log_start":"80'10914","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89718784,"num_objects":1369,"num_object_clones":0,"num_object_copies":4107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10952,"num_write_kb":87616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'10352","reported_seq":10366,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.813481+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:42.813481+0000","last_peered":"2026-02-24T07:53:42.813481+0000","last_clean":"2026-02-24T07:53:42.813481+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:42.813481+0000","last_undegraded":"2026-02-24T07:53:42.813481+0000","last_fullsized":"2026-02-24T07:53:42.813481+0000","mapping_epoch":78,"log_start":"80'10328","ondisk_log_start":"80'10328","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84803584,"num_objects":1294,"num_object_clones":0,"num_object_copies":3882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10352,"num_write_kb":82816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'10577","reported_seq":10590,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.815170+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:42.815170+0000","last_peered":"2026-02-24T07:53:42.815170+0000","last_clean":"2026-02-24T07:53:42.815170+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:42.815170+0000","last_undegraded":"2026-02-24T07:53:42.815170+0000","last_fullsized":"2026-02-24T07:53:42.815170+0000","mapping_epoch":78,"log_start":"80'10573","ondisk_log_start":"80'10573","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86646784,"num_objects":1323,"num_object_clones":0,"num_object_copies":3969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10577,"num_write_kb":84616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'10854","reported_seq":10867,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.822201+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:42.822201+0000","last_peered":"2026-02-24T07:53:42.822201+0000","last_clean":"2026-02-24T07:53:42.822201+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:42.822201+0000","last_undegraded":"2026-02-24T07:53:42.822201+0000","last_fullsized":"2026-02-24T07:53:42.822201+0000","mapping_epoch":78,"log_start":"80'10850","ondisk_log_start":"80'10850","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88915968,"num_objects":1357,"num_object_clones":0,"num_object_copies":4071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10854,"num_write_kb":86832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'10728","reported_seq":10742,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.759756+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:42.759756+0000","last_peered":"2026-02-24T07:53:42.759756+0000","last_clean":"2026-02-24T07:53:42.759756+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:42.759756+0000","last_undegraded":"2026-02-24T07:53:42.759756+0000","last_fullsized":"2026-02-24T07:53:42.759756+0000","mapping_epoch":78,"log_start":"80'10720","ondisk_log_start":"80'10720","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87883776,"num_objects":1341,"num_object_clones":0,"num_object_copies":4023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10728,"num_write_kb":85824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'10176","reported_seq":10190,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.799451+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:42.799451+0000","last_peered":"2026-02-24T07:53:42.799451+0000","last_clean":"2026-02-24T07:53:42.799451+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:42.799451+0000","last_undegraded":"2026-02-24T07:53:42.799451+0000","last_fullsized":"2026-02-24T07:53:42.799451+0000","mapping_epoch":78,"log_start":"80'10152","ondisk_log_start":"80'10152","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83361792,"num_objects":1272,"num_object_clones":0,"num_object_copies":3816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1272,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10176,"num_write_kb":81408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'10537","reported_seq":10551,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.939615+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:42.939615+0000","last_peered":"2026-02-24T07:53:42.939615+0000","last_clean":"2026-02-24T07:53:42.939615+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:42.939615+0000","last_undegraded":"2026-02-24T07:53:42.939615+0000","last_fullsized":"2026-02-24T07:53:42.939615+0000","mapping_epoch":78,"log_start":"80'10534","ondisk_log_start":"80'10534","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86319104,"num_objects":1318,"num_object_clones":0,"num_object_copies":3954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10537,"num_write_kb":84296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'10408","reported_seq":10422,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.813086+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:42.813086+0000","last_peered":"2026-02-24T07:53:42.813086+0000","last_clean":"2026-02-24T07:53:42.813086+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:42.813086+0000","last_undegraded":"2026-02-24T07:53:42.813086+0000","last_fullsized":"2026-02-24T07:53:42.813086+0000","mapping_epoch":78,"log_start":"80'10400","ondisk_log_start":"80'10400","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85262336,"num_objects":1301,"num_object_clones":0,"num_object_copies":3903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10408,"num_write_kb":83264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'10504","reported_seq":10518,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.809963+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:42.809963+0000","last_peered":"2026-02-24T07:53:42.809963+0000","last_clean":"2026-02-24T07:53:42.809963+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:42.809963+0000","last_undegraded":"2026-02-24T07:53:42.809963+0000","last_fullsized":"2026-02-24T07:53:42.809963+0000","mapping_epoch":78,"log_start":"80'10488","ondisk_log_start":"80'10488","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86048768,"num_objects":1313,"num_object_clones":0,"num_object_copies":3939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10504,"num_write_kb":84032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'10632","reported_seq":10645,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.801810+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:42.801810+0000","last_peered":"2026-02-24T07:53:42.801810+0000","last_clean":"2026-02-24T07:53:42.801810+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:42.801810+0000","last_undegraded":"2026-02-24T07:53:42.801810+0000","last_fullsized":"2026-02-24T07:53:42.801810+0000","mapping_epoch":78,"log_start":"80'10624","ondisk_log_start":"80'10624","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87097344,"num_objects":1329,"num_object_clones":0,"num_object_copies":3987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10632,"num_write_kb":85056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'10672","reported_seq":10686,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.798764+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:42.798764+0000","last_peered":"2026-02-24T07:53:42.798764+0000","last_clean":"2026-02-24T07:53:42.798764+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:42.798764+0000","last_undegraded":"2026-02-24T07:53:42.798764+0000","last_fullsized":"2026-02-24T07:53:42.798764+0000","mapping_epoch":78,"log_start":"80'10655","ondisk_log_start":"80'10655","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87425024,"num_objects":1334,"num_object_clones":0,"num_object_copies":4002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1334,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10672,"num_write_kb":85376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'10559","reported_seq":10568,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.832200+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:42.832200+0000","last_peered":"2026-02-24T07:53:42.832200+0000","last_clean":"2026-02-24T07:53:42.832200+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:42.832200+0000","last_undegraded":"2026-02-24T07:53:42.832200+0000","last_fullsized":"2026-02-24T07:53:42.832200+0000","mapping_epoch":78,"log_start":"80'10552","ondisk_log_start":"80'10552","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86499328,"num_objects":1320,"num_object_clones":0,"num_object_copies":3960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10559,"num_write_kb":84472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'10263","reported_seq":10272,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:42.816393+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:42.816393+0000","last_peered":"2026-02-24T07:53:42.816393+0000","last_clean":"2026-02-24T07:53:42.816393+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:42.816393+0000","last_undegraded":"2026-02-24T07:53:42.816393+0000","last_fullsized":"2026-02-24T07:53:42.816393+0000","mapping_epoch":78,"log_start":"80'10256","ondisk_log_start":"80'10256","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84074496,"num_objects":1283,"num_object_clones":0,"num_object_copies":3849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10263,"num_write_kb":82104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866907+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866907+0000","last_peered":"2026-02-24T07:53:22.866907+0000","last_clean":"2026-02-24T07:53:22.866907+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866907+0000","last_undegraded":"2026-02-24T07:53:22.866907+0000","last_fullsized":"2026-02-24T07:53:22.866907+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1385283584,"num_objects":21140,"num_object_clones":0,"num_object_copies":63420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169102,"num_write_kb":1352816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4160151552,"data_stored":4160151552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215190,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2592760,"kb_used_data":1132132,"kb_used_omap":18,"kb_used_meta":1460589,"kb_avail":731410440,"statfs":{"total":751619276800,"available":748964290560,"internally_reserved":0,"allocated":1159303168,"data_stored":1158740346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19239,"internal_metadata":1495643353},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,10,2,1,24,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2455720,"kb_used_data":925524,"kb_used_omap":17,"kb_used_meta":1530158,"kb_avail":731547480,"statfs":{"total":751619276800,"available":749104619520,"internally_reserved":0,"allocated":947736576,"data_stored":947173754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1566882365},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2230708,"kb_used_data":839072,"kb_used_omap":9,"kb_used_meta":1391606,"kb_avail":731772492,"statfs":{"total":751619276800,"available":749335031808,"internally_reserved":0,"allocated":859209728,"data_stored":858650458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1425005406},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2496776,"kb_used_data":1085108,"kb_used_omap":11,"kb_used_meta":1411636,"kb_avail":731506424,"statfs":{"total":751619276800,"available":749062578176,"internally_reserved":0,"allocated":1111150592,"data_stored":1110587770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1445515555},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1126326272,"data_stored":1126326272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":870227968,"data_stored":870227968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":954540032,"data_stored":954540032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1209057280,"data_stored":1209057280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:48.167 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pgp_num 46 2026-02-24T07:53:48.170 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:48.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:48.292+0000 7f8669152640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:48.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:48.292+0000 7f8669152640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:48.315 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:48.332 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:48.333 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:48.345 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:48.345 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:48.357 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:48.357 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:48.379 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:48.380 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:48.441 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:48.438+0000 7f2fd323f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:48.441 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:48.439+0000 7f2fd323f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:48.581 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:53:48.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:48.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 221699 221571 66.5718 65.5938 0.0242866 0.0150118 2026-02-24T07:53:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:48 trial016 ceph-mon[39544]: pgmap v265: 17 pgs: 17 active+clean; 1.3 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.93k op/s 2026-02-24T07:53:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2865608486' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:49.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/858114686' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T07:53:49.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 128 230026 229898 66.5154 65.0547 0.00340711 0.0150257 2026-02-24T07:53:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:49 trial016 ceph-mon[39544]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:50.430 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:50.579 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:50.697 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:50.694+0000 7fd49fe56640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:50.698 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:50.695+0000 7fd49fe56640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:50.729 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:50.730 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:50.742 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:50.742 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:50.755 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:50.756 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:50.781 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:50.781 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:50.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 127 238787 238660 66.5844 68.4531 0.0138409 0.0150133 2026-02-24T07:53:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:50 trial016 ceph-mon[39544]: pgmap v266: 17 pgs: 17 active+clean; 1.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.52k op/s 2026-02-24T07:53:51.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3927716702' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:51.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 247625 247497 66.6689 69.0391 0.00591796 0.0149905 2026-02-24T07:53:52.823 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:52.954 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:52.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 256049 255921 66.6401 65.8125 0.00382088 0.0149997 2026-02-24T07:53:53.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:52 trial016 ceph-mon[39544]: pgmap v267: 17 pgs: 17 active+clean; 1.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.16k op/s 2026-02-24T07:53:53.316 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:53.298+0000 7fa67c384640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:53.316 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:53.298+0000 7fa67c384640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:53.358 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:53.359 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:53.373 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:53.374 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:53.387 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:53.387 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:53.402 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:53.402 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:53.626 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:53:53.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:53:53.627 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:53:53.627 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:53:53.892 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:53.962 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 128 262278 262150 66.0602 48.6641 0.0051358 0.0151315 2026-02-24T07:53:54.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1061659264' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:54.475 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:54.455+0000 7f5fe3e43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:54.475 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:54.455+0000 7f5fe3e43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:54.596 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:53:54.596 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:53:54.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 128 268723 268595 65.5692 50.3516 0.00352512 0.0152443 2026-02-24T07:53:55.075 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2026-02-24T07:53:53.796664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2091786784,"num_objects":31912,"num_object_clones":0,"num_object_copies":95736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31912,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":255408,"num_write_kb":2044334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12484092,"kb_used_data":6026476,"kb_used_omap":57,"kb_used_meta":6457478,"kb_avail":2923528708,"statfs":{"total":3006477107200,"available":2993693396992,"internally_reserved":0,"allocated":6171111424,"data_stored":6168863688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58473,"internal_metadata":6612458391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1057521664,"num_objects":16136,"num_object_clones":0,"num_object_copies":48408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129092,"num_write_kb":1032736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001524"},"pg_stats":[{"pgid":"5.f","version":"80'15392","reported_seq":15404,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.816825+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:52.816825+0000","last_peered":"2026-02-24T07:53:52.816825+0000","last_clean":"2026-02-24T07:53:52.816825+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:52.816825+0000","last_undegraded":"2026-02-24T07:53:52.816825+0000","last_fullsized":"2026-02-24T07:53:52.816825+0000","mapping_epoch":78,"log_start":"80'15388","ondisk_log_start":"80'15388","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126091264,"num_objects":1924,"num_object_clones":0,"num_object_copies":5772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15392,"num_write_kb":123136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'16112","reported_seq":16112,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.819327+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:52.819327+0000","last_peered":"2026-02-24T07:53:52.819327+0000","last_clean":"2026-02-24T07:53:52.819327+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:52.819327+0000","last_undegraded":"2026-02-24T07:53:52.819327+0000","last_fullsized":"2026-02-24T07:53:52.819327+0000","mapping_epoch":78,"log_start":"80'16096","ondisk_log_start":"80'16096","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":6042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16112,"num_write_kb":128896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'16568","reported_seq":16576,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.829455+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:52.829455+0000","last_peered":"2026-02-24T07:53:52.829455+0000","last_clean":"2026-02-24T07:53:52.829455+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:52.829455+0000","last_undegraded":"2026-02-24T07:53:52.829455+0000","last_fullsized":"2026-02-24T07:53:52.829455+0000","mapping_epoch":78,"log_start":"80'16560","ondisk_log_start":"80'16560","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135725056,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16568,"num_write_kb":132544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'16296","reported_seq":16303,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.963561+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:52.963561+0000","last_peered":"2026-02-24T07:53:52.963561+0000","last_clean":"2026-02-24T07:53:52.963561+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:52.963561+0000","last_undegraded":"2026-02-24T07:53:52.963561+0000","last_fullsized":"2026-02-24T07:53:52.963561+0000","mapping_epoch":78,"log_start":"80'16287","ondisk_log_start":"80'16287","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133496832,"num_objects":2037,"num_object_clones":0,"num_object_copies":6111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16296,"num_write_kb":130368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'15888","reported_seq":15894,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.824637+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:52.824637+0000","last_peered":"2026-02-24T07:53:52.824637+0000","last_clean":"2026-02-24T07:53:52.824637+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:52.824637+0000","last_undegraded":"2026-02-24T07:53:52.824637+0000","last_fullsized":"2026-02-24T07:53:52.824637+0000","mapping_epoch":78,"log_start":"80'15872","ondisk_log_start":"80'15872","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130154496,"num_objects":1986,"num_object_clones":0,"num_object_copies":5958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15888,"num_write_kb":127104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'16008","reported_seq":16022,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.824369+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:52.824369+0000","last_peered":"2026-02-24T07:53:52.824369+0000","last_clean":"2026-02-24T07:53:52.824369+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:52.824369+0000","last_undegraded":"2026-02-24T07:53:52.824369+0000","last_fullsized":"2026-02-24T07:53:52.824369+0000","mapping_epoch":78,"log_start":"80'16000","ondisk_log_start":"80'16000","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131137536,"num_objects":2001,"num_object_clones":0,"num_object_copies":6003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16008,"num_write_kb":128064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'16752","reported_seq":16745,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.823660+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:52.823660+0000","last_peered":"2026-02-24T07:53:52.823660+0000","last_clean":"2026-02-24T07:53:52.823660+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:52.823660+0000","last_undegraded":"2026-02-24T07:53:52.823660+0000","last_fullsized":"2026-02-24T07:53:52.823660+0000","mapping_epoch":78,"log_start":"80'16728","ondisk_log_start":"80'16728","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137232384,"num_objects":2094,"num_object_clones":0,"num_object_copies":6282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16752,"num_write_kb":134016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'16168","reported_seq":16182,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.823385+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:52.823385+0000","last_peered":"2026-02-24T07:53:52.823385+0000","last_clean":"2026-02-24T07:53:52.823385+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:52.823385+0000","last_undegraded":"2026-02-24T07:53:52.823385+0000","last_fullsized":"2026-02-24T07:53:52.823385+0000","mapping_epoch":78,"log_start":"80'16152","ondisk_log_start":"80'16152","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132448256,"num_objects":2021,"num_object_clones":0,"num_object_copies":6063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2021,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16168,"num_write_kb":129344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'15665","reported_seq":15678,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.819685+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:52.819685+0000","last_peered":"2026-02-24T07:53:52.819685+0000","last_clean":"2026-02-24T07:53:52.819685+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:52.819685+0000","last_undegraded":"2026-02-24T07:53:52.819685+0000","last_fullsized":"2026-02-24T07:53:52.819685+0000","mapping_epoch":78,"log_start":"80'15656","ondisk_log_start":"80'15656","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128327680,"num_objects":1959,"num_object_clones":0,"num_object_copies":5877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15665,"num_write_kb":125320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'16024","reported_seq":16038,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.965247+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:52.965247+0000","last_peered":"2026-02-24T07:53:52.965247+0000","last_clean":"2026-02-24T07:53:52.965247+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:52.965247+0000","last_undegraded":"2026-02-24T07:53:52.965247+0000","last_fullsized":"2026-02-24T07:53:52.965247+0000","mapping_epoch":78,"log_start":"80'16016","ondisk_log_start":"80'16016","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131268608,"num_objects":2003,"num_object_clones":0,"num_object_copies":6009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2003,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16024,"num_write_kb":128192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'15728","reported_seq":15742,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.801726+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:52.801726+0000","last_peered":"2026-02-24T07:53:52.801726+0000","last_clean":"2026-02-24T07:53:52.801726+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:52.801726+0000","last_undegraded":"2026-02-24T07:53:52.801726+0000","last_fullsized":"2026-02-24T07:53:52.801726+0000","mapping_epoch":78,"log_start":"80'15720","ondisk_log_start":"80'15720","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128843776,"num_objects":1966,"num_object_clones":0,"num_object_copies":5898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15728,"num_write_kb":125824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'15800","reported_seq":15814,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.804302+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:52.804302+0000","last_peered":"2026-02-24T07:53:52.804302+0000","last_clean":"2026-02-24T07:53:52.804302+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:52.804302+0000","last_undegraded":"2026-02-24T07:53:52.804302+0000","last_fullsized":"2026-02-24T07:53:52.804302+0000","mapping_epoch":78,"log_start":"80'15784","ondisk_log_start":"80'15784","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129433600,"num_objects":1975,"num_object_clones":0,"num_object_copies":5925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15800,"num_write_kb":126400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'15976","reported_seq":15983,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.816133+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:52.816133+0000","last_peered":"2026-02-24T07:53:52.816133+0000","last_clean":"2026-02-24T07:53:52.816133+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:52.816133+0000","last_undegraded":"2026-02-24T07:53:52.816133+0000","last_fullsized":"2026-02-24T07:53:52.816133+0000","mapping_epoch":78,"log_start":"80'15956","ondisk_log_start":"80'15956","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1997,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15976,"num_write_kb":127808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'15848","reported_seq":15862,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.813466+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:52.813466+0000","last_peered":"2026-02-24T07:53:52.813466+0000","last_clean":"2026-02-24T07:53:52.813466+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:52.813466+0000","last_undegraded":"2026-02-24T07:53:52.813466+0000","last_fullsized":"2026-02-24T07:53:52.813466+0000","mapping_epoch":78,"log_start":"80'15837","ondisk_log_start":"80'15837","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129826816,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15848,"num_write_kb":126784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'16080","reported_seq":16094,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.784466+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:52.784466+0000","last_peered":"2026-02-24T07:53:52.784466+0000","last_clean":"2026-02-24T07:53:52.784466+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:52.784466+0000","last_undegraded":"2026-02-24T07:53:52.784466+0000","last_fullsized":"2026-02-24T07:53:52.784466+0000","mapping_epoch":78,"log_start":"80'16064","ondisk_log_start":"80'16064","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131727360,"num_objects":2010,"num_object_clones":0,"num_object_copies":6030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16080,"num_write_kb":128640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'14968","reported_seq":14982,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:52.809148+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:52.809148+0000","last_peered":"2026-02-24T07:53:52.809148+0000","last_clean":"2026-02-24T07:53:52.809148+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:52.809148+0000","last_undegraded":"2026-02-24T07:53:52.809148+0000","last_fullsized":"2026-02-24T07:53:52.809148+0000","mapping_epoch":78,"log_start":"80'14960","ondisk_log_start":"80'14960","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122617856,"num_objects":1871,"num_object_clones":0,"num_object_copies":5613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14968,"num_write_kb":119744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866975+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866975+0000","last_peered":"2026-02-24T07:53:22.866975+0000","last_clean":"2026-02-24T07:53:22.866975+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866975+0000","last_undegraded":"2026-02-24T07:53:22.866975+0000","last_fullsized":"2026-02-24T07:53:22.866975+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2091196416,"num_objects":31910,"num_object_clones":0,"num_object_copies":95730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255273,"num_write_kb":2042184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6275842048,"data_stored":6275842048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3368432,"kb_used_data":1727324,"kb_used_omap":18,"kb_used_meta":1641069,"kb_avail":730634768,"statfs":{"total":751619276800,"available":748170002432,"internally_reserved":0,"allocated":1768779776,"data_stored":1768216954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19239,"internal_metadata":1680454873},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3084840,"kb_used_data":1392724,"kb_used_omap":17,"kb_used_meta":1692078,"kb_avail":730918360,"statfs":{"total":751619276800,"available":748460400640,"internally_reserved":0,"allocated":1426149376,"data_stored":1425586554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1732688445},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2845452,"kb_used_data":1273336,"kb_used_omap":9,"kb_used_meta":1572086,"kb_avail":731157748,"statfs":{"total":751619276800,"available":748705533952,"internally_reserved":0,"allocated":1303896064,"data_stored":1303336794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1609816926},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705758,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3185368,"kb_used_data":1633092,"kb_used_omap":11,"kb_used_meta":1552244,"kb_avail":730817832,"statfs":{"total":751619276800,"available":748357459968,"internally_reserved":0,"allocated":1672286208,"data_stored":1671723386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1589498147},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1700462592,"data_stored":1700462592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1312587776,"data_stored":1312587776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1437229056,"data_stored":1437229056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1825562624,"data_stored":1825562624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:53:55.077 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:53:55.078 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 161 2026-02-24T07:53:55.225 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:54 trial016 ceph-mon[39544]: pgmap v268: 17 pgs: 17 active+clean; 1.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.76k op/s 2026-02-24T07:53:55.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:53:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:53:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:53:55.617 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:55.554+0000 7f4f88daf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:55.618 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:55.554+0000 7f4f88daf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:55.702 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:53:55.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:53:55.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 127 276186 276059 65.3491 58.3125 0.0220326 0.0152971 2026-02-24T07:53:56.033 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:53:56.178 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:56.203 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:55 trial016 ceph-mon[39544]: from='client.15019 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:53:56.203 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/31223159' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "161"} : dispatch 2026-02-24T07:53:56.203 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:55 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:53:56.308 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:56.306+0000 7f5f5b36b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:56.309 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:56.306+0000 7f5f5b36b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:56.332 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:56.332 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:56.344 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:56.345 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:56.358 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:56.358 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:56.371 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:56.372 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:56.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 284695 284567 65.3819 66.4688 0.00727908 0.0152898 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: pgmap v269: 17 pgs: 17 active+clean; 1.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.18k op/s 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:53:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2754937862' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:57.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 293914 293786 65.5715 72.0234 0.00637052 0.0152464 2026-02-24T07:53:58.418 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:53:58.563 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:53:58.696 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:58.693+0000 7f7977e67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:58.696 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:53:58.693+0000 7f7977e67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:53:58.725 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:53:58.726 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:53:58.738 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:53:58.738 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:53:58.754 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:53:58.755 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:53:58.781 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:53:58.781 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:53:58.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 127 303162 303035 65.7571 72.2578 0.00466274 0.0152022 2026-02-24T07:53:59.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:58 trial016 ceph-mon[39544]: pgmap v270: 17 pgs: 17 active+clean; 1.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.18k op/s 2026-02-24T07:53:59.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3501841436' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:53:59.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 128 311756 311628 65.7941 67.1328 0.0217516 0.0151925 2026-02-24T07:54:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:59 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:54:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:53:59 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:54:00.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:00.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:00.758 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_3 2026-02-24T07:54:00.759 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:00.830 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:00.906 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:00.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 320456 320328 65.8512 67.9688 0.0276767 0.0151782 2026-02-24T07:54:01.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:00 trial016 ceph-mon[39544]: pgmap v271: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 80 MiB/s wr, 10.30k op/s 2026-02-24T07:54:01.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:00 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:54:01.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:00 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:54:01.161 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:01.398 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:01.331+0000 7f5353728640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:01.398 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:01.331+0000 7f5353728640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:01.476 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:01.477 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:01.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 128 326470 326342 65.3674 46.9844 0.00228641 0.0152933 2026-02-24T07:54:02.114 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2026-02-24T07:53:59.797521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2398470688,"num_objects":36592,"num_object_clones":0,"num_object_copies":109776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36592,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":292845,"num_write_kb":2343830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13069532,"kb_used_data":6932428,"kb_used_omap":57,"kb_used_meta":6136966,"kb_avail":2922943268,"statfs":{"total":3006477107200,"available":2993093906432,"internally_reserved":0,"allocated":7098806272,"data_stored":7096558536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58473,"internal_metadata":6284254103},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,3,14,16],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1012596736,"num_objects":15450,"num_object_clones":0,"num_object_copies":46350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123608,"num_write_kb":988864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001619"},"pg_stats":[{"pgid":"5.f","version":"80'17816","reported_seq":17824,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.817260+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:53:57.817260+0000","last_peered":"2026-02-24T07:53:57.817260+0000","last_clean":"2026-02-24T07:53:57.817260+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:53:57.817260+0000","last_undegraded":"2026-02-24T07:53:57.817260+0000","last_fullsized":"2026-02-24T07:53:57.817260+0000","mapping_epoch":78,"log_start":"80'17809","ondisk_log_start":"80'17809","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145948672,"num_objects":2227,"num_object_clones":0,"num_object_copies":6681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":142528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'18442","reported_seq":18454,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.824309+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:53:57.824309+0000","last_peered":"2026-02-24T07:53:57.824309+0000","last_clean":"2026-02-24T07:53:57.824309+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:53:57.824309+0000","last_undegraded":"2026-02-24T07:53:57.824309+0000","last_fullsized":"2026-02-24T07:53:57.824309+0000","mapping_epoch":78,"log_start":"80'18432","ondisk_log_start":"80'18432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151076864,"num_objects":2306,"num_object_clones":0,"num_object_copies":6918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18442,"num_write_kb":147536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'18864","reported_seq":18873,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.833882+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:53:57.833882+0000","last_peered":"2026-02-24T07:53:57.833882+0000","last_clean":"2026-02-24T07:53:57.833882+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:53:57.833882+0000","last_undegraded":"2026-02-24T07:53:57.833882+0000","last_fullsized":"2026-02-24T07:53:57.833882+0000","mapping_epoch":78,"log_start":"80'18853","ondisk_log_start":"80'18853","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154533888,"num_objects":2358,"num_object_clones":0,"num_object_copies":7074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18864,"num_write_kb":150912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'18752","reported_seq":18766,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.961160+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:53:57.961160+0000","last_peered":"2026-02-24T07:53:57.961160+0000","last_clean":"2026-02-24T07:53:57.961160+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:53:57.961160+0000","last_undegraded":"2026-02-24T07:53:57.961160+0000","last_fullsized":"2026-02-24T07:53:57.961160+0000","mapping_epoch":78,"log_start":"80'18744","ondisk_log_start":"80'18744","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153616384,"num_objects":2344,"num_object_clones":0,"num_object_copies":7032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18752,"num_write_kb":150016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'18104","reported_seq":18118,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.814432+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:53:57.814432+0000","last_peered":"2026-02-24T07:53:57.814432+0000","last_clean":"2026-02-24T07:53:57.814432+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:53:57.814432+0000","last_undegraded":"2026-02-24T07:53:57.814432+0000","last_fullsized":"2026-02-24T07:53:57.814432+0000","mapping_epoch":78,"log_start":"80'18096","ondisk_log_start":"80'18096","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148307968,"num_objects":2263,"num_object_clones":0,"num_object_copies":6789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18104,"num_write_kb":144832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'18280","reported_seq":18294,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.814817+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:53:57.814817+0000","last_peered":"2026-02-24T07:53:57.814817+0000","last_clean":"2026-02-24T07:53:57.814817+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:53:57.814817+0000","last_undegraded":"2026-02-24T07:53:57.814817+0000","last_fullsized":"2026-02-24T07:53:57.814817+0000","mapping_epoch":78,"log_start":"80'18264","ondisk_log_start":"80'18264","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149749760,"num_objects":2285,"num_object_clones":0,"num_object_copies":6855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18280,"num_write_kb":146240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'19152","reported_seq":19166,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.820840+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:53:57.820840+0000","last_peered":"2026-02-24T07:53:57.820840+0000","last_clean":"2026-02-24T07:53:57.820840+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:53:57.820840+0000","last_undegraded":"2026-02-24T07:53:57.820840+0000","last_fullsized":"2026-02-24T07:53:57.820840+0000","mapping_epoch":78,"log_start":"80'19136","ondisk_log_start":"80'19136","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156893184,"num_objects":2394,"num_object_clones":0,"num_object_copies":7182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19152,"num_write_kb":153216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'18576","reported_seq":18590,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.815157+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:53:57.815157+0000","last_peered":"2026-02-24T07:53:57.815157+0000","last_clean":"2026-02-24T07:53:57.815157+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:53:57.815157+0000","last_undegraded":"2026-02-24T07:53:57.815157+0000","last_fullsized":"2026-02-24T07:53:57.815157+0000","mapping_epoch":78,"log_start":"80'18560","ondisk_log_start":"80'18560","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152174592,"num_objects":2322,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18576,"num_write_kb":148608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'17980","reported_seq":17990,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.824196+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:53:57.824196+0000","last_peered":"2026-02-24T07:53:57.824196+0000","last_clean":"2026-02-24T07:53:57.824196+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:53:57.824196+0000","last_undegraded":"2026-02-24T07:53:57.824196+0000","last_fullsized":"2026-02-24T07:53:57.824196+0000","mapping_epoch":78,"log_start":"80'17966","ondisk_log_start":"80'17966","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147292160,"num_objects":2248,"num_object_clones":0,"num_object_copies":6744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17980,"num_write_kb":143840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'18456","reported_seq":18453,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.963557+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:53:57.963557+0000","last_peered":"2026-02-24T07:53:57.963557+0000","last_clean":"2026-02-24T07:53:57.963557+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:53:57.963557+0000","last_undegraded":"2026-02-24T07:53:57.963557+0000","last_fullsized":"2026-02-24T07:53:57.963557+0000","mapping_epoch":78,"log_start":"80'18424","ondisk_log_start":"80'18424","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151191552,"num_objects":2307,"num_object_clones":0,"num_object_copies":6921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18456,"num_write_kb":147648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'18064","reported_seq":18078,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.830770+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:53:57.830770+0000","last_peered":"2026-02-24T07:53:57.830770+0000","last_clean":"2026-02-24T07:53:57.830770+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:53:57.830770+0000","last_undegraded":"2026-02-24T07:53:57.830770+0000","last_fullsized":"2026-02-24T07:53:57.830770+0000","mapping_epoch":78,"log_start":"80'18056","ondisk_log_start":"80'18056","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147980288,"num_objects":2258,"num_object_clones":0,"num_object_copies":6774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18064,"num_write_kb":144512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'18176","reported_seq":18190,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.832902+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:53:57.832902+0000","last_peered":"2026-02-24T07:53:57.832902+0000","last_clean":"2026-02-24T07:53:57.832902+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:53:57.832902+0000","last_undegraded":"2026-02-24T07:53:57.832902+0000","last_fullsized":"2026-02-24T07:53:57.832902+0000","mapping_epoch":78,"log_start":"80'18160","ondisk_log_start":"80'18160","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18176,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'18360","reported_seq":18374,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.822395+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:53:57.822395+0000","last_peered":"2026-02-24T07:53:57.822395+0000","last_clean":"2026-02-24T07:53:57.822395+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:53:57.822395+0000","last_undegraded":"2026-02-24T07:53:57.822395+0000","last_fullsized":"2026-02-24T07:53:57.822395+0000","mapping_epoch":78,"log_start":"80'18344","ondisk_log_start":"80'18344","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150405120,"num_objects":2295,"num_object_clones":0,"num_object_copies":6885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18360,"num_write_kb":146880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'18120","reported_seq":18134,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.788195+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:53:57.788195+0000","last_peered":"2026-02-24T07:53:57.788195+0000","last_clean":"2026-02-24T07:53:57.788195+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:53:57.788195+0000","last_undegraded":"2026-02-24T07:53:57.788195+0000","last_fullsized":"2026-02-24T07:53:57.788195+0000","mapping_epoch":78,"log_start":"80'18104","ondisk_log_start":"80'18104","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148439040,"num_objects":2265,"num_object_clones":0,"num_object_copies":6795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":144960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'18256","reported_seq":18268,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.833831+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:53:57.833831+0000","last_peered":"2026-02-24T07:53:57.833831+0000","last_clean":"2026-02-24T07:53:57.833831+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:53:57.833831+0000","last_undegraded":"2026-02-24T07:53:57.833831+0000","last_fullsized":"2026-02-24T07:53:57.833831+0000","mapping_epoch":78,"log_start":"80'18247","ondisk_log_start":"80'18247","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149553152,"num_objects":2282,"num_object_clones":0,"num_object_copies":6846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18256,"num_write_kb":146048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'17312","reported_seq":17326,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:57.806468+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:53:57.806468+0000","last_peered":"2026-02-24T07:53:57.806468+0000","last_clean":"2026-02-24T07:53:57.806468+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:53:57.806468+0000","last_undegraded":"2026-02-24T07:53:57.806468+0000","last_fullsized":"2026-02-24T07:53:57.806468+0000","mapping_epoch":78,"log_start":"80'17305","ondisk_log_start":"80'17305","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141819904,"num_objects":2164,"num_object_clones":0,"num_object_copies":6492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17312,"num_write_kb":138496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866975+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866975+0000","last_peered":"2026-02-24T07:53:22.866975+0000","last_clean":"2026-02-24T07:53:22.866975+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866975+0000","last_undegraded":"2026-02-24T07:53:22.866975+0000","last_fullsized":"2026-02-24T07:53:22.866975+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2397880320,"num_objects":36590,"num_object_clones":0,"num_object_copies":109770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292710,"num_write_kb":2341680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7197392896,"data_stored":7197392896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215193,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3740312,"kb_used_data":1996164,"kb_used_omap":18,"kb_used_meta":1744109,"kb_avail":730262888,"statfs":{"total":751619276800,"available":747789197312,"internally_reserved":0,"allocated":2044071936,"data_stored":2043509114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19239,"internal_metadata":1785967833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,3,14,16],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3362456,"kb_used_data":1598148,"kb_used_omap":17,"kb_used_meta":1764270,"kb_avail":730640744,"statfs":{"total":751619276800,"available":748176121856,"internally_reserved":0,"allocated":1636503552,"data_stored":1635940730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1806613053},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3068812,"kb_used_data":1460600,"kb_used_omap":9,"kb_used_meta":1608182,"kb_avail":730934388,"statfs":{"total":751619276800,"available":748476813312,"internally_reserved":0,"allocated":1495654400,"data_stored":1495095130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1646779230},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705759,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2897952,"kb_used_data":1877516,"kb_used_omap":11,"kb_used_meta":1020404,"kb_avail":731105248,"statfs":{"total":751619276800,"available":748651773952,"internally_reserved":0,"allocated":1922576384,"data_stored":1922013562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1044893987},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12301,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1947901952,"data_stored":1947901952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1507631104,"data_stored":1507631104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1647730688,"data_stored":1647730688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2094129152,"data_stored":2094129152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:02.117 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pgp_num 46 2026-02-24T07:54:02.379 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:02.289+0000 7f63f59bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:02.290+0000 7f63f59bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:02.380 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:02.381 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:02.387 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:02.388 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:02.577 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:02.700 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:02.697+0000 7fa5a209a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:02.700 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:02.697+0000 7fa5a209a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:02.842 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:54:02.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:02.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:54:02.962097+0000 min lat: 0.000558626 max lat: 0.0979723 avg lat: 0.0153579 2026-02-24T07:54:02.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:54:02.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 127 333396 333269 65.086 54.1172 0.00505075 0.0153579 2026-02-24T07:54:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:02 trial016 ceph-mon[39544]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:03.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:02 trial016 ceph-mon[39544]: pgmap v272: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.71k op/s 2026-02-24T07:54:03.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/642201908' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:03.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1048809736' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T07:54:03.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 128 342528 342400 65.2383 71.3359 0.00426022 0.0153237 2026-02-24T07:54:04.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:03 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:54:04.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:03 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:54:04.591 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:04.737 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:04.853 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:04.850+0000 7fdd208d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:04.853 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:04.850+0000 7fdd208d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:04.891 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:04.891 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:04.904 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:04.904 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:04.918 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:04.918 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:04.944 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:04.945 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:04.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 127 351036 350909 65.2677 66.4766 0.0317062 0.0153143 2026-02-24T07:54:05.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:05.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:04 trial016 ceph-mon[39544]: pgmap v273: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 10.02k op/s 2026-02-24T07:54:05.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1855432684' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:05.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 359785 359657 65.3391 68.3438 0.0130945 0.0153004 2026-02-24T07:54:06.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 368702 368574 65.4373 69.6641 0.00933071 0.0152776 2026-02-24T07:54:06.992 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:07.131 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:07.184 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:06 trial016 ceph-mon[39544]: pgmap v274: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.43k op/s 2026-02-24T07:54:07.254 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:07.251+0000 7ff5d4365640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:07.254 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:07.252+0000 7ff5d4365640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:07.289 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:07.289 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:07.302 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:07.302 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:07.317 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:07.317 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:07.343 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:07.344 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:07.889 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:07.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:07.889 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:54:07.890 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:07.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 127 376957 376830 65.4163 64.5 0.00977183 0.0152829 2026-02-24T07:54:08.037 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:08.197 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4263774239' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:08.486 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:08.461+0000 7f8ecf104640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:08.487 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:08.461+0000 7f8ecf104640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:08.594 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:08.595 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:08.963 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 128 383264 383136 65.0652 49.2656 0.00469812 0.0153644 2026-02-24T07:54:09.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:08 trial016 ceph-mon[39544]: pgmap v275: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.43k op/s 2026-02-24T07:54:09.337 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2026-02-24T07:54:07.798576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2724086304,"num_objects":41561,"num_object_clones":0,"num_object_copies":124683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41561,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":332593,"num_write_kb":2661814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14330452,"kb_used_data":7904580,"kb_used_omap":57,"kb_used_meta":6425734,"kb_avail":2921682348,"statfs":{"total":3006477107200,"available":2991802724352,"internally_reserved":0,"allocated":8094289920,"data_stored":8092042184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59137,"internal_metadata":6579951871},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,10,10,7,33,1,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632299520,"num_objects":9649,"num_object_clones":0,"num_object_copies":28947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77185,"num_write_kb":617480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001584"},"pg_stats":[{"pgid":"5.f","version":"80'20264","reported_seq":20278,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.815422+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:54:02.815422+0000","last_peered":"2026-02-24T07:54:02.815422+0000","last_clean":"2026-02-24T07:54:02.815422+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:02.815422+0000","last_undegraded":"2026-02-24T07:54:02.815422+0000","last_fullsized":"2026-02-24T07:54:02.815422+0000","mapping_epoch":78,"log_start":"80'20254","ondisk_log_start":"80'20254","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166002688,"num_objects":2533,"num_object_clones":0,"num_object_copies":7599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20264,"num_write_kb":162112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'20976","reported_seq":20990,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.808808+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:02.808808+0000","last_peered":"2026-02-24T07:54:02.808808+0000","last_clean":"2026-02-24T07:54:02.808808+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:02.808808+0000","last_undegraded":"2026-02-24T07:54:02.808808+0000","last_fullsized":"2026-02-24T07:54:02.808808+0000","mapping_epoch":78,"log_start":"80'20968","ondisk_log_start":"80'20968","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171835392,"num_objects":2622,"num_object_clones":0,"num_object_copies":7866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20976,"num_write_kb":167808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'21424","reported_seq":21436,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.839868+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:02.839868+0000","last_peered":"2026-02-24T07:54:02.839868+0000","last_clean":"2026-02-24T07:54:02.839868+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:02.839868+0000","last_undegraded":"2026-02-24T07:54:02.839868+0000","last_fullsized":"2026-02-24T07:54:02.839868+0000","mapping_epoch":78,"log_start":"80'21408","ondisk_log_start":"80'21408","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21424,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'21176","reported_seq":21190,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.966275+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:54:02.966275+0000","last_peered":"2026-02-24T07:54:02.966275+0000","last_clean":"2026-02-24T07:54:02.966275+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:02.966275+0000","last_undegraded":"2026-02-24T07:54:02.966275+0000","last_fullsized":"2026-02-24T07:54:02.966275+0000","mapping_epoch":78,"log_start":"80'21173","ondisk_log_start":"80'21173","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173473792,"num_objects":2647,"num_object_clones":0,"num_object_copies":7941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21176,"num_write_kb":169408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'20664","reported_seq":20669,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.838688+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:02.838688+0000","last_peered":"2026-02-24T07:54:02.838688+0000","last_clean":"2026-02-24T07:54:02.838688+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:02.838688+0000","last_undegraded":"2026-02-24T07:54:02.838688+0000","last_fullsized":"2026-02-24T07:54:02.838688+0000","mapping_epoch":78,"log_start":"80'20654","ondisk_log_start":"80'20654","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169279488,"num_objects":2583,"num_object_clones":0,"num_object_copies":7749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20664,"num_write_kb":165312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'20697","reported_seq":20710,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.838517+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:54:02.838517+0000","last_peered":"2026-02-24T07:54:02.838517+0000","last_clean":"2026-02-24T07:54:02.838517+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:02.838517+0000","last_undegraded":"2026-02-24T07:54:02.838517+0000","last_fullsized":"2026-02-24T07:54:02.838517+0000","mapping_epoch":78,"log_start":"80'20694","ondisk_log_start":"80'20694","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169549824,"num_objects":2588,"num_object_clones":0,"num_object_copies":7764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20697,"num_write_kb":165576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'21560","reported_seq":21574,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.818865+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:02.818865+0000","last_peered":"2026-02-24T07:54:02.818865+0000","last_clean":"2026-02-24T07:54:02.818865+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:02.818865+0000","last_undegraded":"2026-02-24T07:54:02.818865+0000","last_fullsized":"2026-02-24T07:54:02.818865+0000","mapping_epoch":78,"log_start":"80'21552","ondisk_log_start":"80'21552","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176619520,"num_objects":2695,"num_object_clones":0,"num_object_copies":8085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21560,"num_write_kb":172480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'21032","reported_seq":21038,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.837675+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:02.837675+0000","last_peered":"2026-02-24T07:54:02.837675+0000","last_clean":"2026-02-24T07:54:02.837675+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:02.837675+0000","last_undegraded":"2026-02-24T07:54:02.837675+0000","last_fullsized":"2026-02-24T07:54:02.837675+0000","mapping_epoch":78,"log_start":"80'21007","ondisk_log_start":"80'21007","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172294144,"num_objects":2629,"num_object_clones":0,"num_object_copies":7887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21032,"num_write_kb":168256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'20328","reported_seq":20342,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.826261+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:02.826261+0000","last_peered":"2026-02-24T07:54:02.826261+0000","last_clean":"2026-02-24T07:54:02.826261+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:02.826261+0000","last_undegraded":"2026-02-24T07:54:02.826261+0000","last_fullsized":"2026-02-24T07:54:02.826261+0000","mapping_epoch":78,"log_start":"80'20312","ondisk_log_start":"80'20312","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166526976,"num_objects":2541,"num_object_clones":0,"num_object_copies":7623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20328,"num_write_kb":162624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'21128","reported_seq":21142,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.947712+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:02.947712+0000","last_peered":"2026-02-24T07:54:02.947712+0000","last_clean":"2026-02-24T07:54:02.947712+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:02.947712+0000","last_undegraded":"2026-02-24T07:54:02.947712+0000","last_fullsized":"2026-02-24T07:54:02.947712+0000","mapping_epoch":78,"log_start":"80'21122","ondisk_log_start":"80'21122","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173080576,"num_objects":2641,"num_object_clones":0,"num_object_copies":7923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21128,"num_write_kb":169024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'20736","reported_seq":20750,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.804450+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:54:02.804450+0000","last_peered":"2026-02-24T07:54:02.804450+0000","last_clean":"2026-02-24T07:54:02.804450+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:02.804450+0000","last_undegraded":"2026-02-24T07:54:02.804450+0000","last_fullsized":"2026-02-24T07:54:02.804450+0000","mapping_epoch":78,"log_start":"80'20720","ondisk_log_start":"80'20720","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169869312,"num_objects":2592,"num_object_clones":0,"num_object_copies":7776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20736,"num_write_kb":165888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'20456","reported_seq":20470,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.834480+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:02.834480+0000","last_peered":"2026-02-24T07:54:02.834480+0000","last_clean":"2026-02-24T07:54:02.834480+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:02.834480+0000","last_undegraded":"2026-02-24T07:54:02.834480+0000","last_fullsized":"2026-02-24T07:54:02.834480+0000","mapping_epoch":78,"log_start":"80'20448","ondisk_log_start":"80'20448","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167575552,"num_objects":2557,"num_object_clones":0,"num_object_copies":7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20456,"num_write_kb":163648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'20644","reported_seq":20652,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.827764+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:54:02.827764+0000","last_peered":"2026-02-24T07:54:02.827764+0000","last_clean":"2026-02-24T07:54:02.827764+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:02.827764+0000","last_undegraded":"2026-02-24T07:54:02.827764+0000","last_fullsized":"2026-02-24T07:54:02.827764+0000","mapping_epoch":78,"log_start":"80'20636","ondisk_log_start":"80'20636","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169115648,"num_objects":2581,"num_object_clones":0,"num_object_copies":7743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20644,"num_write_kb":165152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'20608","reported_seq":20622,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.826173+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:02.826173+0000","last_peered":"2026-02-24T07:54:02.826173+0000","last_clean":"2026-02-24T07:54:02.826173+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:02.826173+0000","last_undegraded":"2026-02-24T07:54:02.826173+0000","last_fullsized":"2026-02-24T07:54:02.826173+0000","mapping_epoch":78,"log_start":"80'20592","ondisk_log_start":"80'20592","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168820736,"num_objects":2576,"num_object_clones":0,"num_object_copies":7728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20608,"num_write_kb":164864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'20933","reported_seq":20947,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.837531+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:02.837531+0000","last_peered":"2026-02-24T07:54:02.837531+0000","last_clean":"2026-02-24T07:54:02.837531+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:02.837531+0000","last_undegraded":"2026-02-24T07:54:02.837531+0000","last_fullsized":"2026-02-24T07:54:02.837531+0000","mapping_epoch":78,"log_start":"80'20928","ondisk_log_start":"80'20928","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171483136,"num_objects":2617,"num_object_clones":0,"num_object_copies":7851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2617,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20933,"num_write_kb":167464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'19832","reported_seq":19846,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:02.818292+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:54:02.818292+0000","last_peered":"2026-02-24T07:54:02.818292+0000","last_clean":"2026-02-24T07:54:02.818292+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:02.818292+0000","last_undegraded":"2026-02-24T07:54:02.818292+0000","last_fullsized":"2026-02-24T07:54:02.818292+0000","mapping_epoch":78,"log_start":"80'19824","ondisk_log_start":"80'19824","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162463744,"num_objects":2479,"num_object_clones":0,"num_object_copies":7437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19832,"num_write_kb":158656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:53:22.866975+0000","last_change":"2026-02-24T07:52:50.877979+0000","last_active":"2026-02-24T07:53:22.866975+0000","last_peered":"2026-02-24T07:53:22.866975+0000","last_clean":"2026-02-24T07:53:22.866975+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:53:22.866975+0000","last_undegraded":"2026-02-24T07:53:22.866975+0000","last_fullsized":"2026-02-24T07:53:22.866975+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:52:50.877940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:52:50.877940+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:53:58.696138+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2723495936,"num_objects":41559,"num_object_clones":0,"num_object_copies":124677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332458,"num_write_kb":2659664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8171298816,"data_stored":8171298816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12346,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215194,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4098888,"kb_used_data":2282548,"kb_used_omap":19,"kb_used_meta":1816300,"kb_avail":729904312,"statfs":{"total":751619276800,"available":747422015488,"internally_reserved":0,"allocated":2337329152,"data_stored":2336766330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19903,"internal_metadata":1859891777},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444123,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3657992,"kb_used_data":1821492,"kb_used_omap":17,"kb_used_meta":1836462,"kb_avail":730345208,"statfs":{"total":751619276800,"available":747873492992,"internally_reserved":0,"allocated":1865207808,"data_stored":1864644986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17859,"internal_metadata":1880537661},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3339732,"kb_used_data":1659328,"kb_used_omap":9,"kb_used_meta":1680374,"kb_avail":730663468,"statfs":{"total":751619276800,"available":748199391232,"internally_reserved":0,"allocated":1699151872,"data_stored":1698592602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1720703838},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3233840,"kb_used_data":2141212,"kb_used_omap":11,"kb_used_meta":1092596,"kb_avail":730769360,"statfs":{"total":751619276800,"available":748307824640,"internally_reserved":0,"allocated":2192601088,"data_stored":2192038266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1118818595},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,10,10,7,33,1,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12346,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2210865152,"data_stored":2210865152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1711538176,"data_stored":1711538176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1871388672,"data_stored":1871388672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2377506816,"data_stored":2377506816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:09.339 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:54:09.339 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 56 2026-02-24T07:54:09.391 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:09.486 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:09.552 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:09.686 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:09.683+0000 7f47edcb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:09.686 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:09.683+0000 7f47edcb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:09.691 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:09.688+0000 7fb6f4b88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:09.691 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:09.689+0000 7fb6f4b88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:09.715 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:09.715 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:09.728 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:09.728 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:09.752 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:09.753 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:09.774 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:09.775 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:09.832 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:54:09.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:09.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 128 390471 390343 64.8787 56.3047 0.0149881 0.0154095 2026-02-24T07:54:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:09 trial016 ceph-mon[39544]: from='client.15037 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:10.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1395403522' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:10.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/502496571' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T07:54:10.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 399227 399099 64.9521 68.4062 0.00392392 0.0153915 2026-02-24T07:54:11.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:10 trial016 ceph-mon[39544]: pgmap v276: 17 pgs: 17 active+clean; 2.9 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.05k op/s 2026-02-24T07:54:11.820 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:11.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 128 407846 407718 65.0006 67.3359 0.00323892 0.0153797 2026-02-24T07:54:11.969 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:12.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:12.095+0000 7f7da5a47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:12.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:12.095+0000 7f7da5a47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:12.119 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:12.120 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:12.136 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:12.137 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:12.150 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:12.150 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:12.176 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:12.176 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:12.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 416665 416537 65.0785 68.8984 0.0171687 0.0153619 2026-02-24T07:54:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:12 trial016 ceph-mon[39544]: pgmap v277: 17 pgs: 17 active+clean; 2.9 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.94k op/s 2026-02-24T07:54:13.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/458943908' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:13.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 425803 425675 65.2021 71.3906 0.00225647 0.0153321 2026-02-24T07:54:14.221 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:14.372 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:14.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:14.874 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:14.874 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:54:14.875 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:14.880 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:14.826+0000 7fb9c17f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:14.881 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:14.826+0000 7fb9c17f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:14.881 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:14.881 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:14.881 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:14.882 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:14.882 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:14.882 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:14.886 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:14.886 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:14.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 433433 433305 65.0945 59.6094 0.00192233 0.0153528 2026-02-24T07:54:15.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:14 trial016 ceph-mon[39544]: pgmap v278: 17 pgs: 17 active+clean; 3.2 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 80 MiB/s wr, 10.23k op/s 2026-02-24T07:54:15.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2558252481' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:15.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:15.747 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:15.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 127 440664 440537 64.9322 56.5 0.014195 0.015397 2026-02-24T07:54:16.280 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:16.250+0000 7f621b185640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:16.281 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:16.250+0000 7f621b185640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:16.395 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:16.396 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:16.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 128 447023 446895 64.6496 49.6719 0.0223944 0.015464 2026-02-24T07:54:17.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:16 trial016 ceph-mon[39544]: pgmap v279: 17 pgs: 17 active+clean; 3.2 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.91k op/s 2026-02-24T07:54:17.249 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2026-02-24T07:54:15.799665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3403874848,"num_objects":51933,"num_object_clones":0,"num_object_copies":155799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51933,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":415575,"num_write_kb":3325670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15029724,"kb_used_data":9885132,"kb_used_omap":36,"kb_used_meta":5144475,"kb_avail":2920983076,"statfs":{"total":3006477107200,"available":2991086669824,"internally_reserved":0,"allocated":10122375168,"data_stored":10120127432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":5267943288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,4,4,16,30],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":679788544,"num_objects":10372,"num_object_clones":0,"num_object_copies":31116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82982,"num_write_kb":663856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001590"},"pg_stats":[{"pgid":"5.f","version":"80'25641","reported_seq":25654,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.809368+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:54:12.809368+0000","last_peered":"2026-02-24T07:54:12.809368+0000","last_clean":"2026-02-24T07:54:12.809368+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:12.809368+0000","last_undegraded":"2026-02-24T07:54:12.809368+0000","last_fullsized":"2026-02-24T07:54:12.809368+0000","mapping_epoch":78,"log_start":"80'25638","ondisk_log_start":"80'25638","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210051072,"num_objects":3206,"num_object_clones":0,"num_object_copies":9618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25641,"num_write_kb":205128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'26200","reported_seq":26199,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.832734+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:12.832734+0000","last_peered":"2026-02-24T07:54:12.832734+0000","last_clean":"2026-02-24T07:54:12.832734+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:12.832734+0000","last_undegraded":"2026-02-24T07:54:12.832734+0000","last_fullsized":"2026-02-24T07:54:12.832734+0000","mapping_epoch":78,"log_start":"80'26176","ondisk_log_start":"80'26176","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214630400,"num_objects":3275,"num_object_clones":0,"num_object_copies":9825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26200,"num_write_kb":209600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'26272","reported_seq":26286,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.804626+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:12.804626+0000","last_peered":"2026-02-24T07:54:12.804626+0000","last_clean":"2026-02-24T07:54:12.804626+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:12.804626+0000","last_undegraded":"2026-02-24T07:54:12.804626+0000","last_fullsized":"2026-02-24T07:54:12.804626+0000","mapping_epoch":78,"log_start":"80'26264","ondisk_log_start":"80'26264","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215220224,"num_objects":3284,"num_object_clones":0,"num_object_copies":9852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26272,"num_write_kb":210176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'26192","reported_seq":26203,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.967370+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:54:12.967370+0000","last_peered":"2026-02-24T07:54:12.967370+0000","last_clean":"2026-02-24T07:54:12.967370+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:12.967370+0000","last_undegraded":"2026-02-24T07:54:12.967370+0000","last_fullsized":"2026-02-24T07:54:12.967370+0000","mapping_epoch":78,"log_start":"80'26184","ondisk_log_start":"80'26184","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214564864,"num_objects":3274,"num_object_clones":0,"num_object_copies":9822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26192,"num_write_kb":209536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'25768","reported_seq":25782,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.805550+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:12.805550+0000","last_peered":"2026-02-24T07:54:12.805550+0000","last_clean":"2026-02-24T07:54:12.805550+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:12.805550+0000","last_undegraded":"2026-02-24T07:54:12.805550+0000","last_fullsized":"2026-02-24T07:54:12.805550+0000","mapping_epoch":78,"log_start":"80'25736","ondisk_log_start":"80'25736","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211091456,"num_objects":3221,"num_object_clones":0,"num_object_copies":9663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25768,"num_write_kb":206144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'25912","reported_seq":25926,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.801777+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:54:12.801777+0000","last_peered":"2026-02-24T07:54:12.801777+0000","last_clean":"2026-02-24T07:54:12.801777+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:12.801777+0000","last_undegraded":"2026-02-24T07:54:12.801777+0000","last_fullsized":"2026-02-24T07:54:12.801777+0000","mapping_epoch":78,"log_start":"80'25904","ondisk_log_start":"80'25904","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212271104,"num_objects":3239,"num_object_clones":0,"num_object_copies":9717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25912,"num_write_kb":207296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'26624","reported_seq":26638,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.826835+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:12.826835+0000","last_peered":"2026-02-24T07:54:12.826835+0000","last_clean":"2026-02-24T07:54:12.826835+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:12.826835+0000","last_undegraded":"2026-02-24T07:54:12.826835+0000","last_fullsized":"2026-02-24T07:54:12.826835+0000","mapping_epoch":78,"log_start":"80'26611","ondisk_log_start":"80'26611","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":3328,"num_object_clones":0,"num_object_copies":9984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26624,"num_write_kb":212992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'26456","reported_seq":26470,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.822759+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:12.822759+0000","last_peered":"2026-02-24T07:54:12.822759+0000","last_clean":"2026-02-24T07:54:12.822759+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:12.822759+0000","last_undegraded":"2026-02-24T07:54:12.822759+0000","last_fullsized":"2026-02-24T07:54:12.822759+0000","mapping_epoch":78,"log_start":"80'26440","ondisk_log_start":"80'26440","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216727552,"num_objects":3307,"num_object_clones":0,"num_object_copies":9921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26456,"num_write_kb":211648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'25376","reported_seq":25378,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.832774+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:12.832774+0000","last_peered":"2026-02-24T07:54:12.832774+0000","last_clean":"2026-02-24T07:54:12.832774+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:12.832774+0000","last_undegraded":"2026-02-24T07:54:12.832774+0000","last_fullsized":"2026-02-24T07:54:12.832774+0000","mapping_epoch":78,"log_start":"80'25360","ondisk_log_start":"80'25360","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207880192,"num_objects":3172,"num_object_clones":0,"num_object_copies":9516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25376,"num_write_kb":203008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'26344","reported_seq":26358,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.965517+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:12.965517+0000","last_peered":"2026-02-24T07:54:12.965517+0000","last_clean":"2026-02-24T07:54:12.965517+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:12.965517+0000","last_undegraded":"2026-02-24T07:54:12.965517+0000","last_fullsized":"2026-02-24T07:54:12.965517+0000","mapping_epoch":78,"log_start":"80'26336","ondisk_log_start":"80'26336","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215810048,"num_objects":3293,"num_object_clones":0,"num_object_copies":9879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26344,"num_write_kb":210752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'25568","reported_seq":25582,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.822345+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:54:12.822345+0000","last_peered":"2026-02-24T07:54:12.822345+0000","last_clean":"2026-02-24T07:54:12.822345+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:12.822345+0000","last_undegraded":"2026-02-24T07:54:12.822345+0000","last_fullsized":"2026-02-24T07:54:12.822345+0000","mapping_epoch":78,"log_start":"80'25552","ondisk_log_start":"80'25552","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209453056,"num_objects":3196,"num_object_clones":0,"num_object_copies":9588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25568,"num_write_kb":204544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'25768","reported_seq":25767,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.821755+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:12.821755+0000","last_peered":"2026-02-24T07:54:12.821755+0000","last_clean":"2026-02-24T07:54:12.821755+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:12.821755+0000","last_undegraded":"2026-02-24T07:54:12.821755+0000","last_fullsized":"2026-02-24T07:54:12.821755+0000","mapping_epoch":78,"log_start":"80'25752","ondisk_log_start":"80'25752","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211091456,"num_objects":3221,"num_object_clones":0,"num_object_copies":9663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25768,"num_write_kb":206144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'25912","reported_seq":25926,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.811696+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:54:12.811696+0000","last_peered":"2026-02-24T07:54:12.811696+0000","last_clean":"2026-02-24T07:54:12.811696+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:12.811696+0000","last_undegraded":"2026-02-24T07:54:12.811696+0000","last_fullsized":"2026-02-24T07:54:12.811696+0000","mapping_epoch":78,"log_start":"80'25904","ondisk_log_start":"80'25904","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212271104,"num_objects":3239,"num_object_clones":0,"num_object_copies":9717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25912,"num_write_kb":207296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'26279","reported_seq":26266,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.832187+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:12.832187+0000","last_peered":"2026-02-24T07:54:12.832187+0000","last_clean":"2026-02-24T07:54:12.832187+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:12.832187+0000","last_undegraded":"2026-02-24T07:54:12.832187+0000","last_fullsized":"2026-02-24T07:54:12.832187+0000","mapping_epoch":78,"log_start":"80'26249","ondisk_log_start":"80'26249","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215277568,"num_objects":3285,"num_object_clones":0,"num_object_copies":9855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26279,"num_write_kb":210232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'26192","reported_seq":26206,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.833242+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:12.833242+0000","last_peered":"2026-02-24T07:54:12.833242+0000","last_clean":"2026-02-24T07:54:12.833242+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:12.833242+0000","last_undegraded":"2026-02-24T07:54:12.833242+0000","last_fullsized":"2026-02-24T07:54:12.833242+0000","mapping_epoch":78,"log_start":"80'26184","ondisk_log_start":"80'26184","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214564864,"num_objects":3274,"num_object_clones":0,"num_object_copies":9822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26192,"num_write_kb":209536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'24936","reported_seq":24931,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:12.811814+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:54:12.811814+0000","last_peered":"2026-02-24T07:54:12.811814+0000","last_clean":"2026-02-24T07:54:12.811814+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:12.811814+0000","last_undegraded":"2026-02-24T07:54:12.811814+0000","last_fullsized":"2026-02-24T07:54:12.811814+0000","mapping_epoch":78,"log_start":"80'24916","ondisk_log_start":"80'24916","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204275712,"num_objects":3117,"num_object_clones":0,"num_object_copies":9351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24936,"num_write_kb":199488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3403284480,"num_objects":51931,"num_object_clones":0,"num_object_copies":155793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415440,"num_write_kb":3323520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10211794944,"data_stored":10211794944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215196,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3982696,"kb_used_data":2852116,"kb_used_omap":7,"kb_used_meta":1130552,"kb_avail":730020504,"statfs":{"total":751619276800,"available":747540996096,"internally_reserved":0,"allocated":2920566784,"data_stored":2920003962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1157685609},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,4,16,30],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444125,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3229632,"kb_used_data":2277420,"kb_used_omap":7,"kb_used_meta":952184,"kb_avail":730773568,"statfs":{"total":751619276800,"available":748312133632,"internally_reserved":0,"allocated":2332078080,"data_stored":2331515258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":975036814},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3880444,"kb_used_data":2073704,"kb_used_omap":9,"kb_used_meta":1806710,"kb_avail":730122756,"statfs":{"total":751619276800,"available":747645702144,"internally_reserved":0,"allocated":2123472896,"data_stored":2122913626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1850071902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3936952,"kb_used_data":2681892,"kb_used_omap":11,"kb_used_meta":1255028,"kb_avail":730066248,"statfs":{"total":751619276800,"available":747587837952,"internally_reserved":0,"allocated":2746257408,"data_stored":2745694586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1285148963},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764791808,"data_stored":2764791808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2133639168,"data_stored":2133639168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2340061184,"data_stored":2340061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2973302784,"data_stored":2973302784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:17.250 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 161 2026-02-24T07:54:17.398 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:17.687 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:17.799 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:17.745+0000 7f08fbe06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:17.799 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:17.745+0000 7f08fbe06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:17.832 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:17.890 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:54:17.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 453980 453852 64.4623 54.3516 0.0129763 0.0155017 2026-02-24T07:54:18.054 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:17 trial016 ceph-mon[39544]: from='client.15047 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:18.054 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2141526637' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "161"} : dispatch 2026-02-24T07:54:18.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:18.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:18.113+0000 7fe7dca05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:18.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:18.114+0000 7fe7dca05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:18.147 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:18.148 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:18.160 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:18.160 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:18.176 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:18.176 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:18.198 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:18.199 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:18.964 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 462045 461917 64.4362 63.0078 0.0126112 0.015516 2026-02-24T07:54:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:18 trial016 ceph-mon[39544]: pgmap v280: 17 pgs: 17 active+clean; 3.2 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.91k op/s 2026-02-24T07:54:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/528594097' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:19.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 127 472222 472095 64.7006 79.5156 0.00341318 0.0154518 2026-02-24T07:54:20.247 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:20.398 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:20.527 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:20.524+0000 7f98aef38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:20.527 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:20.525+0000 7f98aef38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:20.549 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:20.549 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:20.564 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:20.564 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:20.575 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:20.575 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:20.590 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:20.591 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:20.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 128 481040 480912 64.7721 68.8828 0.0166283 0.0154346 2026-02-24T07:54:21.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:20 trial016 ceph-mon[39544]: pgmap v281: 17 pgs: 17 active+clean; 3.5 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.06k op/s 2026-02-24T07:54:21.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/925428278' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:21.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 128 489902 489774 64.8477 69.2344 0.00572495 0.0154172 2026-02-24T07:54:22.636 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:22.784 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:22.908 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:22.906+0000 7fdfb38c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:22.909 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:22.906+0000 7fdfb38c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:22.952 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:22.953 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:22.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:54:22.964100+0000 min lat: 0.000558626 max lat: 0.0979723 avg lat: 0.0153915 2026-02-24T07:54:22.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:54:22.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 127 499056 498929 64.9588 71.5234 0.00288346 0.0153915 2026-02-24T07:54:22.967 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:22.967 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:22.981 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:22.981 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:23.000 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:23.000 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:23.061 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:23.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:23.061 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:54:23.062 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:23.210 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:23.235 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:22 trial016 ceph-mon[39544]: pgmap v282: 17 pgs: 17 active+clean; 3.5 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.44k op/s 2026-02-24T07:54:23.235 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1556868505' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:23.339 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:23.337+0000 7ff3d51c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:23.339 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:23.337+0000 7ff3d51c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:23.475 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:23.475 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:23.522 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2026-02-24T07:54:21.800502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3713696288,"num_objects":56661,"num_object_clones":0,"num_object_copies":169983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56661,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":453395,"num_write_kb":3628230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16269756,"kb_used_data":10818348,"kb_used_omap":36,"kb_used_meta":5451291,"kb_avail":2919743044,"statfs":{"total":3006477107200,"available":2989816877056,"internally_reserved":0,"allocated":11077988352,"data_stored":11075740616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":5582122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,8,9,7,26],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":633241600,"num_objects":9663,"num_object_clones":0,"num_object_copies":28989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77300,"num_write_kb":618400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001656"},"pg_stats":[{"pgid":"5.f","version":"80'28064","reported_seq":28078,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.819679+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:54:17.819679+0000","last_peered":"2026-02-24T07:54:17.819679+0000","last_clean":"2026-02-24T07:54:17.819679+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:17.819679+0000","last_undegraded":"2026-02-24T07:54:17.819679+0000","last_fullsized":"2026-02-24T07:54:17.819679+0000","mapping_epoch":78,"log_start":"80'28057","ondisk_log_start":"80'28057","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229900288,"num_objects":3508,"num_object_clones":0,"num_object_copies":10524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28064,"num_write_kb":224512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'28712","reported_seq":28726,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.818740+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:17.818740+0000","last_peered":"2026-02-24T07:54:17.818740+0000","last_clean":"2026-02-24T07:54:17.818740+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:17.818740+0000","last_undegraded":"2026-02-24T07:54:17.818740+0000","last_fullsized":"2026-02-24T07:54:17.818740+0000","mapping_epoch":78,"log_start":"80'28704","ondisk_log_start":"80'28704","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235208704,"num_objects":3589,"num_object_clones":0,"num_object_copies":10767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":229696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'28628","reported_seq":28633,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.834380+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:17.834380+0000","last_peered":"2026-02-24T07:54:17.834380+0000","last_clean":"2026-02-24T07:54:17.834380+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:17.834380+0000","last_undegraded":"2026-02-24T07:54:17.834380+0000","last_fullsized":"2026-02-24T07:54:17.834380+0000","mapping_epoch":78,"log_start":"80'28616","ondisk_log_start":"80'28616","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234520576,"num_objects":3579,"num_object_clones":0,"num_object_copies":10737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28628,"num_write_kb":229024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'28440","reported_seq":28454,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.923533+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:54:17.923533+0000","last_peered":"2026-02-24T07:54:17.923533+0000","last_clean":"2026-02-24T07:54:17.923533+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:17.923533+0000","last_undegraded":"2026-02-24T07:54:17.923533+0000","last_fullsized":"2026-02-24T07:54:17.923533+0000","mapping_epoch":78,"log_start":"80'28432","ondisk_log_start":"80'28432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232980480,"num_objects":3555,"num_object_clones":0,"num_object_copies":10665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28440,"num_write_kb":227520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'28276","reported_seq":28286,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.838287+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:17.838287+0000","last_peered":"2026-02-24T07:54:17.838287+0000","last_clean":"2026-02-24T07:54:17.838287+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:17.838287+0000","last_undegraded":"2026-02-24T07:54:17.838287+0000","last_fullsized":"2026-02-24T07:54:17.838287+0000","mapping_epoch":78,"log_start":"80'28267","ondisk_log_start":"80'28267","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231636992,"num_objects":3535,"num_object_clones":0,"num_object_copies":10605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28276,"num_write_kb":226208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'28352","reported_seq":28366,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.831343+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:54:17.831343+0000","last_peered":"2026-02-24T07:54:17.831343+0000","last_clean":"2026-02-24T07:54:17.831343+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:17.831343+0000","last_undegraded":"2026-02-24T07:54:17.831343+0000","last_fullsized":"2026-02-24T07:54:17.831343+0000","mapping_epoch":78,"log_start":"80'28344","ondisk_log_start":"80'28344","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232259584,"num_objects":3544,"num_object_clones":0,"num_object_copies":10632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3544,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28352,"num_write_kb":226816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'28960","reported_seq":28974,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.814564+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:17.814564+0000","last_peered":"2026-02-24T07:54:17.814564+0000","last_clean":"2026-02-24T07:54:17.814564+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:17.814564+0000","last_undegraded":"2026-02-24T07:54:17.814564+0000","last_fullsized":"2026-02-24T07:54:17.814564+0000","mapping_epoch":78,"log_start":"80'28952","ondisk_log_start":"80'28952","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237240320,"num_objects":3620,"num_object_clones":0,"num_object_copies":10860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28960,"num_write_kb":231680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'28584","reported_seq":28598,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.803902+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:17.803902+0000","last_peered":"2026-02-24T07:54:17.803902+0000","last_clean":"2026-02-24T07:54:17.803902+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:17.803902+0000","last_undegraded":"2026-02-24T07:54:17.803902+0000","last_fullsized":"2026-02-24T07:54:17.803902+0000","mapping_epoch":78,"log_start":"80'28568","ondisk_log_start":"80'28568","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234160128,"num_objects":3573,"num_object_clones":0,"num_object_copies":10719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28584,"num_write_kb":228672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'27792","reported_seq":27788,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.831722+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:17.831722+0000","last_peered":"2026-02-24T07:54:17.831722+0000","last_clean":"2026-02-24T07:54:17.831722+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:17.831722+0000","last_undegraded":"2026-02-24T07:54:17.831722+0000","last_fullsized":"2026-02-24T07:54:17.831722+0000","mapping_epoch":78,"log_start":"80'27768","ondisk_log_start":"80'27768","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227672064,"num_objects":3474,"num_object_clones":0,"num_object_copies":10422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27792,"num_write_kb":222336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'28720","reported_seq":28728,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.965960+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:17.965960+0000","last_peered":"2026-02-24T07:54:17.965960+0000","last_clean":"2026-02-24T07:54:17.965960+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:17.965960+0000","last_undegraded":"2026-02-24T07:54:17.965960+0000","last_fullsized":"2026-02-24T07:54:17.965960+0000","mapping_epoch":78,"log_start":"80'28713","ondisk_log_start":"80'28713","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235274240,"num_objects":3590,"num_object_clones":0,"num_object_copies":10770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28720,"num_write_kb":229760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'27704","reported_seq":27718,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.805494+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:54:17.805494+0000","last_peered":"2026-02-24T07:54:17.805494+0000","last_clean":"2026-02-24T07:54:17.805494+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:17.805494+0000","last_undegraded":"2026-02-24T07:54:17.805494+0000","last_fullsized":"2026-02-24T07:54:17.805494+0000","mapping_epoch":78,"log_start":"80'27681","ondisk_log_start":"80'27681","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:20.921656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226951168,"num_objects":3463,"num_object_clones":0,"num_object_copies":10389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27704,"num_write_kb":221632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'28160","reported_seq":28174,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.832306+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:17.832306+0000","last_peered":"2026-02-24T07:54:17.832306+0000","last_clean":"2026-02-24T07:54:17.832306+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:17.832306+0000","last_undegraded":"2026-02-24T07:54:17.832306+0000","last_fullsized":"2026-02-24T07:54:17.832306+0000","mapping_epoch":78,"log_start":"80'28138","ondisk_log_start":"80'28138","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":3520,"num_object_clones":0,"num_object_copies":10560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28160,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'28024","reported_seq":28038,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.791994+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:54:17.791994+0000","last_peered":"2026-02-24T07:54:17.791994+0000","last_clean":"2026-02-24T07:54:17.791994+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:17.791994+0000","last_undegraded":"2026-02-24T07:54:17.791994+0000","last_fullsized":"2026-02-24T07:54:17.791994+0000","mapping_epoch":78,"log_start":"80'28008","ondisk_log_start":"80'28008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229572608,"num_objects":3503,"num_object_clones":0,"num_object_copies":10509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28024,"num_write_kb":224192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'28548","reported_seq":28558,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.821196+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:17.821196+0000","last_peered":"2026-02-24T07:54:17.821196+0000","last_clean":"2026-02-24T07:54:17.821196+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:17.821196+0000","last_undegraded":"2026-02-24T07:54:17.821196+0000","last_fullsized":"2026-02-24T07:54:17.821196+0000","mapping_epoch":78,"log_start":"80'28520","ondisk_log_start":"80'28520","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233865216,"num_objects":3569,"num_object_clones":0,"num_object_copies":10707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28548,"num_write_kb":228384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'28752","reported_seq":28765,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.841397+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:17.841397+0000","last_peered":"2026-02-24T07:54:17.841397+0000","last_clean":"2026-02-24T07:54:17.841397+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:17.841397+0000","last_undegraded":"2026-02-24T07:54:17.841397+0000","last_fullsized":"2026-02-24T07:54:17.841397+0000","mapping_epoch":78,"log_start":"80'28749","ondisk_log_start":"80'28749","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235536384,"num_objects":3594,"num_object_clones":0,"num_object_copies":10782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28752,"num_write_kb":230016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'27544","reported_seq":27556,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:17.820945+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:54:17.820945+0000","last_peered":"2026-02-24T07:54:17.820945+0000","last_clean":"2026-02-24T07:54:17.820945+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:17.820945+0000","last_undegraded":"2026-02-24T07:54:17.820945+0000","last_fullsized":"2026-02-24T07:54:17.820945+0000","mapping_epoch":78,"log_start":"80'27540","ondisk_log_start":"80'27540","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225640448,"num_objects":3443,"num_object_clones":0,"num_object_copies":10329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27544,"num_write_kb":220352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3713105920,"num_objects":56659,"num_object_clones":0,"num_object_copies":169977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453260,"num_write_kb":3626080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11141226496,"data_stored":11141226496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215197,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4333744,"kb_used_data":3130972,"kb_used_omap":7,"kb_used_meta":1202744,"kb_avail":729669456,"statfs":{"total":751619276800,"available":747181522944,"internally_reserved":0,"allocated":3206115328,"data_stored":3205552506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1231610217},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,8,9,7,26],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444126,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3536624,"kb_used_data":2494172,"kb_used_omap":7,"kb_used_meta":1042424,"kb_avail":730466576,"statfs":{"total":751619276800,"available":747997773824,"internally_reserved":0,"allocated":2554032128,"data_stored":2553469306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1067442574},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4144668,"kb_used_data":2265736,"kb_used_omap":9,"kb_used_meta":1878902,"kb_avail":729858532,"statfs":{"total":751619276800,"available":747375136768,"internally_reserved":0,"allocated":2320113664,"data_stored":2319554394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1923996510},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4254720,"kb_used_data":2927468,"kb_used_omap":11,"kb_used_meta":1327220,"kb_avail":729748480,"statfs":{"total":751619276800,"available":747262443520,"internally_reserved":0,"allocated":2997727232,"data_stored":2997164410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1359073571},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3014983680,"data_stored":3014983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2326724608,"data_stored":2326724608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2555355136,"data_stored":2555355136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3244163072,"data_stored":3244163072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:23.523 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 161 2026-02-24T07:54:23.670 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:23.804 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:23.801+0000 7f92e1890640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:23.804 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:23.801+0000 7f92e1890640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:23.942 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:54:23.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 507760 507632 65.0085 67.9922 0.00331018 0.0153791 2026-02-24T07:54:23.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:24.965 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 516420 516292 65.0511 67.6562 0.00449726 0.0153689 2026-02-24T07:54:25.049 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:25.196 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:25.220 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:24 trial016 ceph-mon[39544]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:25.220 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:24 trial016 ceph-mon[39544]: pgmap v283: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.17k op/s 2026-02-24T07:54:25.221 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1400887386' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "161"} : dispatch 2026-02-24T07:54:25.221 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:25.320 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:25.317+0000 7ffa5d664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:25.320 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:25.317+0000 7ffa5d664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:25.354 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:25.354 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:25.369 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:25.369 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:25.383 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:25.383 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:25.400 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:25.400 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:25.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 524423 524295 65.0109 62.5234 0.00101709 0.0153779 2026-02-24T07:54:26.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3387046969' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:26.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:25 trial016 ceph-mon[39544]: 5.5 scrub starts 2026-02-24T07:54:26.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 128 532728 532600 65.0088 64.8828 0.00580394 0.0153781 2026-02-24T07:54:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:26 trial016 ceph-mon[39544]: 5.f scrub starts 2026-02-24T07:54:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:26 trial016 ceph-mon[39544]: pgmap v284: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.88k op/s 2026-02-24T07:54:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:26 trial016 ceph-mon[39544]: 5.f scrub ok 2026-02-24T07:54:27.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:26 trial016 ceph-mon[39544]: 5.5 scrub ok 2026-02-24T07:54:27.447 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:27.588 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:27.714 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:27.711+0000 7febdf376640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:27.714 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:27.712+0000 7febdf376640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:27.757 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:27.757 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:27.768 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:27.769 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:27.791 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:27.792 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:27.809 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:27.809 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:27.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 128 540810 540682 64.98 63.1406 0.024449 0.0153852 2026-02-24T07:54:28.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:27 trial016 ceph-mon[39544]: 5.2 scrub starts 2026-02-24T07:54:28.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3865453230' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:28.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 549289 549161 64.999 66.2422 0.00988617 0.0153808 2026-02-24T07:54:28.986 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:28.986 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:28.986 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:54:28.986 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:29.135 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:29.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:28 trial016 ceph-mon[39544]: pgmap v285: 17 pgs: 17 active+clean; 3.8 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.88k op/s 2026-02-24T07:54:29.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:29.547+0000 7f19d53a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:29.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:29.547+0000 7f19d53a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:29.701 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:29.702 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:29.788 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2026-02-24T07:54:27.801261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4080222752,"num_objects":62253,"num_object_clones":0,"num_object_copies":186759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62253,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":498137,"num_write_kb":3986166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16740724,"kb_used_data":11866852,"kb_used_omap":36,"kb_used_meta":4873755,"kb_avail":2919272076,"statfs":{"total":3006477107200,"available":2989334605824,"internally_reserved":0,"allocated":12151656448,"data_stored":12149408712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":4990726008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,6,12,6,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":676347904,"num_objects":10320,"num_object_clones":0,"num_object_copies":30960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82562,"num_write_kb":660496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001595"},"pg_stats":[{"pgid":"5.f","version":"80'30456","reported_seq":30470,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.745342+0000","last_change":"2026-02-24T07:53:21.869209+0000","last_active":"2026-02-24T07:54:22.745342+0000","last_peered":"2026-02-24T07:54:22.745342+0000","last_clean":"2026-02-24T07:54:22.745342+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:22.745342+0000","last_undegraded":"2026-02-24T07:54:22.745342+0000","last_fullsized":"2026-02-24T07:54:22.745342+0000","mapping_epoch":78,"log_start":"80'30445","ondisk_log_start":"80'30445","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:23.721896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249495552,"num_objects":3807,"num_object_clones":0,"num_object_copies":11421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3807,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30456,"num_write_kb":243648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'31384","reported_seq":31398,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.822875+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:22.822875+0000","last_peered":"2026-02-24T07:54:22.822875+0000","last_clean":"2026-02-24T07:54:22.822875+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:22.822875+0000","last_undegraded":"2026-02-24T07:54:22.822875+0000","last_fullsized":"2026-02-24T07:54:22.822875+0000","mapping_epoch":78,"log_start":"80'31358","ondisk_log_start":"80'31358","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257097728,"num_objects":3923,"num_object_clones":0,"num_object_copies":11769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31384,"num_write_kb":251072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'31120","reported_seq":31134,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.758638+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:22.758638+0000","last_peered":"2026-02-24T07:54:22.758638+0000","last_clean":"2026-02-24T07:54:22.758638+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:22.758638+0000","last_undegraded":"2026-02-24T07:54:22.758638+0000","last_fullsized":"2026-02-24T07:54:22.758638+0000","mapping_epoch":78,"log_start":"80'31104","ondisk_log_start":"80'31104","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254935040,"num_objects":3890,"num_object_clones":0,"num_object_copies":11670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31120,"num_write_kb":248960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'31192","reported_seq":31206,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.970416+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:54:22.970416+0000","last_peered":"2026-02-24T07:54:22.970416+0000","last_clean":"2026-02-24T07:54:22.970416+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:22.970416+0000","last_undegraded":"2026-02-24T07:54:22.970416+0000","last_fullsized":"2026-02-24T07:54:22.970416+0000","mapping_epoch":78,"log_start":"80'31184","ondisk_log_start":"80'31184","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255524864,"num_objects":3899,"num_object_clones":0,"num_object_copies":11697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3899,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31192,"num_write_kb":249536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'31160","reported_seq":31174,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.836406+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:22.836406+0000","last_peered":"2026-02-24T07:54:22.836406+0000","last_clean":"2026-02-24T07:54:22.836406+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:22.836406+0000","last_undegraded":"2026-02-24T07:54:22.836406+0000","last_fullsized":"2026-02-24T07:54:22.836406+0000","mapping_epoch":78,"log_start":"80'31152","ondisk_log_start":"80'31152","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255262720,"num_objects":3895,"num_object_clones":0,"num_object_copies":11685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31160,"num_write_kb":249280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'31096","reported_seq":31110,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.836251+0000","last_change":"2026-02-24T07:53:21.869298+0000","last_active":"2026-02-24T07:54:22.836251+0000","last_peered":"2026-02-24T07:54:22.836251+0000","last_clean":"2026-02-24T07:54:22.836251+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:22.836251+0000","last_undegraded":"2026-02-24T07:54:22.836251+0000","last_fullsized":"2026-02-24T07:54:22.836251+0000","mapping_epoch":78,"log_start":"80'31072","ondisk_log_start":"80'31072","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:29.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254738432,"num_objects":3887,"num_object_clones":0,"num_object_copies":11661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31096,"num_write_kb":248768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'31832","reported_seq":31829,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.822382+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:22.822382+0000","last_peered":"2026-02-24T07:54:22.822382+0000","last_clean":"2026-02-24T07:54:22.822382+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:22.822382+0000","last_undegraded":"2026-02-24T07:54:22.822382+0000","last_fullsized":"2026-02-24T07:54:22.822382+0000","mapping_epoch":78,"log_start":"80'31814","ondisk_log_start":"80'31814","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260767744,"num_objects":3979,"num_object_clones":0,"num_object_copies":11937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31832,"num_write_kb":254656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'31440","reported_seq":31454,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.834204+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:22.834204+0000","last_peered":"2026-02-24T07:54:22.834204+0000","last_clean":"2026-02-24T07:54:22.834204+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:22.834204+0000","last_undegraded":"2026-02-24T07:54:22.834204+0000","last_fullsized":"2026-02-24T07:54:22.834204+0000","mapping_epoch":78,"log_start":"80'31432","ondisk_log_start":"80'31432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257556480,"num_objects":3930,"num_object_clones":0,"num_object_copies":11790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31440,"num_write_kb":251520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'30499","reported_seq":30510,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.825163+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:22.825163+0000","last_peered":"2026-02-24T07:54:22.825163+0000","last_clean":"2026-02-24T07:54:22.825163+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:22.825163+0000","last_undegraded":"2026-02-24T07:54:22.825163+0000","last_fullsized":"2026-02-24T07:54:22.825163+0000","mapping_epoch":78,"log_start":"80'30488","ondisk_log_start":"80'30488","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249847808,"num_objects":3813,"num_object_clones":0,"num_object_copies":11439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":243992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'31616","reported_seq":31630,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.968466+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:22.968466+0000","last_peered":"2026-02-24T07:54:22.968466+0000","last_clean":"2026-02-24T07:54:22.968466+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:22.968466+0000","last_undegraded":"2026-02-24T07:54:22.968466+0000","last_fullsized":"2026-02-24T07:54:22.968466+0000","mapping_epoch":78,"log_start":"80'31610","ondisk_log_start":"80'31610","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":3952,"num_object_clones":0,"num_object_copies":11856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31616,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'30768","reported_seq":30782,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.835864+0000","last_change":"2026-02-24T07:53:21.868815+0000","last_active":"2026-02-24T07:54:22.835864+0000","last_peered":"2026-02-24T07:54:22.835864+0000","last_clean":"2026-02-24T07:54:22.835864+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:22.835864+0000","last_undegraded":"2026-02-24T07:54:22.835864+0000","last_fullsized":"2026-02-24T07:54:22.835864+0000","mapping_epoch":78,"log_start":"80'30760","ondisk_log_start":"80'30760","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252051456,"num_objects":3846,"num_object_clones":0,"num_object_copies":11538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30768,"num_write_kb":246144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'31112","reported_seq":31126,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.818965+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:22.818965+0000","last_peered":"2026-02-24T07:54:22.818965+0000","last_clean":"2026-02-24T07:54:22.818965+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:22.818965+0000","last_undegraded":"2026-02-24T07:54:22.818965+0000","last_fullsized":"2026-02-24T07:54:22.818965+0000","mapping_epoch":78,"log_start":"80'31088","ondisk_log_start":"80'31088","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254869504,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31112,"num_write_kb":248896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'30864","reported_seq":30878,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.825231+0000","last_change":"2026-02-24T07:53:21.871025+0000","last_active":"2026-02-24T07:54:22.825231+0000","last_peered":"2026-02-24T07:54:22.825231+0000","last_clean":"2026-02-24T07:54:22.825231+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:22.825231+0000","last_undegraded":"2026-02-24T07:54:22.825231+0000","last_fullsized":"2026-02-24T07:54:22.825231+0000","mapping_epoch":78,"log_start":"80'30840","ondisk_log_start":"80'30840","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:26.241481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'31215","reported_seq":31222,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.825336+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:22.825336+0000","last_peered":"2026-02-24T07:54:22.825336+0000","last_clean":"2026-02-24T07:54:22.825336+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:22.825336+0000","last_undegraded":"2026-02-24T07:54:22.825336+0000","last_fullsized":"2026-02-24T07:54:22.825336+0000","mapping_epoch":78,"log_start":"80'31201","ondisk_log_start":"80'31201","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255713280,"num_objects":3902,"num_object_clones":0,"num_object_copies":11706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31215,"num_write_kb":249720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'31536","reported_seq":31550,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.834211+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:22.834211+0000","last_peered":"2026-02-24T07:54:22.834211+0000","last_clean":"2026-02-24T07:54:22.834211+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:22.834211+0000","last_undegraded":"2026-02-24T07:54:22.834211+0000","last_fullsized":"2026-02-24T07:54:22.834211+0000","mapping_epoch":78,"log_start":"80'31528","ondisk_log_start":"80'31528","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258342912,"num_objects":3942,"num_object_clones":0,"num_object_copies":11826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31536,"num_write_kb":252288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'30712","reported_seq":30726,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:22.819847+0000","last_change":"2026-02-24T07:53:21.868064+0000","last_active":"2026-02-24T07:54:22.819847+0000","last_peered":"2026-02-24T07:54:22.819847+0000","last_clean":"2026-02-24T07:54:22.819847+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:22.819847+0000","last_undegraded":"2026-02-24T07:54:22.819847+0000","last_fullsized":"2026-02-24T07:54:22.819847+0000","mapping_epoch":78,"log_start":"80'30707","ondisk_log_start":"80'30707","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:28.944107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251592704,"num_objects":3839,"num_object_clones":0,"num_object_copies":11517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30712,"num_write_kb":245696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4079632384,"num_objects":62251,"num_object_clones":0,"num_object_copies":186753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498002,"num_write_kb":3984016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12241821696,"data_stored":12241821696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215198,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4292328,"kb_used_data":3432532,"kb_used_omap":7,"kb_used_meta":859768,"kb_avail":729710872,"statfs":{"total":751619276800,"available":747223932928,"internally_reserved":0,"allocated":3514912768,"data_stored":3514349946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":880402793},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,6,12,4,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444127,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3870304,"kb_used_data":2737612,"kb_used_omap":7,"kb_used_meta":1132664,"kb_avail":730132896,"statfs":{"total":751619276800,"available":747656085504,"internally_reserved":0,"allocated":2803314688,"data_stored":2802751866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1159848334},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3940852,"kb_used_data":2495008,"kb_used_omap":9,"kb_used_meta":1445814,"kb_avail":730062348,"statfs":{"total":751619276800,"available":747583844352,"internally_reserved":0,"allocated":2554888192,"data_stored":2554328922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1480514398},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4637240,"kb_used_data":3201700,"kb_used_omap":11,"kb_used_meta":1435508,"kb_avail":729365960,"statfs":{"total":751619276800,"available":746870743040,"internally_reserved":0,"allocated":3278540800,"data_stored":3277977978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1469960483},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3308642304,"data_stored":3308642304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2561753088,"data_stored":2561753088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2806358016,"data_stored":2806358016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3565068288,"data_stored":3565068288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:29.790 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:54:29.790 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 171 2026-02-24T07:54:29.854 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:29.937 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:29.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 127 556657 556530 64.8881 57.5703 0.0226079 0.0154077 2026-02-24T07:54:30.005 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:30.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:29 trial016 ceph-mon[39544]: 5.2 scrub ok 2026-02-24T07:54:30.067 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:30.063+0000 7f6853990640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:30.067 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:30.064+0000 7f6853990640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:30.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:30.125+0000 7fefc8c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:30.129 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:30.125+0000 7fefc8c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:30.150 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:30.151 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:30.165 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:30.165 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:30.178 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:30.178 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:30.191 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:30.191 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:30.216 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:54:30.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:30.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 128 565634 565506 64.965 70.125 0.0171958 0.0153895 2026-02-24T07:54:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:30 trial016 ceph-mon[39544]: from='client.15065 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:31.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:30 trial016 ceph-mon[39544]: pgmap v286: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.37k op/s 2026-02-24T07:54:31.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1732263503' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:31.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/901105381' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "171"} : dispatch 2026-02-24T07:54:31.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 574413 574285 65.0174 68.5859 0.00605591 0.0153777 2026-02-24T07:54:32.241 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:32.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:31 trial016 ceph-mon[39544]: 5.4 scrub starts 2026-02-24T07:54:32.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:31 trial016 ceph-mon[39544]: 5.4 scrub ok 2026-02-24T07:54:32.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:31 trial016 ceph-mon[39544]: 5.a scrub starts 2026-02-24T07:54:32.388 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:32.512 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:32.508+0000 7f7ec0b70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:32.512 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:32.508+0000 7f7ec0b70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:32.551 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:32.552 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:32.564 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:32.564 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:32.576 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:32.577 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:32.591 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:32.592 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:32.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 127 583127 583000 65.0612 68.0859 0.0324964 0.0153667 2026-02-24T07:54:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:32 trial016 ceph-mon[39544]: pgmap v287: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.22k op/s 2026-02-24T07:54:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2069407163' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:32 trial016 ceph-mon[39544]: 5.a scrub ok 2026-02-24T07:54:33.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 127 591971 591844 65.1179 69.0938 0.00634475 0.0153539 2026-02-24T07:54:34.637 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:34.784 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:34.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 128 600696 600568 65.16 68.1562 0.0427993 0.0153395 2026-02-24T07:54:35.192 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:34 trial016 ceph-mon[39544]: pgmap v288: 17 pgs: 17 active+clean; 4.4 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.74k op/s 2026-02-24T07:54:35.192 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:35.254 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:35.255 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:35.255 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:35.188+0000 7fdee9b9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:35.255 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:35.188+0000 7fdee9b9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:35.255 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:35.255 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:35.259 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:35.259 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:35.259 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:54:35.259 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:35.269 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:35.269 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:35.291 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:35.291 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:35.402 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:35.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 127 607035 606908 64.9459 49.5312 0.00319401 0.0153946 2026-02-24T07:54:36.185 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1072029121' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:36.367 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:36.317+0000 7f8f1ce75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:36.368 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:36.318+0000 7f8f1ce75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:36.468 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:36.469 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:36.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 127 613044 612917 64.7026 46.9453 0.0163685 0.0154524 2026-02-24T07:54:37.044 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:36 trial016 ceph-mon[39544]: pgmap v289: 17 pgs: 17 active+clean; 4.4 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.01k op/s 2026-02-24T07:54:37.072 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2026-02-24T07:54:35.802362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4769382944,"num_objects":72769,"num_object_clones":0,"num_object_copies":218307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72769,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":582263,"num_write_kb":4659174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19370108,"kb_used_data":13882604,"kb_used_omap":36,"kb_used_meta":5487387,"kb_avail":2916642692,"statfs":{"total":3006477107200,"available":2986642116608,"internally_reserved":0,"allocated":14215786496,"data_stored":14213538760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":5619085176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":689160192,"num_objects":10516,"num_object_clones":0,"num_object_copies":31548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84126,"num_write_kb":673008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001634"},"pg_stats":[{"pgid":"5.f","version":"80'35800","reported_seq":35862,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.775232+0000","last_change":"2026-02-24T07:54:26.163507+0000","last_active":"2026-02-24T07:54:32.775232+0000","last_peered":"2026-02-24T07:54:32.775232+0000","last_clean":"2026-02-24T07:54:32.775232+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:32.775232+0000","last_undegraded":"2026-02-24T07:54:32.775232+0000","last_fullsized":"2026-02-24T07:54:32.775232+0000","mapping_epoch":78,"log_start":"80'35792","ondisk_log_start":"80'35792","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32216","last_scrub_stamp":"2026-02-24T07:54:26.163478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.163478+0000","objects_scrubbed":4019,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:33.593692+0000","scrub_duration":440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293273600,"num_objects":4475,"num_object_clones":0,"num_object_copies":13425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35800,"num_write_kb":286400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'36576","reported_seq":36590,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.835147+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:32.835147+0000","last_peered":"2026-02-24T07:54:32.835147+0000","last_clean":"2026-02-24T07:54:32.835147+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:32.835147+0000","last_undegraded":"2026-02-24T07:54:32.835147+0000","last_fullsized":"2026-02-24T07:54:32.835147+0000","mapping_epoch":78,"log_start":"80'36560","ondisk_log_start":"80'36560","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299630592,"num_objects":4572,"num_object_clones":0,"num_object_copies":13716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36576,"num_write_kb":292608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'36624","reported_seq":36638,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.824364+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:32.824364+0000","last_peered":"2026-02-24T07:54:32.824364+0000","last_clean":"2026-02-24T07:54:32.824364+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:32.824364+0000","last_undegraded":"2026-02-24T07:54:32.824364+0000","last_fullsized":"2026-02-24T07:54:32.824364+0000","mapping_epoch":78,"log_start":"80'36616","ondisk_log_start":"80'36616","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300023808,"num_objects":4578,"num_object_clones":0,"num_object_copies":13734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4578,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36624,"num_write_kb":292992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'36072","reported_seq":36086,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.934930+0000","last_change":"2026-02-24T07:53:21.869002+0000","last_active":"2026-02-24T07:54:32.934930+0000","last_peered":"2026-02-24T07:54:32.934930+0000","last_clean":"2026-02-24T07:54:32.934930+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:32.934930+0000","last_undegraded":"2026-02-24T07:54:32.934930+0000","last_fullsized":"2026-02-24T07:54:32.934930+0000","mapping_epoch":78,"log_start":"80'36066","ondisk_log_start":"80'36066","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:35.808900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295501824,"num_objects":4509,"num_object_clones":0,"num_object_copies":13527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36072,"num_write_kb":288576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'36272","reported_seq":36286,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.844675+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:32.844675+0000","last_peered":"2026-02-24T07:54:32.844675+0000","last_clean":"2026-02-24T07:54:32.844675+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:32.844675+0000","last_undegraded":"2026-02-24T07:54:32.844675+0000","last_fullsized":"2026-02-24T07:54:32.844675+0000","mapping_epoch":78,"log_start":"80'36256","ondisk_log_start":"80'36256","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297140224,"num_objects":4534,"num_object_clones":0,"num_object_copies":13602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36272,"num_write_kb":290176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'36456","reported_seq":36524,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.823287+0000","last_change":"2026-02-24T07:54:32.632828+0000","last_active":"2026-02-24T07:54:32.823287+0000","last_peered":"2026-02-24T07:54:32.823287+0000","last_clean":"2026-02-24T07:54:32.823287+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:32.823287+0000","last_undegraded":"2026-02-24T07:54:32.823287+0000","last_fullsized":"2026-02-24T07:54:32.823287+0000","mapping_epoch":78,"log_start":"80'36440","ondisk_log_start":"80'36440","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'36368","last_scrub_stamp":"2026-02-24T07:54:32.632782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:32.632782+0000","objects_scrubbed":4504,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:35.654029+0000","scrub_duration":1284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298647552,"num_objects":4557,"num_object_clones":0,"num_object_copies":13671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36456,"num_write_kb":291648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'36880","reported_seq":36894,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.827319+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:32.827319+0000","last_peered":"2026-02-24T07:54:32.827319+0000","last_clean":"2026-02-24T07:54:32.827319+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:32.827319+0000","last_undegraded":"2026-02-24T07:54:32.827319+0000","last_fullsized":"2026-02-24T07:54:32.827319+0000","mapping_epoch":78,"log_start":"80'36864","ondisk_log_start":"80'36864","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:36.274674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302120960,"num_objects":4610,"num_object_clones":0,"num_object_copies":13830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36880,"num_write_kb":295040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'36400","reported_seq":36414,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.824677+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:32.824677+0000","last_peered":"2026-02-24T07:54:32.824677+0000","last_clean":"2026-02-24T07:54:32.824677+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:32.824677+0000","last_undegraded":"2026-02-24T07:54:32.824677+0000","last_fullsized":"2026-02-24T07:54:32.824677+0000","mapping_epoch":78,"log_start":"80'36392","ondisk_log_start":"80'36392","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298188800,"num_objects":4550,"num_object_clones":0,"num_object_copies":13650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36400,"num_write_kb":291200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'35920","reported_seq":35934,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.834093+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:32.834093+0000","last_peered":"2026-02-24T07:54:32.834093+0000","last_clean":"2026-02-24T07:54:32.834093+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:32.834093+0000","last_undegraded":"2026-02-24T07:54:32.834093+0000","last_fullsized":"2026-02-24T07:54:32.834093+0000","mapping_epoch":78,"log_start":"80'35912","ondisk_log_start":"80'35912","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294256640,"num_objects":4490,"num_object_clones":0,"num_object_copies":13470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35920,"num_write_kb":287360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'36704","reported_seq":36718,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.967422+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:32.967422+0000","last_peered":"2026-02-24T07:54:32.967422+0000","last_clean":"2026-02-24T07:54:32.967422+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:32.967422+0000","last_undegraded":"2026-02-24T07:54:32.967422+0000","last_fullsized":"2026-02-24T07:54:32.967422+0000","mapping_epoch":78,"log_start":"80'36672","ondisk_log_start":"80'36672","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300679168,"num_objects":4588,"num_object_clones":0,"num_object_copies":13764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36704,"num_write_kb":293632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'36186","reported_seq":36243,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.844507+0000","last_change":"2026-02-24T07:54:26.737811+0000","last_active":"2026-02-24T07:54:32.844507+0000","last_peered":"2026-02-24T07:54:32.844507+0000","last_clean":"2026-02-24T07:54:32.844507+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:32.844507+0000","last_undegraded":"2026-02-24T07:54:32.844507+0000","last_fullsized":"2026-02-24T07:54:32.844507+0000","mapping_epoch":78,"log_start":"80'36170","ondisk_log_start":"80'36170","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32720","last_scrub_stamp":"2026-02-24T07:54:26.737739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.737739+0000","objects_scrubbed":4050,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.916612+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296435712,"num_objects":4524,"num_object_clones":0,"num_object_copies":13572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36186,"num_write_kb":289488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'36144","reported_seq":36151,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.847422+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:32.847422+0000","last_peered":"2026-02-24T07:54:32.847422+0000","last_clean":"2026-02-24T07:54:32.847422+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:32.847422+0000","last_undegraded":"2026-02-24T07:54:32.847422+0000","last_fullsized":"2026-02-24T07:54:32.847422+0000","mapping_epoch":78,"log_start":"80'36128","ondisk_log_start":"80'36128","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296091648,"num_objects":4518,"num_object_clones":0,"num_object_copies":13554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36144,"num_write_kb":289152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'36288","reported_seq":36355,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.834301+0000","last_change":"2026-02-24T07:54:28.375175+0000","last_active":"2026-02-24T07:54:32.834301+0000","last_peered":"2026-02-24T07:54:32.834301+0000","last_clean":"2026-02-24T07:54:32.834301+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:32.834301+0000","last_undegraded":"2026-02-24T07:54:32.834301+0000","last_fullsized":"2026-02-24T07:54:32.834301+0000","mapping_epoch":78,"log_start":"80'36280","ondisk_log_start":"80'36280","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'34016","last_scrub_stamp":"2026-02-24T07:54:28.375143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:28.375143+0000","objects_scrubbed":4207,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:50.214828+0000","scrub_duration":1406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297271296,"num_objects":4536,"num_object_clones":0,"num_object_copies":13608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36288,"num_write_kb":290304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'36496","reported_seq":36510,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.833436+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:32.833436+0000","last_peered":"2026-02-24T07:54:32.833436+0000","last_clean":"2026-02-24T07:54:32.833436+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:32.833436+0000","last_undegraded":"2026-02-24T07:54:32.833436+0000","last_fullsized":"2026-02-24T07:54:32.833436+0000","mapping_epoch":78,"log_start":"80'36488","ondisk_log_start":"80'36488","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298975232,"num_objects":4562,"num_object_clones":0,"num_object_copies":13686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36496,"num_write_kb":291968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'36904","reported_seq":36918,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.821769+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:32.821769+0000","last_peered":"2026-02-24T07:54:32.821769+0000","last_clean":"2026-02-24T07:54:32.821769+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:32.821769+0000","last_undegraded":"2026-02-24T07:54:32.821769+0000","last_fullsized":"2026-02-24T07:54:32.821769+0000","mapping_epoch":78,"log_start":"80'36897","ondisk_log_start":"80'36897","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302317568,"num_objects":4613,"num_object_clones":0,"num_object_copies":13839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36904,"num_write_kb":295232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'36406","reported_seq":36466,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:32.822080+0000","last_change":"2026-02-24T07:54:31.198542+0000","last_active":"2026-02-24T07:54:32.822080+0000","last_peered":"2026-02-24T07:54:32.822080+0000","last_clean":"2026-02-24T07:54:32.822080+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:32.822080+0000","last_undegraded":"2026-02-24T07:54:32.822080+0000","last_fullsized":"2026-02-24T07:54:32.822080+0000","mapping_epoch":78,"log_start":"80'36399","ondisk_log_start":"80'36399","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'35440","last_scrub_stamp":"2026-02-24T07:54:31.198510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:31.198510+0000","objects_scrubbed":4413,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:48.497357+0000","scrub_duration":462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298237952,"num_objects":4551,"num_object_clones":0,"num_object_copies":13653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36406,"num_write_kb":291248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4768792576,"num_objects":72767,"num_object_clones":0,"num_object_copies":218301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582128,"num_write_kb":4657024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14309810176,"data_stored":14309810176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215200,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5061800,"kb_used_data":4021524,"kb_used_omap":7,"kb_used_meta":1040248,"kb_avail":728941400,"statfs":{"total":751619276800,"available":746435993600,"internally_reserved":0,"allocated":4118040576,"data_stored":4117477754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1065214313},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444129,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4494808,"kb_used_data":3199684,"kb_used_omap":7,"kb_used_meta":1295096,"kb_avail":729508392,"statfs":{"total":751619276800,"available":747016593408,"internally_reserved":0,"allocated":3276476416,"data_stored":3275913594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1326178702},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4484204,"kb_used_data":2912024,"kb_used_omap":9,"kb_used_meta":1572150,"kb_avail":729518996,"statfs":{"total":751619276800,"available":747027451904,"internally_reserved":0,"allocated":2981912576,"data_stored":2981353306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1609882462},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705766,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5329296,"kb_used_data":3749372,"kb_used_omap":11,"kb_used_meta":1579892,"kb_avail":728673904,"statfs":{"total":751619276800,"available":746162077696,"internally_reserved":0,"allocated":3839356928,"data_stored":3838794106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1617809699},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3868327936,"data_stored":3868327936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2991095808,"data_stored":2991095808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3280207872,"data_stored":3280207872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4170178560,"data_stored":4170178560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:37.074 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:54:37.075 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 66 2026-02-24T07:54:37.258 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:37.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:37.666+0000 7f2062206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:37.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:37.666+0000 7f2062206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:37.814 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:54:37.959 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:37.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 619726 619598 64.5358 52.1953 0.0038601 0.0154913 2026-02-24T07:54:38.167 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:38.258 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:37 trial016 ceph-mon[39544]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:38.259 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1580474493' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T07:54:38.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:38.724 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:38.698+0000 7f70486aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:38.724 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:38.699+0000 7f70486aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:38.767 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:38.768 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:38.782 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:38.782 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:38.798 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:38.799 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:38.811 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:38.811 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:38.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 127 625809 625682 64.312 47.5312 0.00454697 0.0155467 2026-02-24T07:54:39.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:38 trial016 ceph-mon[39544]: 5.c scrub starts 2026-02-24T07:54:39.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:38 trial016 ceph-mon[39544]: pgmap v290: 17 pgs: 17 active+clean; 4.4 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.01k op/s 2026-02-24T07:54:39.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/758245558' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:39.966 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 127 634377 634250 64.346 66.9375 0.0263492 0.0155377 2026-02-24T07:54:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:39 trial016 ceph-mon[39544]: 5.c scrub ok 2026-02-24T07:54:40.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 128 643134 643006 64.398 68.4062 0.00387475 0.0155252 2026-02-24T07:54:40.992 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:41.134 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:41.204 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:40 trial016 ceph-mon[39544]: pgmap v291: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.10k op/s 2026-02-24T07:54:41.269 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:41.267+0000 7f41f73af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:41.269 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:41.267+0000 7f41f73af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:41.316 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:41.316 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:41.328 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:41.328 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:41.342 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:41.342 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:41.363 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:41.363 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:41.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 127 651845 651718 64.4443 68.0625 0.0121192 0.0155151 2026-02-24T07:54:42.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/84420178' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:42.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:54:42.965647+0000 min lat: 0.000558626 max lat: 0.104159 avg lat: 0.0155115 2026-02-24T07:54:42.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:54:42.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 660193 660065 64.4538 65.2109 0.0269395 0.0155115 2026-02-24T07:54:43.285 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:43.285 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:43.286 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:54:43.286 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:43.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:42 trial016 ceph-mon[39544]: pgmap v292: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.60k op/s 2026-02-24T07:54:43.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:42 trial016 ceph-mon[39544]: 5.b scrub starts 2026-02-24T07:54:43.410 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:43.428 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:43.558 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:43.555+0000 7f973259a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:43.558 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:43.555+0000 7f973259a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:43.561 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:43.680 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:43.677+0000 7f3393a69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:43.680 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:43.677+0000 7f3393a69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:43.710 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:43.711 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:43.715 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:43.715 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:43.731 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:43.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:43.745 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:43.746 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:43.757 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:43.758 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:43.764 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2026-02-24T07:54:41.803196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5072822816,"num_objects":77399,"num_object_clones":0,"num_object_copies":232197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77399,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":619304,"num_write_kb":4955502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20526372,"kb_used_data":14787540,"kb_used_omap":36,"kb_used_meta":5738715,"kb_avail":2915486428,"statfs":{"total":3006477107200,"available":2985458102272,"internally_reserved":0,"allocated":15142440960,"data_stored":15140193224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":5876445048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[24,2,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":649207808,"num_objects":9906,"num_object_clones":0,"num_object_copies":29718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79249,"num_write_kb":633992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001678"},"pg_stats":[{"pgid":"5.f","version":"80'38304","reported_seq":38358,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.822474+0000","last_change":"2026-02-24T07:54:26.163507+0000","last_active":"2026-02-24T07:54:37.822474+0000","last_peered":"2026-02-24T07:54:37.822474+0000","last_clean":"2026-02-24T07:54:37.822474+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:37.822474+0000","last_undegraded":"2026-02-24T07:54:37.822474+0000","last_fullsized":"2026-02-24T07:54:37.822474+0000","mapping_epoch":78,"log_start":"80'38288","ondisk_log_start":"80'38288","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32216","last_scrub_stamp":"2026-02-24T07:54:26.163478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.163478+0000","objects_scrubbed":4019,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:33.593692+0000","scrub_duration":440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313786368,"num_objects":4788,"num_object_clones":0,"num_object_copies":14364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38304,"num_write_kb":306432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'38744","reported_seq":38758,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.827298+0000","last_change":"2026-02-24T07:53:21.871207+0000","last_active":"2026-02-24T07:54:37.827298+0000","last_peered":"2026-02-24T07:54:37.827298+0000","last_clean":"2026-02-24T07:54:37.827298+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:37.827298+0000","last_undegraded":"2026-02-24T07:54:37.827298+0000","last_fullsized":"2026-02-24T07:54:37.827298+0000","mapping_epoch":78,"log_start":"80'38736","ondisk_log_start":"80'38736","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.328457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317390848,"num_objects":4843,"num_object_clones":0,"num_object_copies":14529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38744,"num_write_kb":309952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'38876","reported_seq":38880,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.888350+0000","last_change":"2026-02-24T07:53:21.868146+0000","last_active":"2026-02-24T07:54:37.888350+0000","last_peered":"2026-02-24T07:54:37.888350+0000","last_clean":"2026-02-24T07:54:37.888350+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:37.888350+0000","last_undegraded":"2026-02-24T07:54:37.888350+0000","last_fullsized":"2026-02-24T07:54:37.888350+0000","mapping_epoch":78,"log_start":"80'38864","ondisk_log_start":"80'38864","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.775192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318472192,"num_objects":4860,"num_object_clones":0,"num_object_copies":14580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4860,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38876,"num_write_kb":311008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'38224","reported_seq":38247,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:37.965730+0000","last_change":"2026-02-24T07:54:37.770037+0000","last_active":"2026-02-24T07:54:37.965730+0000","last_peered":"2026-02-24T07:54:37.965730+0000","last_clean":"2026-02-24T07:54:37.965730+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:37.965730+0000","last_undegraded":"2026-02-24T07:54:37.965730+0000","last_fullsized":"2026-02-24T07:54:37.965730+0000","mapping_epoch":78,"log_start":"80'38216","ondisk_log_start":"80'38216","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":1249,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313131008,"num_objects":4778,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38224,"num_write_kb":305792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'38664","reported_seq":38678,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.838071+0000","last_change":"2026-02-24T07:53:21.868753+0000","last_active":"2026-02-24T07:54:37.838071+0000","last_peered":"2026-02-24T07:54:37.838071+0000","last_clean":"2026-02-24T07:54:37.838071+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:37.838071+0000","last_undegraded":"2026-02-24T07:54:37.838071+0000","last_fullsized":"2026-02-24T07:54:37.838071+0000","mapping_epoch":78,"log_start":"80'38656","ondisk_log_start":"80'38656","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:39.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316735488,"num_objects":4833,"num_object_clones":0,"num_object_copies":14499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38664,"num_write_kb":309312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'39000","reported_seq":39064,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.886990+0000","last_change":"2026-02-24T07:54:32.632828+0000","last_active":"2026-02-24T07:54:37.886990+0000","last_peered":"2026-02-24T07:54:37.886990+0000","last_clean":"2026-02-24T07:54:37.886990+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:37.886990+0000","last_undegraded":"2026-02-24T07:54:37.886990+0000","last_fullsized":"2026-02-24T07:54:37.886990+0000","mapping_epoch":78,"log_start":"80'38988","ondisk_log_start":"80'38988","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'36368","last_scrub_stamp":"2026-02-24T07:54:32.632782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:32.632782+0000","objects_scrubbed":4504,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:35.654029+0000","scrub_duration":1284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319488000,"num_objects":4875,"num_object_clones":0,"num_object_copies":14625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39000,"num_write_kb":312000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'39344","reported_seq":39358,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.811098+0000","last_change":"2026-02-24T07:53:21.871216+0000","last_active":"2026-02-24T07:54:37.811098+0000","last_peered":"2026-02-24T07:54:37.811098+0000","last_clean":"2026-02-24T07:54:37.811098+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:37.811098+0000","last_undegraded":"2026-02-24T07:54:37.811098+0000","last_fullsized":"2026-02-24T07:54:37.811098+0000","mapping_epoch":78,"log_start":"80'39336","ondisk_log_start":"80'39336","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322306048,"num_objects":4918,"num_object_clones":0,"num_object_copies":14754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39344,"num_write_kb":314752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'38712","reported_seq":38726,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.834810+0000","last_change":"2026-02-24T07:53:21.869019+0000","last_active":"2026-02-24T07:54:37.834810+0000","last_peered":"2026-02-24T07:54:37.834810+0000","last_clean":"2026-02-24T07:54:37.834810+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:37.834810+0000","last_undegraded":"2026-02-24T07:54:37.834810+0000","last_fullsized":"2026-02-24T07:54:37.834810+0000","mapping_epoch":78,"log_start":"80'38704","ondisk_log_start":"80'38704","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.438924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317128704,"num_objects":4839,"num_object_clones":0,"num_object_copies":14517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38712,"num_write_kb":309696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'38080","reported_seq":38086,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.835908+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:37.835908+0000","last_peered":"2026-02-24T07:54:37.835908+0000","last_clean":"2026-02-24T07:54:37.835908+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:37.835908+0000","last_undegraded":"2026-02-24T07:54:37.835908+0000","last_fullsized":"2026-02-24T07:54:37.835908+0000","mapping_epoch":78,"log_start":"80'38065","ondisk_log_start":"80'38065","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311951360,"num_objects":4760,"num_object_clones":0,"num_object_copies":14280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38080,"num_write_kb":304640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'39016","reported_seq":39030,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.964154+0000","last_change":"2026-02-24T07:53:21.869319+0000","last_active":"2026-02-24T07:54:37.964154+0000","last_peered":"2026-02-24T07:54:37.964154+0000","last_clean":"2026-02-24T07:54:37.964154+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:37.964154+0000","last_undegraded":"2026-02-24T07:54:37.964154+0000","last_fullsized":"2026-02-24T07:54:37.964154+0000","mapping_epoch":78,"log_start":"80'39010","ondisk_log_start":"80'39010","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:43.596132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319619072,"num_objects":4877,"num_object_clones":0,"num_object_copies":14631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39016,"num_write_kb":312128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'38584","reported_seq":38641,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.888223+0000","last_change":"2026-02-24T07:54:26.737811+0000","last_active":"2026-02-24T07:54:37.888223+0000","last_peered":"2026-02-24T07:54:37.888223+0000","last_clean":"2026-02-24T07:54:37.888223+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:37.888223+0000","last_undegraded":"2026-02-24T07:54:37.888223+0000","last_fullsized":"2026-02-24T07:54:37.888223+0000","mapping_epoch":78,"log_start":"80'38576","ondisk_log_start":"80'38576","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32720","last_scrub_stamp":"2026-02-24T07:54:26.737739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.737739+0000","objects_scrubbed":4050,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.916612+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316080128,"num_objects":4823,"num_object_clones":0,"num_object_copies":14469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38584,"num_write_kb":308672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'38464","reported_seq":38478,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.817704+0000","last_change":"2026-02-24T07:53:21.868676+0000","last_active":"2026-02-24T07:54:37.817704+0000","last_peered":"2026-02-24T07:54:37.817704+0000","last_clean":"2026-02-24T07:54:37.817704+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:37.817704+0000","last_undegraded":"2026-02-24T07:54:37.817704+0000","last_fullsized":"2026-02-24T07:54:37.817704+0000","mapping_epoch":78,"log_start":"80'38457","ondisk_log_start":"80'38457","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:40.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315097088,"num_objects":4808,"num_object_clones":0,"num_object_copies":14424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38464,"num_write_kb":307712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'38352","reported_seq":38419,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.822371+0000","last_change":"2026-02-24T07:54:28.375175+0000","last_active":"2026-02-24T07:54:37.822371+0000","last_peered":"2026-02-24T07:54:37.822371+0000","last_clean":"2026-02-24T07:54:37.822371+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:37.822371+0000","last_undegraded":"2026-02-24T07:54:37.822371+0000","last_fullsized":"2026-02-24T07:54:37.822371+0000","mapping_epoch":78,"log_start":"80'38344","ondisk_log_start":"80'38344","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'34016","last_scrub_stamp":"2026-02-24T07:54:28.375143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:28.375143+0000","objects_scrubbed":4207,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:50.214828+0000","scrub_duration":1406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314179584,"num_objects":4794,"num_object_clones":0,"num_object_copies":14382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38352,"num_write_kb":306816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'38776","reported_seq":38790,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.823030+0000","last_change":"2026-02-24T07:53:21.871303+0000","last_active":"2026-02-24T07:54:37.823030+0000","last_peered":"2026-02-24T07:54:37.823030+0000","last_clean":"2026-02-24T07:54:37.823030+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:37.823030+0000","last_undegraded":"2026-02-24T07:54:37.823030+0000","last_fullsized":"2026-02-24T07:54:37.823030+0000","mapping_epoch":78,"log_start":"80'38760","ondisk_log_start":"80'38760","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:45.665472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317652992,"num_objects":4847,"num_object_clones":0,"num_object_copies":14541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38776,"num_write_kb":310208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'39296","reported_seq":39310,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.817783+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:37.817783+0000","last_peered":"2026-02-24T07:54:37.817783+0000","last_clean":"2026-02-24T07:54:37.817783+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:37.817783+0000","last_undegraded":"2026-02-24T07:54:37.817783+0000","last_fullsized":"2026-02-24T07:54:37.817783+0000","mapping_epoch":78,"log_start":"80'39288","ondisk_log_start":"80'39288","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":4912,"num_object_clones":0,"num_object_copies":14736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39296,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'38733","reported_seq":38794,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:37.819590+0000","last_change":"2026-02-24T07:54:31.198542+0000","last_active":"2026-02-24T07:54:37.819590+0000","last_peered":"2026-02-24T07:54:37.819590+0000","last_clean":"2026-02-24T07:54:37.819590+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:37.819590+0000","last_undegraded":"2026-02-24T07:54:37.819590+0000","last_fullsized":"2026-02-24T07:54:37.819590+0000","mapping_epoch":78,"log_start":"80'38726","ondisk_log_start":"80'38726","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'35440","last_scrub_stamp":"2026-02-24T07:54:31.198510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:31.198510+0000","objects_scrubbed":4413,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:48.497357+0000","scrub_duration":462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317300736,"num_objects":4842,"num_object_clones":0,"num_object_copies":14526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38733,"num_write_kb":309864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":5072232448,"num_objects":77397,"num_object_clones":0,"num_object_copies":232191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619169,"num_write_kb":4953352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15219154944,"data_stored":15219154944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215201,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5415520,"kb_used_data":4285004,"kb_used_omap":7,"kb_used_meta":1130488,"kb_avail":728587680,"statfs":{"total":751619276800,"available":746073784320,"internally_reserved":0,"allocated":4387844096,"data_stored":4387281274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1157620073},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444130,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4770160,"kb_used_data":3402844,"kb_used_omap":7,"kb_used_meta":1367288,"kb_avail":729233040,"statfs":{"total":751619276800,"available":746734632960,"internally_reserved":0,"allocated":3484512256,"data_stored":3483949434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1400103310},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4687460,"kb_used_data":3098640,"kb_used_omap":9,"kb_used_meta":1588790,"kb_avail":729315740,"statfs":{"total":751619276800,"available":746819317760,"internally_reserved":0,"allocated":3173007360,"data_stored":3172448090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1626921822},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5653232,"kb_used_data":4001052,"kb_used_omap":11,"kb_used_meta":1652148,"kb_avail":728349968,"statfs":{"total":751619276800,"available":745830367232,"internally_reserved":0,"allocated":4097077248,"data_stored":4096514426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1691799843},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[24,2,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4113612800,"data_stored":4113612800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3179290624,"data_stored":3179290624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3489374208,"data_stored":3489374208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4436877312,"data_stored":4436877312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:43.766 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:54:43.767 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 76 2026-02-24T07:54:43.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 128 668789 668661 64.4871 67.1562 0.028386 0.0155025 2026-02-24T07:54:43.990 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:44.120 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:44.118+0000 7f4b7e029640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:44.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:44.118+0000 7f4b7e029640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:44.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/399849367' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:44.268 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:54:44.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:44.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 677459 677331 64.5267 67.7344 0.0226079 0.0154939 2026-02-24T07:54:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:44 trial016 ceph-mon[39544]: from='client.15083 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:44 trial016 ceph-mon[39544]: pgmap v293: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 9.95k op/s 2026-02-24T07:54:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:44 trial016 ceph-mon[39544]: 5.b scrub ok 2026-02-24T07:54:45.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:44 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/689631939' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "76"} : dispatch 2026-02-24T07:54:45.806 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:45.954 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:45.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 128 686044 685916 64.5573 67.0703 0.0171305 0.0154873 2026-02-24T07:54:46.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:45 trial016 ceph-mon[39544]: 5.9 scrub starts 2026-02-24T07:54:46.152 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:45 trial016 ceph-mon[39544]: 5.6 scrub starts 2026-02-24T07:54:46.152 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:45 trial016 ceph-mon[39544]: 5.3 scrub starts 2026-02-24T07:54:46.370 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:46.354+0000 7fb204f1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:46.370 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:46.354+0000 7fb204f1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:46.371 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:46.371 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:46.396 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:46.396 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:46.408 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:46.409 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:46.428 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:46.428 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:46.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 127 692509 692382 64.3901 50.5156 0.00577869 0.015528 2026-02-24T07:54:47.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: pgmap v294: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.43k op/s 2026-02-24T07:54:47.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: 5.e scrub starts 2026-02-24T07:54:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: 5.9 scrub ok 2026-02-24T07:54:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: 5.6 scrub ok 2026-02-24T07:54:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2881345086' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:46 trial016 ceph-mon[39544]: 5.d scrub starts 2026-02-24T07:54:47.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 700607 700479 64.3767 63.2578 0.0119286 0.0155308 2026-02-24T07:54:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:47 trial016 ceph-mon[39544]: 5.1 scrub starts 2026-02-24T07:54:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:47 trial016 ceph-mon[39544]: 5.3 scrub ok 2026-02-24T07:54:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:47 trial016 ceph-mon[39544]: 5.8 scrub starts 2026-02-24T07:54:48.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 127 709309 709182 64.4187 67.9922 0.0154468 0.0155209 2026-02-24T07:54:49.125 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:49.277 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:49.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:48 trial016 ceph-mon[39544]: 5.e scrub ok 2026-02-24T07:54:49.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:48 trial016 ceph-mon[39544]: pgmap v295: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.43k op/s 2026-02-24T07:54:49.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:48 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:54:49.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:48 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:54:49.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:48 trial016 ceph-mon[39544]: 5.d scrub ok 2026-02-24T07:54:49.334 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:49.334 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:49.334 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:49.472 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:49.457+0000 7fb337fc4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:49.472 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:49.458+0000 7fb337fc4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:49.480 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:49.494 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:49.494 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:49.510 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:49.510 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:49.522 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:49.522 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:49.539 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:49.539 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:49.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 716702 716574 64.342 57.75 0.00626472 0.0155392 2026-02-24T07:54:50.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:49 trial016 ceph-mon[39544]: 5.1 scrub ok 2026-02-24T07:54:50.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:49 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:54:50.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:49 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:54:50.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:49 trial016 ceph-mon[39544]: 5.8 scrub ok 2026-02-24T07:54:50.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4176711170' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:50.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:50.632+0000 7fbe62f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:50.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:50.633+0000 7fbe62f0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:50.776 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:50.776 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:50.967 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 723037 722909 64.1732 49.4922 0.0399049 0.0155766 2026-02-24T07:54:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:50 trial016 ceph-mon[39544]: pgmap v296: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 77 MiB/s wr, 9.80k op/s 2026-02-24T07:54:51.546 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2026-02-24T07:54:49.804365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5733286432,"num_objects":87476,"num_object_clones":0,"num_object_copies":262428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87476,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":699927,"num_write_kb":5600486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22707308,"kb_used_data":16772572,"kb_used_omap":36,"kb_used_meta":5934619,"kb_avail":2913305492,"statfs":{"total":3006477107200,"available":2983224823808,"internally_reserved":0,"allocated":17175113728,"data_stored":17172865992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":6077050744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":963903488,"num_objects":14707,"num_object_clones":0,"num_object_copies":44121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117664,"num_write_kb":941312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001730"},"pg_stats":[{"pgid":"5.f","version":"80'43504","reported_seq":43566,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.806580+0000","last_change":"2026-02-24T07:54:26.163507+0000","last_active":"2026-02-24T07:54:47.806580+0000","last_peered":"2026-02-24T07:54:47.806580+0000","last_clean":"2026-02-24T07:54:47.806580+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:47.806580+0000","last_undegraded":"2026-02-24T07:54:47.806580+0000","last_fullsized":"2026-02-24T07:54:47.806580+0000","mapping_epoch":78,"log_start":"80'43501","ondisk_log_start":"80'43501","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32216","last_scrub_stamp":"2026-02-24T07:54:26.163478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.163478+0000","objects_scrubbed":4019,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:33.593692+0000","scrub_duration":440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356384768,"num_objects":5438,"num_object_clones":0,"num_object_copies":16314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43504,"num_write_kb":348032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'43872","reported_seq":43949,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.839271+0000","last_change":"2026-02-24T07:54:47.601256+0000","last_active":"2026-02-24T07:54:47.839271+0000","last_peered":"2026-02-24T07:54:47.839271+0000","last_clean":"2026-02-24T07:54:47.839271+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:47.839271+0000","last_undegraded":"2026-02-24T07:54:47.839271+0000","last_fullsized":"2026-02-24T07:54:47.839271+0000","mapping_epoch":78,"log_start":"80'43856","ondisk_log_start":"80'43856","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43736","last_scrub_stamp":"2026-02-24T07:54:47.601226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.601226+0000","objects_scrubbed":5411,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:54.893103+0000","scrub_duration":1741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359399424,"num_objects":5484,"num_object_clones":0,"num_object_copies":16452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43872,"num_write_kb":350976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'43992","reported_seq":44034,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:47.872950+0000","last_change":"2026-02-24T07:54:46.611893+0000","last_active":"2026-02-24T07:54:47.872950+0000","last_peered":"2026-02-24T07:54:47.872950+0000","last_clean":"2026-02-24T07:54:47.872950+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:47.872950+0000","last_undegraded":"2026-02-24T07:54:47.872950+0000","last_fullsized":"2026-02-24T07:54:47.872950+0000","mapping_epoch":78,"log_start":"80'43976","ondisk_log_start":"80'43976","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":3899,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360382464,"num_objects":5499,"num_object_clones":0,"num_object_copies":16497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43992,"num_write_kb":351936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'43144","reported_seq":43216,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.964786+0000","last_change":"2026-02-24T07:54:38.743150+0000","last_active":"2026-02-24T07:54:47.964786+0000","last_peered":"2026-02-24T07:54:47.964786+0000","last_clean":"2026-02-24T07:54:47.964786+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:47.964786+0000","last_undegraded":"2026-02-24T07:54:47.964786+0000","last_fullsized":"2026-02-24T07:54:47.964786+0000","mapping_epoch":78,"log_start":"80'43136","ondisk_log_start":"80'43136","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'38520","last_scrub_stamp":"2026-02-24T07:54:38.743085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:38.743085+0000","objects_scrubbed":4790,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:53.680833+0000","scrub_duration":973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353435648,"num_objects":5393,"num_object_clones":0,"num_object_copies":16179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43144,"num_write_kb":345152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'43888","reported_seq":43964,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.870884+0000","last_change":"2026-02-24T07:54:44.144091+0000","last_active":"2026-02-24T07:54:47.870884+0000","last_peered":"2026-02-24T07:54:47.870884+0000","last_clean":"2026-02-24T07:54:47.870884+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:47.870884+0000","last_undegraded":"2026-02-24T07:54:47.870884+0000","last_fullsized":"2026-02-24T07:54:47.870884+0000","mapping_epoch":78,"log_start":"80'43872","ondisk_log_start":"80'43872","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'41992","last_scrub_stamp":"2026-02-24T07:54:44.143971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:44.143971+0000","objects_scrubbed":5187,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.730146+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359530496,"num_objects":5486,"num_object_clones":0,"num_object_copies":16458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43888,"num_write_kb":351104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'43904","reported_seq":43972,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.869560+0000","last_change":"2026-02-24T07:54:32.632828+0000","last_active":"2026-02-24T07:54:47.869560+0000","last_peered":"2026-02-24T07:54:47.869560+0000","last_clean":"2026-02-24T07:54:47.869560+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:47.869560+0000","last_undegraded":"2026-02-24T07:54:47.869560+0000","last_fullsized":"2026-02-24T07:54:47.869560+0000","mapping_epoch":78,"log_start":"80'43888","ondisk_log_start":"80'43888","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'36368","last_scrub_stamp":"2026-02-24T07:54:32.632782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:32.632782+0000","objects_scrubbed":4504,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:35.654029+0000","scrub_duration":1284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359661568,"num_objects":5488,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43904,"num_write_kb":351232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'44328","reported_seq":44405,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.803083+0000","last_change":"2026-02-24T07:54:45.981381+0000","last_active":"2026-02-24T07:54:47.803083+0000","last_peered":"2026-02-24T07:54:47.803083+0000","last_clean":"2026-02-24T07:54:47.803083+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:47.803083+0000","last_undegraded":"2026-02-24T07:54:47.803083+0000","last_fullsized":"2026-02-24T07:54:47.803083+0000","mapping_epoch":78,"log_start":"80'44315","ondisk_log_start":"80'44315","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43456","last_scrub_stamp":"2026-02-24T07:54:45.981348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:45.981348+0000","objects_scrubbed":5400,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:47.147962+0000","scrub_duration":1102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363134976,"num_objects":5541,"num_object_clones":0,"num_object_copies":16623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44328,"num_write_kb":354624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'43896","reported_seq":43903,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:47.873225+0000","last_change":"2026-02-24T07:54:47.624112+0000","last_active":"2026-02-24T07:54:47.873225+0000","last_peered":"2026-02-24T07:54:47.873225+0000","last_clean":"2026-02-24T07:54:47.873225+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:47.873225+0000","last_undegraded":"2026-02-24T07:54:47.873225+0000","last_fullsized":"2026-02-24T07:54:47.873225+0000","mapping_epoch":78,"log_start":"80'43876","ondisk_log_start":"80'43876","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":899,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359596032,"num_objects":5487,"num_object_clones":0,"num_object_copies":16461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43896,"num_write_kb":351168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'43024","reported_seq":43031,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.839565+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:47.839565+0000","last_peered":"2026-02-24T07:54:47.839565+0000","last_clean":"2026-02-24T07:54:47.839565+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:47.839565+0000","last_undegraded":"2026-02-24T07:54:47.839565+0000","last_fullsized":"2026-02-24T07:54:47.839565+0000","mapping_epoch":78,"log_start":"80'43008","ondisk_log_start":"80'43008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:48.049333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352452608,"num_objects":5378,"num_object_clones":0,"num_object_copies":16134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43024,"num_write_kb":344192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'44064","reported_seq":44137,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.968219+0000","last_change":"2026-02-24T07:54:46.101852+0000","last_active":"2026-02-24T07:54:47.968219+0000","last_peered":"2026-02-24T07:54:47.968219+0000","last_clean":"2026-02-24T07:54:47.968219+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:47.968219+0000","last_undegraded":"2026-02-24T07:54:47.968219+0000","last_fullsized":"2026-02-24T07:54:47.968219+0000","mapping_epoch":78,"log_start":"80'44051","ondisk_log_start":"80'44051","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43224","last_scrub_stamp":"2026-02-24T07:54:46.101712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:46.101712+0000","objects_scrubbed":5374,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:02.880834+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360972288,"num_objects":5508,"num_object_clones":0,"num_object_copies":16524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44064,"num_write_kb":352512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'43560","reported_seq":43623,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.855155+0000","last_change":"2026-02-24T07:54:26.737811+0000","last_active":"2026-02-24T07:54:47.855155+0000","last_peered":"2026-02-24T07:54:47.855155+0000","last_clean":"2026-02-24T07:54:47.855155+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:47.855155+0000","last_undegraded":"2026-02-24T07:54:47.855155+0000","last_fullsized":"2026-02-24T07:54:47.855155+0000","mapping_epoch":78,"log_start":"80'43552","ondisk_log_start":"80'43552","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32720","last_scrub_stamp":"2026-02-24T07:54:26.737739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.737739+0000","objects_scrubbed":4050,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.916612+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356843520,"num_objects":5445,"num_object_clones":0,"num_object_copies":16335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43560,"num_write_kb":348480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'43592","reported_seq":43661,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.872093+0000","last_change":"2026-02-24T07:54:47.297995+0000","last_active":"2026-02-24T07:54:47.872093+0000","last_peered":"2026-02-24T07:54:47.872093+0000","last_clean":"2026-02-24T07:54:47.872093+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:47.872093+0000","last_undegraded":"2026-02-24T07:54:47.872093+0000","last_fullsized":"2026-02-24T07:54:47.872093+0000","mapping_epoch":78,"log_start":"80'43579","ondisk_log_start":"80'43579","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43192","last_scrub_stamp":"2026-02-24T07:54:47.297933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.297933+0000","objects_scrubbed":5349,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:56.582210+0000","scrub_duration":1732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357105664,"num_objects":5449,"num_object_clones":0,"num_object_copies":16347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43592,"num_write_kb":348736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'43336","reported_seq":43403,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.838585+0000","last_change":"2026-02-24T07:54:28.375175+0000","last_active":"2026-02-24T07:54:47.838585+0000","last_peered":"2026-02-24T07:54:47.838585+0000","last_clean":"2026-02-24T07:54:47.838585+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:47.838585+0000","last_undegraded":"2026-02-24T07:54:47.838585+0000","last_fullsized":"2026-02-24T07:54:47.838585+0000","mapping_epoch":78,"log_start":"80'43320","ondisk_log_start":"80'43320","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'34016","last_scrub_stamp":"2026-02-24T07:54:28.375143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:28.375143+0000","objects_scrubbed":4207,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:50.214828+0000","scrub_duration":1406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355008512,"num_objects":5417,"num_object_clones":0,"num_object_copies":16251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43336,"num_write_kb":346688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'43720","reported_seq":43772,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:47.838986+0000","last_change":"2026-02-24T07:54:46.842627+0000","last_active":"2026-02-24T07:54:47.838986+0000","last_peered":"2026-02-24T07:54:47.838986+0000","last_clean":"2026-02-24T07:54:47.838986+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:47.838986+0000","last_undegraded":"2026-02-24T07:54:47.838986+0000","last_fullsized":"2026-02-24T07:54:47.838986+0000","mapping_epoch":78,"log_start":"80'43696","ondisk_log_start":"80'43696","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":3299,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358154240,"num_objects":5465,"num_object_clones":0,"num_object_copies":16395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43720,"num_write_kb":349760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'44424","reported_seq":44438,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.887363+0000","last_change":"2026-02-24T07:53:21.868639+0000","last_active":"2026-02-24T07:54:47.887363+0000","last_peered":"2026-02-24T07:54:47.887363+0000","last_clean":"2026-02-24T07:54:47.887363+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:47.887363+0000","last_undegraded":"2026-02-24T07:54:47.887363+0000","last_fullsized":"2026-02-24T07:54:47.887363+0000","mapping_epoch":78,"log_start":"80'44417","ondisk_log_start":"80'44417","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:50.732066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363921408,"num_objects":5553,"num_object_clones":0,"num_object_copies":16659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44424,"num_write_kb":355392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'43544","reported_seq":43610,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:47.758878+0000","last_change":"2026-02-24T07:54:31.198542+0000","last_active":"2026-02-24T07:54:47.758878+0000","last_peered":"2026-02-24T07:54:47.758878+0000","last_clean":"2026-02-24T07:54:47.758878+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:47.758878+0000","last_undegraded":"2026-02-24T07:54:47.758878+0000","last_fullsized":"2026-02-24T07:54:47.758878+0000","mapping_epoch":78,"log_start":"80'43538","ondisk_log_start":"80'43538","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'35440","last_scrub_stamp":"2026-02-24T07:54:31.198510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:31.198510+0000","objects_scrubbed":4413,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:48.497357+0000","scrub_duration":462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356712448,"num_objects":5443,"num_object_clones":0,"num_object_copies":16329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43544,"num_write_kb":348352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":5732696064,"num_objects":87474,"num_object_clones":0,"num_object_copies":262422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699792,"num_write_kb":5598336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17198702592,"data_stored":17198702592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215203,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6243200,"kb_used_data":4896108,"kb_used_omap":7,"kb_used_meta":1347064,"kb_avail":727760000,"statfs":{"total":751619276800,"available":745226240000,"internally_reserved":0,"allocated":5013614592,"data_stored":5013051770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1379393897},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444132,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5335144,"kb_used_data":3841492,"kb_used_omap":7,"kb_used_meta":1493624,"kb_avail":728668056,"statfs":{"total":751619276800,"available":746156089344,"internally_reserved":0,"allocated":3933687808,"data_stored":3933124986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1529471374},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4765676,"kb_used_data":3504344,"kb_used_omap":9,"kb_used_meta":1261302,"kb_avail":729237524,"statfs":{"total":751619276800,"available":746739224576,"internally_reserved":0,"allocated":3588448256,"data_stored":3587888986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1291574110},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705769,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6363288,"kb_used_data":4530628,"kb_used_omap":11,"kb_used_meta":1832628,"kb_avail":727639912,"statfs":{"total":751619276800,"available":745103269888,"internally_reserved":0,"allocated":4639363072,"data_stored":4638800250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11997,"internal_metadata":1876611363},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4652695552,"data_stored":4652695552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3589808128,"data_stored":3589808128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3942514688,"data_stored":3942514688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5013684224,"data_stored":5013684224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:51.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 127 730561 730434 64.1126 58.7891 0.027194 0.015595 2026-02-24T07:54:52.314 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:52.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:51 trial016 ceph-mon[39544]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:52.450 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:52.606 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:52.603+0000 7f341471a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:52.606 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:52.603+0000 7f341471a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:52.638 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:52.638 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:52.651 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:52.651 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:52.667 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:52.667 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:52.693 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:52.693 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:52.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 34 738192 738158 64.0707 60.3438 0.0174434 0.0156057 2026-02-24T07:54:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:52 trial016 ceph-mon[39544]: pgmap v297: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.72k op/s 2026-02-24T07:54:53.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2687817483' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:53.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:52 trial016 ceph-mon[39544]: 5.0 scrub starts 2026-02-24T07:54:53.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0132 2026-02-24T07:54:53.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 738192 2026-02-24T07:54:53.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:54:53.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:54:53.968 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 64.0698 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 7.36876 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 79.5156 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 45.5859 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 8200 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 943.201 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 10178 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 5835 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0156056 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.0102486 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.104159 2026-02-24T07:54:53.969 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000558626 2026-02-24T07:54:53.970 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:54:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:53 trial016 ceph-mon[39544]: 5.0 scrub ok 2026-02-24T07:54:54.739 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:54.882 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:55.002 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:54.999+0000 7f686c8e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:55.002 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:54.999+0000 7f686c8e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:55.025 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:55.026 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:55.026 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:54 trial016 ceph-mon[39544]: pgmap v298: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 77 MiB/s wr, 9.86k op/s 2026-02-24T07:54:55.027 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:54:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:54:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:54:55.037 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:55.038 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:55.053 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:55.054 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:55.079 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:55.079 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:56.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:55 trial016 ceph-mon[39544]: 5.7 scrub starts 2026-02-24T07:54:56.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1584514342' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:56.549 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:54:56.549 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:54:56.549 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:54:56.550 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:54:56.689 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:56.815 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:56.812+0000 7f7608462640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:56.815 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:56.812+0000 7f7608462640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:56.965 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:54:56.965 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:54:57.013 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2026-02-24T07:54:55.805278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6042305056,"num_objects":92195,"num_object_clones":0,"num_object_copies":276585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92195,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":737649,"num_write_kb":5902262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23045364,"kb_used_data":17670884,"kb_used_omap":32,"kb_used_meta":5374367,"kb_avail":2912967436,"statfs":{"total":3006477107200,"available":2982878654464,"internally_reserved":0,"allocated":18094985216,"data_stored":18092737480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32808,"internal_metadata":5503352792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,6,0,0,24,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":640311296,"num_objects":9773,"num_object_clones":0,"num_object_copies":29319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78163,"num_write_kb":625304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001808"},"pg_stats":[{"pgid":"5.f","version":"80'45636","reported_seq":45695,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.814431+0000","last_change":"2026-02-24T07:54:26.163507+0000","last_active":"2026-02-24T07:54:52.814431+0000","last_peered":"2026-02-24T07:54:52.814431+0000","last_clean":"2026-02-24T07:54:52.814431+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:52.814431+0000","last_undegraded":"2026-02-24T07:54:52.814431+0000","last_fullsized":"2026-02-24T07:54:52.814431+0000","mapping_epoch":78,"log_start":"80'45632","ondisk_log_start":"80'45632","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32216","last_scrub_stamp":"2026-02-24T07:54:26.163478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.163478+0000","objects_scrubbed":4019,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:33.593692+0000","scrub_duration":440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373850112,"num_objects":5705,"num_object_clones":0,"num_object_copies":17115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45636,"num_write_kb":365088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'46216","reported_seq":46293,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.825912+0000","last_change":"2026-02-24T07:54:47.601256+0000","last_active":"2026-02-24T07:54:52.825912+0000","last_peered":"2026-02-24T07:54:52.825912+0000","last_clean":"2026-02-24T07:54:52.825912+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:52.825912+0000","last_undegraded":"2026-02-24T07:54:52.825912+0000","last_fullsized":"2026-02-24T07:54:52.825912+0000","mapping_epoch":78,"log_start":"80'46192","ondisk_log_start":"80'46192","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43736","last_scrub_stamp":"2026-02-24T07:54:47.601226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.601226+0000","objects_scrubbed":5411,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:54.893103+0000","scrub_duration":1741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378601472,"num_objects":5777,"num_object_clones":0,"num_object_copies":17331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46216,"num_write_kb":369728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'46226","reported_seq":46303,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.888123+0000","last_change":"2026-02-24T07:54:48.344620+0000","last_active":"2026-02-24T07:54:52.888123+0000","last_peered":"2026-02-24T07:54:52.888123+0000","last_clean":"2026-02-24T07:54:52.888123+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:52.888123+0000","last_undegraded":"2026-02-24T07:54:52.888123+0000","last_fullsized":"2026-02-24T07:54:52.888123+0000","mapping_epoch":78,"log_start":"80'46223","ondisk_log_start":"80'46223","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44184","last_scrub_stamp":"2026-02-24T07:54:48.344575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:48.344575+0000","objects_scrubbed":5473,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:53.551695+0000","scrub_duration":1732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378683392,"num_objects":5779,"num_object_clones":0,"num_object_copies":17337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46226,"num_write_kb":369808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'45368","reported_seq":45440,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.963410+0000","last_change":"2026-02-24T07:54:38.743150+0000","last_active":"2026-02-24T07:54:52.963410+0000","last_peered":"2026-02-24T07:54:52.963410+0000","last_clean":"2026-02-24T07:54:52.963410+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:52.963410+0000","last_undegraded":"2026-02-24T07:54:52.963410+0000","last_fullsized":"2026-02-24T07:54:52.963410+0000","mapping_epoch":78,"log_start":"80'45365","ondisk_log_start":"80'45365","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'38520","last_scrub_stamp":"2026-02-24T07:54:38.743085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:38.743085+0000","objects_scrubbed":4790,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:53.680833+0000","scrub_duration":973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371654656,"num_objects":5671,"num_object_clones":0,"num_object_copies":17013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45368,"num_write_kb":362944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'46243","reported_seq":46316,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.887297+0000","last_change":"2026-02-24T07:54:44.144091+0000","last_active":"2026-02-24T07:54:52.887297+0000","last_peered":"2026-02-24T07:54:52.887297+0000","last_clean":"2026-02-24T07:54:52.887297+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:52.887297+0000","last_undegraded":"2026-02-24T07:54:52.887297+0000","last_fullsized":"2026-02-24T07:54:52.887297+0000","mapping_epoch":78,"log_start":"80'46237","ondisk_log_start":"80'46237","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'41992","last_scrub_stamp":"2026-02-24T07:54:44.143971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:44.143971+0000","objects_scrubbed":5187,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.730146+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378822656,"num_objects":5781,"num_object_clones":0,"num_object_copies":17343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46243,"num_write_kb":369944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'46234","reported_seq":46300,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.885601+0000","last_change":"2026-02-24T07:54:32.632828+0000","last_active":"2026-02-24T07:54:52.885601+0000","last_peered":"2026-02-24T07:54:52.885601+0000","last_clean":"2026-02-24T07:54:52.885601+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:52.885601+0000","last_undegraded":"2026-02-24T07:54:52.885601+0000","last_fullsized":"2026-02-24T07:54:52.885601+0000","mapping_epoch":78,"log_start":"80'46231","ondisk_log_start":"80'46231","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'36368","last_scrub_stamp":"2026-02-24T07:54:32.632782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:32.632782+0000","objects_scrubbed":4504,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:35.654029+0000","scrub_duration":1284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378748928,"num_objects":5780,"num_object_clones":0,"num_object_copies":17340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46234,"num_write_kb":369872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'46795","reported_seq":46869,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.842538+0000","last_change":"2026-02-24T07:54:45.981381+0000","last_active":"2026-02-24T07:54:52.842538+0000","last_peered":"2026-02-24T07:54:52.842538+0000","last_clean":"2026-02-24T07:54:52.842538+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:52.842538+0000","last_undegraded":"2026-02-24T07:54:52.842538+0000","last_fullsized":"2026-02-24T07:54:52.842538+0000","mapping_epoch":78,"log_start":"80'46790","ondisk_log_start":"80'46790","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43456","last_scrub_stamp":"2026-02-24T07:54:45.981348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:45.981348+0000","objects_scrubbed":5400,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:47.147962+0000","scrub_duration":1102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383344640,"num_objects":5850,"num_object_clones":0,"num_object_copies":17550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5850,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46795,"num_write_kb":374360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'46456","reported_seq":46525,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.893737+0000","last_change":"2026-02-24T07:54:49.304204+0000","last_active":"2026-02-24T07:54:52.893737+0000","last_peered":"2026-02-24T07:54:52.893737+0000","last_clean":"2026-02-24T07:54:52.893737+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:52.893737+0000","last_undegraded":"2026-02-24T07:54:52.893737+0000","last_fullsized":"2026-02-24T07:54:52.893737+0000","mapping_epoch":78,"log_start":"80'46440","ondisk_log_start":"80'46440","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44820","last_scrub_stamp":"2026-02-24T07:54:49.304052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:49.304052+0000","objects_scrubbed":5529,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.472314+0000","scrub_duration":1680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380567552,"num_objects":5807,"num_object_clones":0,"num_object_copies":17421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5807,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46456,"num_write_kb":371648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'45384","reported_seq":45398,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.825332+0000","last_change":"2026-02-24T07:53:21.871276+0000","last_active":"2026-02-24T07:54:52.825332+0000","last_peered":"2026-02-24T07:54:52.825332+0000","last_clean":"2026-02-24T07:54:52.825332+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:52.825332+0000","last_undegraded":"2026-02-24T07:54:52.825332+0000","last_fullsized":"2026-02-24T07:54:52.825332+0000","mapping_epoch":78,"log_start":"80'45376","ondisk_log_start":"80'45376","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371785728,"num_objects":5673,"num_object_clones":0,"num_object_copies":17019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45384,"num_write_kb":363072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'46408","reported_seq":46486,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.964611+0000","last_change":"2026-02-24T07:54:46.101852+0000","last_active":"2026-02-24T07:54:52.964611+0000","last_peered":"2026-02-24T07:54:52.964611+0000","last_clean":"2026-02-24T07:54:52.964611+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:52.964611+0000","last_undegraded":"2026-02-24T07:54:52.964611+0000","last_fullsized":"2026-02-24T07:54:52.964611+0000","mapping_epoch":78,"log_start":"80'46392","ondisk_log_start":"80'46392","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43224","last_scrub_stamp":"2026-02-24T07:54:46.101712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:46.101712+0000","objects_scrubbed":5374,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:02.880834+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380174336,"num_objects":5801,"num_object_clones":0,"num_object_copies":17403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46408,"num_write_kb":371264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'46088","reported_seq":46151,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.886244+0000","last_change":"2026-02-24T07:54:26.737811+0000","last_active":"2026-02-24T07:54:52.886244+0000","last_peered":"2026-02-24T07:54:52.886244+0000","last_clean":"2026-02-24T07:54:52.886244+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:52.886244+0000","last_undegraded":"2026-02-24T07:54:52.886244+0000","last_fullsized":"2026-02-24T07:54:52.886244+0000","mapping_epoch":78,"log_start":"80'46068","ondisk_log_start":"80'46068","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32720","last_scrub_stamp":"2026-02-24T07:54:26.737739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.737739+0000","objects_scrubbed":4050,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.916612+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377552896,"num_objects":5761,"num_object_clones":0,"num_object_copies":17283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46088,"num_write_kb":368704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'45824","reported_seq":45901,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.884260+0000","last_change":"2026-02-24T07:54:47.297995+0000","last_active":"2026-02-24T07:54:52.884260+0000","last_peered":"2026-02-24T07:54:52.884260+0000","last_clean":"2026-02-24T07:54:52.884260+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:52.884260+0000","last_undegraded":"2026-02-24T07:54:52.884260+0000","last_fullsized":"2026-02-24T07:54:52.884260+0000","mapping_epoch":78,"log_start":"80'45800","ondisk_log_start":"80'45800","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43192","last_scrub_stamp":"2026-02-24T07:54:47.297933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.297933+0000","objects_scrubbed":5349,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:56.582210+0000","scrub_duration":1732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375390208,"num_objects":5728,"num_object_clones":0,"num_object_copies":17184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45824,"num_write_kb":366592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'45664","reported_seq":45731,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.794969+0000","last_change":"2026-02-24T07:54:28.375175+0000","last_active":"2026-02-24T07:54:52.794969+0000","last_peered":"2026-02-24T07:54:52.794969+0000","last_clean":"2026-02-24T07:54:52.794969+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:52.794969+0000","last_undegraded":"2026-02-24T07:54:52.794969+0000","last_fullsized":"2026-02-24T07:54:52.794969+0000","mapping_epoch":78,"log_start":"80'45656","ondisk_log_start":"80'45656","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'34016","last_scrub_stamp":"2026-02-24T07:54:28.375143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:28.375143+0000","objects_scrubbed":4207,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:50.214828+0000","scrub_duration":1406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374079488,"num_objects":5708,"num_object_clones":0,"num_object_copies":17124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45664,"num_write_kb":365312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'46392","reported_seq":46471,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.823908+0000","last_change":"2026-02-24T07:54:48.504806+0000","last_active":"2026-02-24T07:54:52.823908+0000","last_peered":"2026-02-24T07:54:52.823908+0000","last_clean":"2026-02-24T07:54:52.823908+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:52.823908+0000","last_undegraded":"2026-02-24T07:54:52.823908+0000","last_fullsized":"2026-02-24T07:54:52.823908+0000","mapping_epoch":78,"log_start":"80'46369","ondisk_log_start":"80'46369","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44032","last_scrub_stamp":"2026-02-24T07:54:48.504740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:48.504740+0000","objects_scrubbed":5459,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.558507+0000","scrub_duration":1662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380043264,"num_objects":5799,"num_object_clones":0,"num_object_copies":17397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46392,"num_write_kb":371136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'46724","reported_seq":46759,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:52.884275+0000","last_change":"2026-02-24T07:54:52.615728+0000","last_active":"2026-02-24T07:54:52.884275+0000","last_peered":"2026-02-24T07:54:52.884275+0000","last_clean":"2026-02-24T07:54:52.884275+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:52.884275+0000","last_undegraded":"2026-02-24T07:54:52.884275+0000","last_fullsized":"2026-02-24T07:54:52.884275+0000","mapping_epoch":78,"log_start":"80'46720","ondisk_log_start":"80'46720","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":2099,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382763008,"num_objects":5841,"num_object_clones":0,"num_object_copies":17523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5841,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46724,"num_write_kb":373792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'45856","reported_seq":45922,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:52.815356+0000","last_change":"2026-02-24T07:54:31.198542+0000","last_active":"2026-02-24T07:54:52.815356+0000","last_peered":"2026-02-24T07:54:52.815356+0000","last_clean":"2026-02-24T07:54:52.815356+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:52.815356+0000","last_undegraded":"2026-02-24T07:54:52.815356+0000","last_fullsized":"2026-02-24T07:54:52.815356+0000","mapping_epoch":78,"log_start":"80'45853","ondisk_log_start":"80'45853","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'35440","last_scrub_stamp":"2026-02-24T07:54:31.198510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:31.198510+0000","objects_scrubbed":4413,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:48.497357+0000","scrub_duration":462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375652352,"num_objects":5732,"num_object_clones":0,"num_object_copies":17196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45856,"num_write_kb":366848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6041714688,"num_objects":92193,"num_object_clones":0,"num_object_copies":276579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737514,"num_write_kb":5900112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18125799424,"data_stored":18125799424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215204,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6581216,"kb_used_data":5161932,"kb_used_omap":7,"kb_used_meta":1419256,"kb_avail":727421984,"statfs":{"total":751619276800,"available":744880111616,"internally_reserved":0,"allocated":5285818368,"data_stored":5285255546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1453318505},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,16,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444133,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5624200,"kb_used_data":4041204,"kb_used_omap":7,"kb_used_meta":1582968,"kb_avail":728379000,"statfs":{"total":751619276800,"available":745860096000,"internally_reserved":0,"allocated":4138192896,"data_stored":4137630074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1620959630},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,6],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5007748,"kb_used_data":3692272,"kb_used_omap":9,"kb_used_meta":1315446,"kb_avail":728995452,"statfs":{"total":751619276800,"available":746491342848,"internally_reserved":0,"allocated":3780886528,"data_stored":3780327258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1347017566},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705770,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5832200,"kb_used_data":4775476,"kb_used_omap":7,"kb_used_meta":1056696,"kb_avail":728171000,"statfs":{"total":751619276800,"available":745647104000,"internally_reserved":0,"allocated":4890087424,"data_stored":4889524602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7805,"internal_metadata":1082057091},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4903370752,"data_stored":4903370752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3784310784,"data_stored":3784310784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4152295424,"data_stored":4152295424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5285822464,"data_stored":5285822464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:54:57.015 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:54:57.016 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 181 2026-02-24T07:54:57.125 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:54:57.160 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: pgmap v299: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.51k op/s 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:54:57.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:54:57.273 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:57.292 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:57.290+0000 7ff401ebc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:57.293 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:57.290+0000 7ff401ebc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:57.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:57.386+0000 7f9bfcbca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:57.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:57.387+0000 7f9bfcbca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:57.428 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:57.429 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:57.437 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:54:57.441 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:57.442 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:57.458 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:57.458 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:57.470 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:57.471 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:54:57.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:54:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:57 trial016 ceph-mon[39544]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:54:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4289150909' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:54:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/932421202' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "181"} : dispatch 2026-02-24T07:54:59.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:58 trial016 ceph-mon[39544]: pgmap v300: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.51k op/s 2026-02-24T07:54:59.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:58 trial016 ceph-mon[39544]: 5.7 scrub ok 2026-02-24T07:54:59.514 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:54:59.655 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:54:59.778 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:59.775+0000 7f3b7225e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:59.778 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:54:59.775+0000 7f3b7225e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:54:59.792 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:54:59.792 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:54:59.806 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:54:59.806 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:54:59.818 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:54:59.818 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:54:59.837 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:54:59.837 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:00.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:54:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2379796509' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:00 trial016 ceph-mon[39544]: pgmap v301: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.6 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 51 MiB/s wr, 9.31k op/s 2026-02-24T07:55:01.905 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:02.050 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:02.180 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:02.177+0000 7fcf36571640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:02.180 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:02.177+0000 7fcf36571640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:02.212 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:02.213 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:02.225 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:02.225 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:02.239 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:02.239 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:02.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:02.262 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:02.477 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:02.477 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:02.477 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T07:55:02.477 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:02.624 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:02.745 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:02.742+0000 7f0a46d0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:02.745 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:02.743+0000 7f0a46d0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:02.899 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:02.900 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:02.948 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2026-02-24T07:55:01.806104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3893494328,"num_objects":59404,"num_object_clones":0,"num_object_copies":178212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59404,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":771201,"num_write_kb":5907687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":17595976,"kb_used_data":12076792,"kb_used_omap":32,"kb_used_meta":5518943,"kb_avail":2918416824,"statfs":{"total":3006477107200,"available":2988458827776,"internally_reserved":0,"allocated":12366635008,"data_stored":12364375056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32808,"internal_metadata":5651398616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,5,18,27,42,60],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1839792104,"num_objects":-28072,"num_object_clones":0,"num_object_copies":-84216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28072,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71274,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001739"},"pg_stats":[{"pgid":"5.f","version":"80'47658","reported_seq":47720,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.824879+0000","last_change":"2026-02-24T07:54:26.163507+0000","last_active":"2026-02-24T07:54:57.824879+0000","last_peered":"2026-02-24T07:54:57.824879+0000","last_clean":"2026-02-24T07:54:57.824879+0000","last_became_active":"2026-02-24T07:53:21.868748+0000","last_became_peered":"2026-02-24T07:53:21.868748+0000","last_unstale":"2026-02-24T07:54:57.824879+0000","last_undegraded":"2026-02-24T07:54:57.824879+0000","last_fullsized":"2026-02-24T07:54:57.824879+0000","mapping_epoch":78,"log_start":"80'47654","ondisk_log_start":"80'47654","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32216","last_scrub_stamp":"2026-02-24T07:54:26.163478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.163478+0000","objects_scrubbed":4019,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:33.593692+0000","scrub_duration":440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245760000,"num_objects":3750,"num_object_clones":0,"num_object_copies":11250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47658,"num_write_kb":365568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'48341","reported_seq":48412,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.840447+0000","last_change":"2026-02-24T07:54:47.601256+0000","last_active":"2026-02-24T07:54:57.840447+0000","last_peered":"2026-02-24T07:54:57.840447+0000","last_clean":"2026-02-24T07:54:57.840447+0000","last_became_active":"2026-02-24T07:53:21.870931+0000","last_became_peered":"2026-02-24T07:53:21.870931+0000","last_unstale":"2026-02-24T07:54:57.840447+0000","last_undegraded":"2026-02-24T07:54:57.840447+0000","last_fullsized":"2026-02-24T07:54:57.840447+0000","mapping_epoch":78,"log_start":"80'48330","ondisk_log_start":"80'48330","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43736","last_scrub_stamp":"2026-02-24T07:54:47.601226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.601226+0000","objects_scrubbed":5411,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:54.893103+0000","scrub_duration":1741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244645888,"num_objects":3733,"num_object_clones":0,"num_object_copies":11199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48341,"num_write_kb":370304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'48403","reported_seq":48477,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.886878+0000","last_change":"2026-02-24T07:54:48.344620+0000","last_active":"2026-02-24T07:54:57.886878+0000","last_peered":"2026-02-24T07:54:57.886878+0000","last_clean":"2026-02-24T07:54:57.886878+0000","last_became_active":"2026-02-24T07:53:21.867773+0000","last_became_peered":"2026-02-24T07:53:21.867773+0000","last_unstale":"2026-02-24T07:54:57.886878+0000","last_undegraded":"2026-02-24T07:54:57.886878+0000","last_fullsized":"2026-02-24T07:54:57.886878+0000","mapping_epoch":78,"log_start":"80'48394","ondisk_log_start":"80'48394","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44184","last_scrub_stamp":"2026-02-24T07:54:48.344575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:48.344575+0000","objects_scrubbed":5473,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:53.551695+0000","scrub_duration":1732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238288920,"num_objects":3637,"num_object_clones":0,"num_object_copies":10911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3637,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48403,"num_write_kb":370049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'47507","reported_seq":47578,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.973492+0000","last_change":"2026-02-24T07:54:38.743150+0000","last_active":"2026-02-24T07:54:57.973492+0000","last_peered":"2026-02-24T07:54:57.973492+0000","last_clean":"2026-02-24T07:54:57.973492+0000","last_became_active":"2026-02-24T07:53:21.868622+0000","last_became_peered":"2026-02-24T07:53:21.868622+0000","last_unstale":"2026-02-24T07:54:57.973492+0000","last_undegraded":"2026-02-24T07:54:57.973492+0000","last_fullsized":"2026-02-24T07:54:57.973492+0000","mapping_epoch":78,"log_start":"80'47504","ondisk_log_start":"80'47504","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'38520","last_scrub_stamp":"2026-02-24T07:54:38.743085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:38.743085+0000","objects_scrubbed":4790,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:53.680833+0000","scrub_duration":973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231473152,"num_objects":3532,"num_object_clones":0,"num_object_copies":10596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47507,"num_write_kb":362944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'48328","reported_seq":48402,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.888705+0000","last_change":"2026-02-24T07:54:44.144091+0000","last_active":"2026-02-24T07:54:57.888705+0000","last_peered":"2026-02-24T07:54:57.888705+0000","last_clean":"2026-02-24T07:54:57.888705+0000","last_became_active":"2026-02-24T07:53:21.868402+0000","last_became_peered":"2026-02-24T07:53:21.868402+0000","last_unstale":"2026-02-24T07:54:57.888705+0000","last_undegraded":"2026-02-24T07:54:57.888705+0000","last_fullsized":"2026-02-24T07:54:57.888705+0000","mapping_epoch":78,"log_start":"80'48320","ondisk_log_start":"80'48320","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'41992","last_scrub_stamp":"2026-02-24T07:54:44.143971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:44.143971+0000","objects_scrubbed":5187,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.730146+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245497856,"num_objects":3746,"num_object_clones":0,"num_object_copies":11238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48328,"num_write_kb":370304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'48347","reported_seq":48413,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.887359+0000","last_change":"2026-02-24T07:54:32.632828+0000","last_active":"2026-02-24T07:54:57.887359+0000","last_peered":"2026-02-24T07:54:57.887359+0000","last_clean":"2026-02-24T07:54:57.887359+0000","last_became_active":"2026-02-24T07:53:21.869083+0000","last_became_peered":"2026-02-24T07:53:21.869083+0000","last_unstale":"2026-02-24T07:54:57.887359+0000","last_undegraded":"2026-02-24T07:54:57.887359+0000","last_fullsized":"2026-02-24T07:54:57.887359+0000","mapping_epoch":78,"log_start":"80'48344","ondisk_log_start":"80'48344","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'36368","last_scrub_stamp":"2026-02-24T07:54:32.632782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:32.632782+0000","objects_scrubbed":4504,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:35.654029+0000","scrub_duration":1284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244252672,"num_objects":3727,"num_object_clones":0,"num_object_copies":11181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48347,"num_write_kb":370304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'48989","reported_seq":49066,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.831407+0000","last_change":"2026-02-24T07:54:45.981381+0000","last_active":"2026-02-24T07:54:57.831407+0000","last_peered":"2026-02-24T07:54:57.831407+0000","last_clean":"2026-02-24T07:54:57.831407+0000","last_became_active":"2026-02-24T07:53:21.870859+0000","last_became_peered":"2026-02-24T07:53:21.870859+0000","last_unstale":"2026-02-24T07:54:57.831407+0000","last_undegraded":"2026-02-24T07:54:57.831407+0000","last_fullsized":"2026-02-24T07:54:57.831407+0000","mapping_epoch":78,"log_start":"80'48986","ondisk_log_start":"80'48986","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43456","last_scrub_stamp":"2026-02-24T07:54:45.981348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:45.981348+0000","objects_scrubbed":5400,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:47.147962+0000","scrub_duration":1102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244056064,"num_objects":3724,"num_object_clones":0,"num_object_copies":11172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48989,"num_write_kb":374848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'48585","reported_seq":48662,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.887940+0000","last_change":"2026-02-24T07:54:49.304204+0000","last_active":"2026-02-24T07:54:57.887940+0000","last_peered":"2026-02-24T07:54:57.887940+0000","last_clean":"2026-02-24T07:54:57.887940+0000","last_became_active":"2026-02-24T07:53:21.868722+0000","last_became_peered":"2026-02-24T07:53:21.868722+0000","last_unstale":"2026-02-24T07:54:57.887940+0000","last_undegraded":"2026-02-24T07:54:57.887940+0000","last_fullsized":"2026-02-24T07:54:57.887940+0000","mapping_epoch":78,"log_start":"80'48581","ondisk_log_start":"80'48581","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44820","last_scrub_stamp":"2026-02-24T07:54:49.304052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:49.304052+0000","objects_scrubbed":5529,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.472314+0000","scrub_duration":1680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242810880,"num_objects":3705,"num_object_clones":0,"num_object_copies":11115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48585,"num_write_kb":371840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'47459","reported_seq":47529,"reported_epoch":80,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:54:57.840687+0000","last_change":"2026-02-24T07:54:54.832130+0000","last_active":"2026-02-24T07:54:57.840687+0000","last_peered":"2026-02-24T07:54:57.840687+0000","last_clean":"2026-02-24T07:54:57.840687+0000","last_became_active":"2026-02-24T07:53:21.870898+0000","last_became_peered":"2026-02-24T07:53:21.870898+0000","last_unstale":"2026-02-24T07:54:57.840687+0000","last_undegraded":"2026-02-24T07:54:57.840687+0000","last_fullsized":"2026-02-24T07:54:57.840687+0000","mapping_epoch":78,"log_start":"80'47454","ondisk_log_start":"80'47454","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:53:20.856837+0000","objects_scrubbed":4299,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241106944,"num_objects":3679,"num_object_clones":0,"num_object_copies":11037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47459,"num_write_kb":363648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'48526","reported_seq":48601,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.972063+0000","last_change":"2026-02-24T07:54:46.101852+0000","last_active":"2026-02-24T07:54:57.972063+0000","last_peered":"2026-02-24T07:54:57.972063+0000","last_clean":"2026-02-24T07:54:57.972063+0000","last_became_active":"2026-02-24T07:53:21.869150+0000","last_became_peered":"2026-02-24T07:53:21.869150+0000","last_unstale":"2026-02-24T07:54:57.972063+0000","last_undegraded":"2026-02-24T07:54:57.972063+0000","last_fullsized":"2026-02-24T07:54:57.972063+0000","mapping_epoch":78,"log_start":"80'48517","ondisk_log_start":"80'48517","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43224","last_scrub_stamp":"2026-02-24T07:54:46.101712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:46.101712+0000","objects_scrubbed":5374,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:02.880834+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241369088,"num_objects":3683,"num_object_clones":0,"num_object_copies":11049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3683,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48526,"num_write_kb":371264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'48122","reported_seq":48182,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.887752+0000","last_change":"2026-02-24T07:54:26.737811+0000","last_active":"2026-02-24T07:54:57.887752+0000","last_peered":"2026-02-24T07:54:57.887752+0000","last_clean":"2026-02-24T07:54:57.887752+0000","last_became_active":"2026-02-24T07:53:21.868268+0000","last_became_peered":"2026-02-24T07:53:21.868268+0000","last_unstale":"2026-02-24T07:54:57.887752+0000","last_undegraded":"2026-02-24T07:54:57.887752+0000","last_fullsized":"2026-02-24T07:54:57.887752+0000","mapping_epoch":78,"log_start":"80'48118","ondisk_log_start":"80'48118","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'32720","last_scrub_stamp":"2026-02-24T07:54:26.737739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:26.737739+0000","objects_scrubbed":4050,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.916612+0000","scrub_duration":1412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245432320,"num_objects":3745,"num_object_clones":0,"num_object_copies":11235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48122,"num_write_kb":368832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'47890","reported_seq":47961,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.888671+0000","last_change":"2026-02-24T07:54:47.297995+0000","last_active":"2026-02-24T07:54:57.888671+0000","last_peered":"2026-02-24T07:54:57.888671+0000","last_clean":"2026-02-24T07:54:57.888671+0000","last_became_active":"2026-02-24T07:53:21.868212+0000","last_became_peered":"2026-02-24T07:53:21.868212+0000","last_unstale":"2026-02-24T07:54:57.888671+0000","last_undegraded":"2026-02-24T07:54:57.888671+0000","last_fullsized":"2026-02-24T07:54:57.888671+0000","mapping_epoch":78,"log_start":"80'47883","ondisk_log_start":"80'47883","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'43192","last_scrub_stamp":"2026-02-24T07:54:47.297933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:47.297933+0000","objects_scrubbed":5349,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:56.582210+0000","scrub_duration":1732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242352128,"num_objects":3698,"num_object_clones":0,"num_object_copies":11094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47890,"num_write_kb":366848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'47734","reported_seq":47799,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.840157+0000","last_change":"2026-02-24T07:54:28.375175+0000","last_active":"2026-02-24T07:54:57.840157+0000","last_peered":"2026-02-24T07:54:57.840157+0000","last_clean":"2026-02-24T07:54:57.840157+0000","last_became_active":"2026-02-24T07:53:21.870616+0000","last_became_peered":"2026-02-24T07:53:21.870616+0000","last_unstale":"2026-02-24T07:54:57.840157+0000","last_undegraded":"2026-02-24T07:54:57.840157+0000","last_fullsized":"2026-02-24T07:54:57.840157+0000","mapping_epoch":78,"log_start":"80'47726","ondisk_log_start":"80'47726","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'34016","last_scrub_stamp":"2026-02-24T07:54:28.375143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:28.375143+0000","objects_scrubbed":4207,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:50.214828+0000","scrub_duration":1406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240189440,"num_objects":3665,"num_object_clones":0,"num_object_copies":10995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47734,"num_write_kb":365504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'48480","reported_seq":48555,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.840668+0000","last_change":"2026-02-24T07:54:48.504806+0000","last_active":"2026-02-24T07:54:57.840668+0000","last_peered":"2026-02-24T07:54:57.840668+0000","last_clean":"2026-02-24T07:54:57.840668+0000","last_became_active":"2026-02-24T07:53:21.871075+0000","last_became_peered":"2026-02-24T07:53:21.871075+0000","last_unstale":"2026-02-24T07:54:57.840668+0000","last_undegraded":"2026-02-24T07:54:57.840668+0000","last_fullsized":"2026-02-24T07:54:57.840668+0000","mapping_epoch":78,"log_start":"80'48472","ondisk_log_start":"80'48472","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'44032","last_scrub_stamp":"2026-02-24T07:54:48.504740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:48.504740+0000","objects_scrubbed":5459,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:52.558507+0000","scrub_duration":1662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247922688,"num_objects":3783,"num_object_clones":0,"num_object_copies":11349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48480,"num_write_kb":371648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'48858","reported_seq":48936,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.884678+0000","last_change":"2026-02-24T07:54:53.129228+0000","last_active":"2026-02-24T07:54:57.884678+0000","last_peered":"2026-02-24T07:54:57.884678+0000","last_clean":"2026-02-24T07:54:57.884678+0000","last_became_active":"2026-02-24T07:53:21.868192+0000","last_became_peered":"2026-02-24T07:53:21.868192+0000","last_unstale":"2026-02-24T07:54:57.884678+0000","last_undegraded":"2026-02-24T07:54:57.884678+0000","last_fullsized":"2026-02-24T07:54:57.884678+0000","mapping_epoch":78,"log_start":"80'48854","ondisk_log_start":"80'48854","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'46776","last_scrub_stamp":"2026-02-24T07:54:53.129187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:53.129187+0000","objects_scrubbed":5843,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:04.477082+0000","scrub_duration":513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246743040,"num_objects":3765,"num_object_clones":0,"num_object_copies":11295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48858,"num_write_kb":374208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'47839","reported_seq":47905,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:57.824580+0000","last_change":"2026-02-24T07:54:31.198542+0000","last_active":"2026-02-24T07:54:57.824580+0000","last_peered":"2026-02-24T07:54:57.824580+0000","last_clean":"2026-02-24T07:54:57.824580+0000","last_became_active":"2026-02-24T07:53:21.867704+0000","last_became_peered":"2026-02-24T07:53:21.867704+0000","last_unstale":"2026-02-24T07:54:57.824580+0000","last_undegraded":"2026-02-24T07:54:57.824580+0000","last_fullsized":"2026-02-24T07:54:57.824580+0000","mapping_epoch":78,"log_start":"80'47836","ondisk_log_start":"80'47836","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'35440","last_scrub_stamp":"2026-02-24T07:54:31.198510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:53:20.856837+0000","last_clean_scrub_stamp":"2026-02-24T07:54:31.198510+0000","objects_scrubbed":4413,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:48.497357+0000","scrub_duration":462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251002880,"num_objects":3830,"num_object_clones":0,"num_object_copies":11490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47839,"num_write_kb":367424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T07:54:03.007708+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:54:03.007708+0000","last_peered":"2026-02-24T07:54:03.007708+0000","last_clean":"2026-02-24T07:54:03.007708+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:54:03.007708+0000","last_undegraded":"2026-02-24T07:54:03.007708+0000","last_fullsized":"2026-02-24T07:54:03.007708+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3892903960,"num_objects":59402,"num_object_clones":0,"num_object_copies":178206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59402,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":771066,"num_write_kb":5905537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11676102656,"data_stored":11676090440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215205,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5211508,"kb_used_data":3773920,"kb_used_omap":7,"kb_used_meta":1437496,"kb_avail":728791692,"statfs":{"total":751619276800,"available":746282692608,"internally_reserved":0,"allocated":3864494080,"data_stored":3863927186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7831,"internal_metadata":1471996265},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,12,14,25],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444134,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4372276,"kb_used_data":2771168,"kb_used_omap":7,"kb_used_meta":1601016,"kb_avail":729630924,"statfs":{"total":751619276800,"available":747142066176,"internally_reserved":0,"allocated":2837676032,"data_stored":2837109138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7794,"internal_metadata":1639440782},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3753580,"kb_used_data":2383960,"kb_used_omap":9,"kb_used_meta":1369590,"kb_avail":730249620,"statfs":{"total":751619276800,"available":747775610880,"internally_reserved":0,"allocated":2441175040,"data_stored":2440615770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1402461022},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705771,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4258612,"kb_used_data":3147744,"kb_used_omap":7,"kb_used_meta":1110840,"kb_avail":729744588,"statfs":{"total":751619276800,"available":747258458112,"internally_reserved":0,"allocated":3223289856,"data_stored":3222722962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7805,"internal_metadata":1137500547},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,18,15,28,35],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3149139968,"data_stored":3149135896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2403991552,"data_stored":2403991552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2693206016,"data_stored":2693201944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3429765120,"data_stored":3429761048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:02.950 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:55:02.950 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 86 2026-02-24T07:55:03.092 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:03.152 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:02 trial016 ceph-mon[39544]: pgmap v302: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.6 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 25 MiB/s wr, 5.94k op/s 2026-02-24T07:55:03.152 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2376111316' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:03.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:03.210+0000 7f1fe3d94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:03.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:03.210+0000 7f1fe3d94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:03.355 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:55:03.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:55:04.309 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:03 trial016 ceph-mon[39544]: from='client.15109 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2520561378' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "86"} : dispatch 2026-02-24T07:55:04.453 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:04.830 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:04.813+0000 7f16bc249640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:04.830 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:04.813+0000 7f16bc249640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:04.849 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 92274 objects 2026-02-24T07:55:04.849 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :10.8784 2026-02-24T07:55:04.852 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:04.853 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:04.863 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:04.864 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:04.874 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:04.874 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:04.884 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:04.885 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:05.197 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:04 trial016 ceph-mon[39544]: pgmap v303: 17 pgs: 17 active+clean; 989 MiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 25 MiB/s wr, 9.57k op/s 2026-02-24T07:55:05.197 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1871357168' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:05.197 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:05 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:55:06.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:05 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:55:06.629 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-24T07:55:06.629 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-24T07:55:06.745 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:06.843+0000 7f73bca3c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:06.844+0000 7f73bca3c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:06.987 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_3' removed 2026-02-24T07:55:07.043 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:55:07.044 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:55:07.044 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-24T07:55:07.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_4 16 2026-02-24T07:55:07.164 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:07.267 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:07.264+0000 7f53bb5b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:07.267 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:06 trial016 ceph-mon[39544]: pgmap v304: 17 pgs: 17 active+clean; 989 MiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 452 KiB/s wr, 6.43k op/s 2026-02-24T07:55:07.267 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:06 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:55:07.267 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:06 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:55:07.267 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2248990866' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:55:07.267 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:07.264+0000 7f53bb5b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:07.454 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:07.571 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:07.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:07.672+0000 7f0bfd5c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:07.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:07.672+0000 7f0bfd5c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:07.688 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:07.688 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:07.698 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:07.699 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:07.711 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:07.711 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:07.721 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:07.721 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:07.991 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_4' created 2026-02-24T07:55:08.046 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-24T07:55:08.161 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:08.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:08.261+0000 7fe9a3c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:08.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:08.261+0000 7fe9a3c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:08.264 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2248990866' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:55:08.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:07 trial016 ceph-mon[39544]: osdmap e81: 4 total, 4 up, 4 in 2026-02-24T07:55:08.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2262061473' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16} : dispatch 2026-02-24T07:55:08.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2023581780' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:08.399 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:08.399 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:08.995 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-24T07:55:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:08 trial016 ceph-mon[39544]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:55:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2262061473' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2026-02-24T07:55:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:08 trial016 ceph-mon[39544]: osdmap e82: 4 total, 4 up, 4 in 2026-02-24T07:55:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2288341873' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:55:09.757 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:09.876 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:09.971 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:09.968+0000 7fefcb85e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:09.971 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:09.969+0000 7fefcb85e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:09.983 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:09.983 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:09.994 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:09.994 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:10.006 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:10.006 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:10.016 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:10.017 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:10.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2288341873' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:55:10.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:09 trial016 ceph-mon[39544]: osdmap e83: 4 total, 4 up, 4 in 2026-02-24T07:55:10.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:09 trial016 ceph-mon[39544]: osdmap e84: 4 total, 4 up, 4 in 2026-02-24T07:55:10.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2199014095' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:10.034 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2026-02-24T07:55:10.035 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T07:55:10.035 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:10.036 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:55:10.036 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:55:10.083 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:55:10.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:55:10.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_122970 2026-02-24T07:55:10.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:55:10.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:55:10.175 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:10.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:10.297+0000 7f86a8e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:10.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:10.297+0000 7f86a8e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:10.459 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:10.460 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:10.505 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2026-02-24T07:55:09.843019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":5776940,"kb_used_data":5212,"kb_used_omap":35,"kb_used_meta":5771612,"kb_avail":2930235860,"statfs":{"total":3006477107200,"available":3000561520640,"internally_reserved":0,"allocated":5337088,"data_stored":3057836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36068,"internal_metadata":5910131484},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1036189720,"num_objects":-15812,"num_object_clones":0,"num_object_copies":-47436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15812,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-814656,"num_write_kb":-5905537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036344"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:55:07.985997+0000","last_change":"2026-02-24T07:55:07.985997+0000","last_active":"2026-02-24T07:55:07.985997+0000","last_peered":"2026-02-24T07:55:07.985997+0000","last_clean":"2026-02-24T07:55:07.985997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:55:07.985997+0000","last_undegraded":"2026-02-24T07:55:07.985997+0000","last_fullsized":"2026-02-24T07:55:07.985997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T07:55:06.986491+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:55:06.986491+0000","last_peered":"2026-02-24T07:55:06.986491+0000","last_clean":"2026-02-24T07:55:06.986491+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:06.986491+0000","last_undegraded":"2026-02-24T07:55:06.986491+0000","last_fullsized":"2026-02-24T07:55:06.986491+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215207,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1529212,"kb_used_data":1448,"kb_used_omap":8,"kb_used_meta":1527735,"kb_avail":732473988,"statfs":{"total":751619276800,"available":750053363712,"internally_reserved":0,"allocated":1482752,"data_stored":912051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9135,"internal_metadata":1564400721},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444136,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1674684,"kb_used_data":1448,"kb_used_omap":8,"kb_used_meta":1673207,"kb_avail":732328516,"statfs":{"total":751619276800,"available":749904400384,"internally_reserved":0,"allocated":1482752,"data_stored":912051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9098,"internal_metadata":1713364086},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1406584,"kb_used_data":868,"kb_used_omap":9,"kb_used_meta":1405686,"kb_avail":732596616,"statfs":{"total":751619276800,"available":750178934784,"internally_reserved":0,"allocated":888832,"data_stored":321683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9378,"internal_metadata":1439423326},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1166460,"kb_used_data":1448,"kb_used_omap":8,"kb_used_meta":1164983,"kb_avail":732836740,"statfs":{"total":751619276800,"available":750424821760,"internally_reserved":0,"allocated":1482752,"data_stored":912051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8457,"internal_metadata":1192943351},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0}]}} 2026-02-24T07:55:10.506 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 16 2026-02-24T07:55:10.689 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:10.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:10.818+0000 7f4039c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:10.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:10.819+0000 7f4039c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:11.001 INFO:teuthology.orchestra.run.trial016.stderr:set pool 6 pgp_num to 16 2026-02-24T07:55:11.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 9093 8965 70.033 70.0391 0.0105991 0.014173 2026-02-24T07:55:11.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:10 trial016 ceph-mon[39544]: pgmap v309: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:55:11.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1635995818' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"} : dispatch 2026-02-24T07:55:12.055 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:12.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 19793 19665 76.8101 83.5938 0.00371814 0.0129405 2026-02-24T07:55:12.209 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:12.261 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:12 trial016 ceph-mon[39544]: from='client.15128 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:12.262 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1635995818' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]': finished 2026-02-24T07:55:12.262 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:12 trial016 ceph-mon[39544]: osdmap e85: 4 total, 4 up, 4 in 2026-02-24T07:55:12.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:12.330+0000 7fb3ea742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:12.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:12.331+0000 7fb3ea742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:12.351 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:12.351 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:12.373 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:12.374 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:12.391 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:12.391 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:12.403 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:12.403 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:13.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 30107 29980 78.0668 80.5859 0.00355373 0.0127668 2026-02-24T07:55:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:13 trial016 ceph-mon[39544]: pgmap v312: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:55:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/881905429' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:14.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 40863 40735 79.5543 84.0234 0.0126017 0.0125406 2026-02-24T07:55:14.450 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:14.598 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:14.733 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:14.729+0000 7f933b9e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:14.733 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:14.730+0000 7f933b9e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:14.750 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:14.750 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:14.776 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:14.776 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:14.790 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:14.791 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:14.803 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:14.804 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:15.005 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:15.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 127 50244 50117 78.3017 73.2969 0.0218915 0.0127444 2026-02-24T07:55:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:15 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:55:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:15 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:55:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:15 trial016 ceph-mon[39544]: pgmap v313: 17 pgs: 17 active+clean; 221 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.84k op/s 2026-02-24T07:55:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:15 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1819510522' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:15 trial016 ceph-mon[39544]: osdmap e86: 4 total, 4 up, 4 in 2026-02-24T07:55:16.054 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:16.054 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:16.054 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T07:55:16.054 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:16.084 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 59626 59498 77.4654 73.2891 0.00227063 0.0128912 2026-02-24T07:55:16.207 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:16.337 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:16.333+0000 7f3e0a1ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:16.337 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:16.334+0000 7f3e0a1ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:16.495 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:16.496 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:16.542 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2026-02-24T07:55:15.808006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":231244320,"num_objects":3523,"num_object_clones":0,"num_object_copies":10569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3523,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":28291,"num_write_kb":227398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6610236,"kb_used_data":621932,"kb_used_omap":46,"kb_used_meta":5988177,"kb_avail":2929402564,"statfs":{"total":3006477107200,"available":2999708225536,"internally_reserved":0,"allocated":636858368,"data_stored":634458616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47152,"internal_metadata":6131894224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,9,15,36,62,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":230653952,"num_objects":3521,"num_object_clones":0,"num_object_copies":10563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28156,"num_write_kb":225248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000774"},"pg_stats":[{"pgid":"6.f","version":"85'1712","reported_seq":1729,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.968091+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:12.968091+0000","last_peered":"2026-02-24T07:55:12.968091+0000","last_clean":"2026-02-24T07:55:12.968091+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:12.968091+0000","last_undegraded":"2026-02-24T07:55:12.968091+0000","last_fullsized":"2026-02-24T07:55:12.968091+0000","mapping_epoch":82,"log_start":"85'1704","ondisk_log_start":"85'1704","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1704,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1712,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"85'1744","reported_seq":1745,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.797490+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:12.797490+0000","last_peered":"2026-02-24T07:55:12.797490+0000","last_clean":"2026-02-24T07:55:12.797490+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:12.797490+0000","last_undegraded":"2026-02-24T07:55:12.797490+0000","last_fullsized":"2026-02-24T07:55:12.797490+0000","mapping_epoch":82,"log_start":"85'1728","ondisk_log_start":"85'1728","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1728,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1744,"num_write_kb":13952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"85'1808","reported_seq":1809,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.822660+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:12.822660+0000","last_peered":"2026-02-24T07:55:12.822660+0000","last_clean":"2026-02-24T07:55:12.822660+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:12.822660+0000","last_undegraded":"2026-02-24T07:55:12.822660+0000","last_fullsized":"2026-02-24T07:55:12.822660+0000","mapping_epoch":82,"log_start":"85'1792","ondisk_log_start":"85'1792","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1792,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"85'1592","reported_seq":1609,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.969859+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:12.969859+0000","last_peered":"2026-02-24T07:55:12.969859+0000","last_clean":"2026-02-24T07:55:12.969859+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:12.969859+0000","last_undegraded":"2026-02-24T07:55:12.969859+0000","last_fullsized":"2026-02-24T07:55:12.969859+0000","mapping_epoch":82,"log_start":"85'1573","ondisk_log_start":"85'1573","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1573,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"85'1728","reported_seq":1745,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.969058+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:12.969058+0000","last_peered":"2026-02-24T07:55:12.969058+0000","last_clean":"2026-02-24T07:55:12.969058+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:12.969058+0000","last_undegraded":"2026-02-24T07:55:12.969058+0000","last_fullsized":"2026-02-24T07:55:12.969058+0000","mapping_epoch":82,"log_start":"85'1712","ondisk_log_start":"85'1712","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1712,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"85'1834","reported_seq":1848,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.822879+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:12.822879+0000","last_peered":"2026-02-24T07:55:12.822879+0000","last_clean":"2026-02-24T07:55:12.822879+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:12.822879+0000","last_undegraded":"2026-02-24T07:55:12.822879+0000","last_fullsized":"2026-02-24T07:55:12.822879+0000","mapping_epoch":82,"log_start":"85'1831","ondisk_log_start":"85'1831","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":1831,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15024128,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834,"num_write_kb":14672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"85'1800","reported_seq":1817,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.876747+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:12.876747+0000","last_peered":"2026-02-24T07:55:12.876747+0000","last_clean":"2026-02-24T07:55:12.876747+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:12.876747+0000","last_undegraded":"2026-02-24T07:55:12.876747+0000","last_fullsized":"2026-02-24T07:55:12.876747+0000","mapping_epoch":82,"log_start":"85'1789","ondisk_log_start":"85'1789","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":1789,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1800,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"85'1750","reported_seq":1761,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.839839+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:12.839839+0000","last_peered":"2026-02-24T07:55:12.839839+0000","last_clean":"2026-02-24T07:55:12.839839+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:12.839839+0000","last_undegraded":"2026-02-24T07:55:12.839839+0000","last_fullsized":"2026-02-24T07:55:12.839839+0000","mapping_epoch":82,"log_start":"85'1744","ondisk_log_start":"85'1744","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":1744,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14336000,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1750,"num_write_kb":14000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"85'1696","reported_seq":1697,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.924052+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:12.924052+0000","last_peered":"2026-02-24T07:55:12.924052+0000","last_clean":"2026-02-24T07:55:12.924052+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:12.924052+0000","last_undegraded":"2026-02-24T07:55:12.924052+0000","last_fullsized":"2026-02-24T07:55:12.924052+0000","mapping_epoch":82,"log_start":"85'1680","ondisk_log_start":"85'1680","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1680,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1696,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"85'1976","reported_seq":1993,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.828249+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:12.828249+0000","last_peered":"2026-02-24T07:55:12.828249+0000","last_clean":"2026-02-24T07:55:12.828249+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:12.828249+0000","last_undegraded":"2026-02-24T07:55:12.828249+0000","last_fullsized":"2026-02-24T07:55:12.828249+0000","mapping_epoch":82,"log_start":"85'1966","ondisk_log_start":"85'1966","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":1966,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1976,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"85'1640","reported_seq":1649,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.973809+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:12.973809+0000","last_peered":"2026-02-24T07:55:12.973809+0000","last_clean":"2026-02-24T07:55:12.973809+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:12.973809+0000","last_undegraded":"2026-02-24T07:55:12.973809+0000","last_fullsized":"2026-02-24T07:55:12.973809+0000","mapping_epoch":82,"log_start":"85'1627","ondisk_log_start":"85'1627","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1627,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"85'1880","reported_seq":1897,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.822029+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:12.822029+0000","last_peered":"2026-02-24T07:55:12.822029+0000","last_clean":"2026-02-24T07:55:12.822029+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:12.822029+0000","last_undegraded":"2026-02-24T07:55:12.822029+0000","last_fullsized":"2026-02-24T07:55:12.822029+0000","mapping_epoch":82,"log_start":"85'1864","ondisk_log_start":"85'1864","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1864,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"85'1640","reported_seq":1657,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.825160+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:12.825160+0000","last_peered":"2026-02-24T07:55:12.825160+0000","last_clean":"2026-02-24T07:55:12.825160+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:12.825160+0000","last_undegraded":"2026-02-24T07:55:12.825160+0000","last_fullsized":"2026-02-24T07:55:12.825160+0000","mapping_epoch":82,"log_start":"85'1635","ondisk_log_start":"85'1635","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":1635,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"85'1813","reported_seq":1817,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.953288+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:12.953288+0000","last_peered":"2026-02-24T07:55:12.953288+0000","last_clean":"2026-02-24T07:55:12.953288+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:12.953288+0000","last_undegraded":"2026-02-24T07:55:12.953288+0000","last_fullsized":"2026-02-24T07:55:12.953288+0000","mapping_epoch":82,"log_start":"85'1800","ondisk_log_start":"85'1800","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14852096,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":14504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"85'1719","reported_seq":1729,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.898155+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:12.898155+0000","last_peered":"2026-02-24T07:55:12.898155+0000","last_clean":"2026-02-24T07:55:12.898155+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:12.898155+0000","last_undegraded":"2026-02-24T07:55:12.898155+0000","last_fullsized":"2026-02-24T07:55:12.898155+0000","mapping_epoch":82,"log_start":"85'1711","ondisk_log_start":"85'1711","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1711,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14082048,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1719,"num_write_kb":13752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"85'1824","reported_seq":1833,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:12.836937+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:12.836937+0000","last_peered":"2026-02-24T07:55:12.836937+0000","last_clean":"2026-02-24T07:55:12.836937+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:12.836937+0000","last_undegraded":"2026-02-24T07:55:12.836937+0000","last_fullsized":"2026-02-24T07:55:12.836937+0000","mapping_epoch":82,"log_start":"85'1816","ondisk_log_start":"85'1816","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1816,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1824,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":351,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-24T07:55:11.001743+0000","last_change":"2026-02-24T07:54:03.007708+0000","last_active":"2026-02-24T07:55:11.001743+0000","last_peered":"2026-02-24T07:55:11.001743+0000","last_clean":"2026-02-24T07:55:11.001743+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:11.001743+0000","last_undegraded":"2026-02-24T07:55:11.001743+0000","last_fullsized":"2026-02-24T07:55:11.001743+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:54:03.007655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:54:03.007655+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:12.175073+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":230653952,"num_objects":3521,"num_object_clones":0,"num_object_copies":10563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28156,"num_write_kb":225248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":690372608,"data_stored":690372608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215208,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1703228,"kb_used_data":139368,"kb_used_omap":11,"kb_used_meta":1563828,"kb_avail":732299972,"statfs":{"total":751619276800,"available":749875171328,"internally_reserved":0,"allocated":142712832,"data_stored":142112006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":1601360417},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,4,4,14,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444137,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1848004,"kb_used_data":138672,"kb_used_omap":11,"kb_used_meta":1709300,"kb_avail":732155196,"statfs":{"total":751619276800,"available":749726920704,"internally_reserved":0,"allocated":142000128,"data_stored":141399302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11706,"internal_metadata":1750323782},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,25,31],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1678136,"kb_used_data":182180,"kb_used_omap":12,"kb_used_meta":1495923,"kb_avail":732325064,"statfs":{"total":751619276800,"available":749900865536,"internally_reserved":0,"allocated":186552320,"data_stored":185955046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13290,"internal_metadata":1531825174},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,5,11,7,17],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705774,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1380868,"kb_used_data":161712,"kb_used_omap":10,"kb_used_meta":1219125,"kb_avail":732622332,"statfs":{"total":751619276800,"available":750205267968,"internally_reserved":0,"allocated":165593088,"data_stored":164992262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10413,"internal_metadata":1248384851},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5058,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":172351488,"data_stored":172351488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":205619200,"data_stored":205619200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":169164800,"data_stored":169164800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143237120,"data_stored":143237120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:16.544 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:55:16.544 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 26 2026-02-24T07:55:16.737 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:16.851 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:16.868 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:16.865+0000 7f016d158640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:16.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:16.865+0000 7f016d158640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:17.006 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:17.028 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:55:17.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:55:17.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 127 69084 68957 76.955 73.8984 0.00478435 0.012979 2026-02-24T07:55:17.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:17 trial016 ceph-mon[39544]: pgmap v315: 17 pgs: 17 active+clean; 221 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 37 MiB/s wr, 4.69k op/s 2026-02-24T07:55:17.130 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:17.127+0000 7f0dfefc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:17.130 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:17.128+0000 7f0dfefc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:17.146 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:17.146 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:17.165 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:17.165 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:17.185 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:17.186 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:17.198 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:17.199 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:18.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 78076 77948 76.1153 70.2422 0.009007 0.0131242 2026-02-24T07:55:18.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:18 trial016 ceph-mon[39544]: from='client.15136 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:18.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1280593403' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:55:18.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1806582590' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:19.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 87746 87618 76.0514 75.5469 0.0153208 0.0131307 2026-02-24T07:55:19.242 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:19.268 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:19 trial016 ceph-mon[39544]: pgmap v316: 17 pgs: 17 active+clean; 221 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.53k op/s 2026-02-24T07:55:19.388 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:19.516 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:19.514+0000 7ff181a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:19.516 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:19.514+0000 7ff181a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:19.531 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:19.531 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:19.564 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:19.564 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:19.577 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:19.577 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:19.590 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:19.590 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:20.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 127 95561 95434 74.5521 61.0625 0.00658999 0.0133898 2026-02-24T07:55:20.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2761862856' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:20.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:20 trial016 ceph-mon[39544]: pgmap v317: 17 pgs: 17 active+clean; 597 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.66k op/s 2026-02-24T07:55:21.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 105299 105171 74.6897 76.0703 0.00974971 0.0133727 2026-02-24T07:55:22.076 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:22.077 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:22.077 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T07:55:22.077 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:22.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 115140 115012 74.872 76.8828 0.0146437 0.0133479 2026-02-24T07:55:22.180 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:22.232 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:22.561 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:22.930 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:22.760+0000 7f5f1dd9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:22.930 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:22.761+0000 7f5f1dd9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:22.930 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:22.931 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:22.931 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:22 trial016 ceph-mon[39544]: pgmap v318: 17 pgs: 17 active+clean; 597 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.63k op/s 2026-02-24T07:55:23.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 122252 122124 73.3866 55.5625 0.0123586 0.0135875 2026-02-24T07:55:23.513 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:23.481+0000 7fcdee8a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:23.514 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:23.482+0000 7fcdee8a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:23.514 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:23.514 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:23.529 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:23.530 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:23.545 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:23.545 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:23.559 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:23.560 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:23.676 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2026-02-24T07:55:21.808729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":625869344,"num_objects":9543,"num_object_clones":0,"num_object_copies":28629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9543,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":76463,"num_write_kb":612774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8082636,"kb_used_data":1769468,"kb_used_omap":49,"kb_used_meta":6313038,"kb_avail":2927930164,"statfs":{"total":3006477107200,"available":2998200487936,"internally_reserved":0,"allocated":1811935232,"data_stored":1809503932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50474,"internal_metadata":6464551638},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[31,8,8,12,35,27],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":625278976,"num_objects":9541,"num_object_clones":0,"num_object_copies":28623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76328,"num_write_kb":610624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001273"},"pg_stats":[{"pgid":"6.f","version":"86'4496","reported_seq":4515,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.970602+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:17.970602+0000","last_peered":"2026-02-24T07:55:17.970602+0000","last_clean":"2026-02-24T07:55:17.970602+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:17.970602+0000","last_undegraded":"2026-02-24T07:55:17.970602+0000","last_fullsized":"2026-02-24T07:55:17.970602+0000","mapping_epoch":82,"log_start":"86'4488","ondisk_log_start":"86'4488","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4496,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"86'4880","reported_seq":4899,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.811561+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:17.811561+0000","last_peered":"2026-02-24T07:55:17.811561+0000","last_clean":"2026-02-24T07:55:17.811561+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:17.811561+0000","last_undegraded":"2026-02-24T07:55:17.811561+0000","last_fullsized":"2026-02-24T07:55:17.811561+0000","mapping_epoch":82,"log_start":"86'4872","ondisk_log_start":"86'4872","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4880,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"86'4976","reported_seq":4989,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.811080+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:17.811080+0000","last_peered":"2026-02-24T07:55:17.811080+0000","last_clean":"2026-02-24T07:55:17.811080+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:17.811080+0000","last_undegraded":"2026-02-24T07:55:17.811080+0000","last_fullsized":"2026-02-24T07:55:17.811080+0000","mapping_epoch":82,"log_start":"86'4968","ondisk_log_start":"86'4968","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4976,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"86'4776","reported_seq":4786,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.975385+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:17.975385+0000","last_peered":"2026-02-24T07:55:17.975385+0000","last_clean":"2026-02-24T07:55:17.975385+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:17.975385+0000","last_undegraded":"2026-02-24T07:55:17.975385+0000","last_fullsized":"2026-02-24T07:55:17.975385+0000","mapping_epoch":82,"log_start":"86'4766","ondisk_log_start":"86'4766","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4776,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"86'4912","reported_seq":4931,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.964701+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:17.964701+0000","last_peered":"2026-02-24T07:55:17.964701+0000","last_clean":"2026-02-24T07:55:17.964701+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:17.964701+0000","last_undegraded":"2026-02-24T07:55:17.964701+0000","last_fullsized":"2026-02-24T07:55:17.964701+0000","mapping_epoch":82,"log_start":"86'4896","ondisk_log_start":"86'4896","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40239104,"num_objects":614,"num_object_clones":0,"num_object_copies":1842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4912,"num_write_kb":39296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'4896","reported_seq":4915,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.791832+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:17.791832+0000","last_peered":"2026-02-24T07:55:17.791832+0000","last_clean":"2026-02-24T07:55:17.791832+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:17.791832+0000","last_undegraded":"2026-02-24T07:55:17.791832+0000","last_fullsized":"2026-02-24T07:55:17.791832+0000","mapping_epoch":82,"log_start":"86'4880","ondisk_log_start":"86'4880","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4896,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'4680","reported_seq":4699,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.890866+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:17.890866+0000","last_peered":"2026-02-24T07:55:17.890866+0000","last_clean":"2026-02-24T07:55:17.890866+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:17.890866+0000","last_undegraded":"2026-02-24T07:55:17.890866+0000","last_fullsized":"2026-02-24T07:55:17.890866+0000","mapping_epoch":82,"log_start":"86'4672","ondisk_log_start":"86'4672","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4680,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"86'4480","reported_seq":4499,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.840436+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:17.840436+0000","last_peered":"2026-02-24T07:55:17.840436+0000","last_clean":"2026-02-24T07:55:17.840436+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:17.840436+0000","last_undegraded":"2026-02-24T07:55:17.840436+0000","last_fullsized":"2026-02-24T07:55:17.840436+0000","mapping_epoch":82,"log_start":"86'4472","ondisk_log_start":"86'4472","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4480,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"86'4568","reported_seq":4587,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.963277+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:17.963277+0000","last_peered":"2026-02-24T07:55:17.963277+0000","last_clean":"2026-02-24T07:55:17.963277+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:17.963277+0000","last_undegraded":"2026-02-24T07:55:17.963277+0000","last_fullsized":"2026-02-24T07:55:17.963277+0000","mapping_epoch":82,"log_start":"86'4560","ondisk_log_start":"86'4560","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37421056,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4568,"num_write_kb":36544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"86'4992","reported_seq":5011,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.825574+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:17.825574+0000","last_peered":"2026-02-24T07:55:17.825574+0000","last_clean":"2026-02-24T07:55:17.825574+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:17.825574+0000","last_undegraded":"2026-02-24T07:55:17.825574+0000","last_fullsized":"2026-02-24T07:55:17.825574+0000","mapping_epoch":82,"log_start":"86'4989","ondisk_log_start":"86'4989","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40894464,"num_objects":624,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4992,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"86'4616","reported_seq":4635,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.971887+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:17.971887+0000","last_peered":"2026-02-24T07:55:17.971887+0000","last_clean":"2026-02-24T07:55:17.971887+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:17.971887+0000","last_undegraded":"2026-02-24T07:55:17.971887+0000","last_fullsized":"2026-02-24T07:55:17.971887+0000","mapping_epoch":82,"log_start":"86'4600","ondisk_log_start":"86'4600","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37814272,"num_objects":577,"num_object_clones":0,"num_object_copies":1731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4616,"num_write_kb":36928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"86'4560","reported_seq":4579,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.807583+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:17.807583+0000","last_peered":"2026-02-24T07:55:17.807583+0000","last_clean":"2026-02-24T07:55:17.807583+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:17.807583+0000","last_undegraded":"2026-02-24T07:55:17.807583+0000","last_fullsized":"2026-02-24T07:55:17.807583+0000","mapping_epoch":82,"log_start":"86'4552","ondisk_log_start":"86'4552","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4560,"num_write_kb":36480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"86'4640","reported_seq":4659,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.844503+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:17.844503+0000","last_peered":"2026-02-24T07:55:17.844503+0000","last_clean":"2026-02-24T07:55:17.844503+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:17.844503+0000","last_undegraded":"2026-02-24T07:55:17.844503+0000","last_fullsized":"2026-02-24T07:55:17.844503+0000","mapping_epoch":82,"log_start":"86'4634","ondisk_log_start":"86'4634","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4640,"num_write_kb":37120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"86'4760","reported_seq":4779,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.962165+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:17.962165+0000","last_peered":"2026-02-24T07:55:17.962165+0000","last_clean":"2026-02-24T07:55:17.962165+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:17.962165+0000","last_undegraded":"2026-02-24T07:55:17.962165+0000","last_fullsized":"2026-02-24T07:55:17.962165+0000","mapping_epoch":82,"log_start":"86'4723","ondisk_log_start":"86'4723","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":3000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38993920,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4760,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"86'4936","reported_seq":4955,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.880389+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:17.880389+0000","last_peered":"2026-02-24T07:55:17.880389+0000","last_clean":"2026-02-24T07:55:17.880389+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:17.880389+0000","last_undegraded":"2026-02-24T07:55:17.880389+0000","last_fullsized":"2026-02-24T07:55:17.880389+0000","mapping_epoch":82,"log_start":"86'4931","ondisk_log_start":"86'4931","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40435712,"num_objects":617,"num_object_clones":0,"num_object_copies":1851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":617,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4936,"num_write_kb":39488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'5160","reported_seq":5174,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:17.845676+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:17.845676+0000","last_peered":"2026-02-24T07:55:17.845676+0000","last_clean":"2026-02-24T07:55:17.845676+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:17.845676+0000","last_undegraded":"2026-02-24T07:55:17.845676+0000","last_fullsized":"2026-02-24T07:55:17.845676+0000","mapping_epoch":82,"log_start":"86'5144","ondisk_log_start":"86'5144","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42270720,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5160,"num_write_kb":41280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:14.852957+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:55:14.852957+0000","last_peered":"2026-02-24T07:55:14.852957+0000","last_clean":"2026-02-24T07:55:14.852957+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:14.852957+0000","last_undegraded":"2026-02-24T07:55:14.852957+0000","last_fullsized":"2026-02-24T07:55:14.852957+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":625278976,"num_objects":9541,"num_object_clones":0,"num_object_copies":28623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76328,"num_write_kb":610624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1876697088,"data_stored":1876697088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215209,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2006928,"kb_used_data":370876,"kb_used_omap":12,"kb_used_meta":1636019,"kb_avail":731996272,"statfs":{"total":751619276800,"available":749564182528,"internally_reserved":0,"allocated":379777024,"data_stored":379168311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12457,"internal_metadata":1675284311},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,0,0,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444138,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2212648,"kb_used_data":431124,"kb_used_omap":12,"kb_used_meta":1781491,"kb_avail":731790552,"statfs":{"total":751619276800,"available":749353525248,"internally_reserved":0,"allocated":441470976,"data_stored":440862263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12358,"internal_metadata":1824247738},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,6,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2087500,"kb_used_data":519352,"kb_used_omap":13,"kb_used_meta":1568114,"kb_avail":731915700,"statfs":{"total":751619276800,"available":749481676800,"internally_reserved":0,"allocated":531816448,"data_stored":531211287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13942,"internal_metadata":1605749130},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,8,8,0,25,27],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1775560,"kb_used_data":448116,"kb_used_omap":11,"kb_used_meta":1327412,"kb_avail":732227640,"statfs":{"total":751619276800,"available":749801103360,"internally_reserved":0,"allocated":458870784,"data_stored":458262071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11717,"internal_metadata":1359270459},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":468869120,"data_stored":468869120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":551813120,"data_stored":551813120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":470941696,"data_stored":470941696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":385073152,"data_stored":385073152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:23.678 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 26 2026-02-24T07:55:23.821 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:23.950 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:23.947+0000 7f387ecff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:23.950 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:23.947+0000 7f387ecff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:24.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:23 trial016 ceph-mon[39544]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:24.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2321751212' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:24.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 127 130135 130008 72.5439 61.5938 0.00680435 0.0137768 2026-02-24T07:55:24.099 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:55:24.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:55:25.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 140923 140795 73.3255 84.2734 0.00460784 0.0136297 2026-02-24T07:55:25.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:24 trial016 ceph-mon[39544]: pgmap v319: 17 pgs: 17 active+clean; 947 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s wr, 9.29k op/s 2026-02-24T07:55:25.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1328449112' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T07:55:25.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:25.776 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:25.928 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:26.053 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:26.050+0000 7f9d1b3b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:26.053 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:26.050+0000 7f9d1b3b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:26.068 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:26.068 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:26.085 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 151142 151014 73.732 79.8359 0.00236648 0.0135524 2026-02-24T07:55:26.092 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:26.092 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:26.107 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:26.107 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:26.121 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:26.121 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:27.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 160677 160549 73.7764 74.4922 0.00535905 0.0135432 2026-02-24T07:55:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:26 trial016 ceph-mon[39544]: pgmap v320: 17 pgs: 17 active+clean; 947 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.48k op/s 2026-02-24T07:55:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:26 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2999903041' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:28.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 127 170173 170046 73.7994 74.1953 0.0066294 0.0135423 2026-02-24T07:55:28.166 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:28.316 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:28.785+0000 7efe335b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:28.786+0000 7efe335b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:28.835 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:28.849 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:28.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:28.861 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:28.861 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:29.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:28 trial016 ceph-mon[39544]: pgmap v321: 17 pgs: 17 active+clean; 947 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s wr, 7.75k op/s 2026-02-24T07:55:29.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3249402880' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:29.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 128 177168 177040 72.7908 54.6406 0.00343555 0.0137263 2026-02-24T07:55:29.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:29.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:29.146 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:55:29.146 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:55:29.519 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:29.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:29.950+0000 7ff16a77f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:29.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:29.950+0000 7ff16a77f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:29.999 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:55:30.000 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:55:30.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:55:30.084430+0000 min lat: 0.000575227 max lat: 0.0955226 avg lat: 0.0139453 2026-02-24T07:55:30.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:55:30.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 128 183577 183449 71.6546 50.0703 0.0128986 0.0139453 2026-02-24T07:55:30.694 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:55:30.695 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:55:30.695 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:55:30.840 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:30.957 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:30 trial016 ceph-mon[39544]: pgmap v322: 17 pgs: 17 active+clean; 1.3 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s wr, 11.69k op/s 2026-02-24T07:55:31.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 190541 190413 70.833 54.4062 0.0146862 0.014113 2026-02-24T07:55:31.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:31.246+0000 7f8fc76c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:31.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:31.246+0000 7f8fc76c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:55:31.315 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:55:31.316 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:55:31.316 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:55:31.316 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:55:31.537 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:31.842 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:55:31.843 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:55:31.843 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:55:31.851 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:32.024 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:32.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 128 197036 196908 69.9196 50.7422 0.00968278 0.0142957 2026-02-24T07:55:32.109 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.105+0000 7f6b11fe6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.106+0000 7f6b11fe6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.133 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:32.134 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:32.149 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:32.149 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:32.154 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.151+0000 7f157f4b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.155 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.152+0000 7f157f4b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.177 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:32.177 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:55:32.183 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:55:32.192 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:32.192 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:32.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:55:32.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:55:32.223 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:55:32.425 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:32.562 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.557+0000 7f5f08d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.562 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:32.558+0000 7f5f08d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:55:32.583 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:55:32.584 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:55:32.584 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:55:32.584 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:55:32.622 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:55:32.622 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:55:33.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 128 206814 206686 70.2007 76.3906 0.00988666 0.0142372 2026-02-24T07:55:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:32 trial016 ceph-mon[39544]: pgmap v323: 17 pgs: 17 active+clean; 1.3 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.67k op/s 2026-02-24T07:55:33.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3680735456' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:34.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 127 216735 216608 70.5053 77.5156 0.0127133 0.014176 2026-02-24T07:55:34.238 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:34.391 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:34.826 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:34.800+0000 7f21b8a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:34.826 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:34.800+0000 7f21b8a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:34.826 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:34.827 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:34.844 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:34.845 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:34.858 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:34.858 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:34.872 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:34.872 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:35.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:34 trial016 ceph-mon[39544]: pgmap v324: 17 pgs: 17 active+clean; 1.6 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.71k op/s 2026-02-24T07:55:35.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3993569676' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:35.068 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:35.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 127 224847 224720 70.2199 63.375 0.0130733 0.0142343 2026-02-24T07:55:36.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 232891 232763 69.9357 62.8359 0.00221805 0.0142903 2026-02-24T07:55:37.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 127 241938 241811 69.9634 70.6875 0.00795821 0.0142878 2026-02-24T07:55:37.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:36 trial016 ceph-mon[39544]: pgmap v325: 17 pgs: 17 active+clean; 1.6 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 6.98k op/s 2026-02-24T07:55:37.583 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:37.623 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:37.623 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:37.624 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:37.735 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:37.784 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:38.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 250540 250412 69.8643 67.1953 0.0112691 0.0143084 2026-02-24T07:55:38.169 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:38.149+0000 7efd05c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:38.169 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:38.149+0000 7efd05c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:38.184 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:38.185 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:38.245 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:38.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:38.259 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:38.259 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:38.270 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:38.270 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:38.907 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:38.899+0000 7fd78b9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:38.907 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:38.899+0000 7fd78b9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:39.040 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:39.041 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:39.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 256326 256198 69.0138 45.2031 0.00887378 0.0144837 2026-02-24T07:55:39.089 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2026-02-24T07:55:37.810818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1678803488,"num_objects":25611,"num_object_clones":0,"num_object_copies":76833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25611,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":204995,"num_write_kb":1641030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10319484,"kb_used_data":4840620,"kb_used_omap":49,"kb_used_meta":5478734,"kb_avail":2925693316,"statfs":{"total":3006477107200,"available":2995909955584,"internally_reserved":0,"allocated":4956794880,"data_stored":4954363580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50474,"internal_metadata":5610224342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,8,12],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686063616,"num_objects":10468,"num_object_clones":0,"num_object_copies":31404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83748,"num_write_kb":669984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001506"},"pg_stats":[{"pgid":"6.f","version":"86'12336","reported_seq":12355,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.966826+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:32.966826+0000","last_peered":"2026-02-24T07:55:32.966826+0000","last_clean":"2026-02-24T07:55:32.966826+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:32.966826+0000","last_undegraded":"2026-02-24T07:55:32.966826+0000","last_fullsized":"2026-02-24T07:55:32.966826+0000","mapping_epoch":82,"log_start":"86'12320","ondisk_log_start":"86'12320","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101056512,"num_objects":1542,"num_object_clones":0,"num_object_copies":4626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12336,"num_write_kb":98688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"86'12624","reported_seq":12643,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.829845+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:32.829845+0000","last_peered":"2026-02-24T07:55:32.829845+0000","last_clean":"2026-02-24T07:55:32.829845+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:32.829845+0000","last_undegraded":"2026-02-24T07:55:32.829845+0000","last_fullsized":"2026-02-24T07:55:32.829845+0000","mapping_epoch":82,"log_start":"86'12608","ondisk_log_start":"86'12608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103415808,"num_objects":1578,"num_object_clones":0,"num_object_copies":4734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1578,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12624,"num_write_kb":100992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"86'13632","reported_seq":13651,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.830396+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:32.830396+0000","last_peered":"2026-02-24T07:55:32.830396+0000","last_clean":"2026-02-24T07:55:32.830396+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:32.830396+0000","last_undegraded":"2026-02-24T07:55:32.830396+0000","last_fullsized":"2026-02-24T07:55:32.830396+0000","mapping_epoch":82,"log_start":"86'13624","ondisk_log_start":"86'13624","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111673344,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13632,"num_write_kb":109056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"86'12555","reported_seq":12571,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.975730+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:32.975730+0000","last_peered":"2026-02-24T07:55:32.975730+0000","last_clean":"2026-02-24T07:55:32.975730+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:32.975730+0000","last_undegraded":"2026-02-24T07:55:32.975730+0000","last_fullsized":"2026-02-24T07:55:32.975730+0000","mapping_epoch":82,"log_start":"86'12547","ondisk_log_start":"86'12547","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102850560,"num_objects":1570,"num_object_clones":0,"num_object_copies":4710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12555,"num_write_kb":100440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"86'12872","reported_seq":12891,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.948127+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:32.948127+0000","last_peered":"2026-02-24T07:55:32.948127+0000","last_clean":"2026-02-24T07:55:32.948127+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:32.948127+0000","last_undegraded":"2026-02-24T07:55:32.948127+0000","last_fullsized":"2026-02-24T07:55:32.948127+0000","mapping_epoch":82,"log_start":"86'12848","ondisk_log_start":"86'12848","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105447424,"num_objects":1609,"num_object_clones":0,"num_object_copies":4827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12872,"num_write_kb":102976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'12840","reported_seq":12859,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.831378+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:32.831378+0000","last_peered":"2026-02-24T07:55:32.831378+0000","last_clean":"2026-02-24T07:55:32.831378+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:32.831378+0000","last_undegraded":"2026-02-24T07:55:32.831378+0000","last_fullsized":"2026-02-24T07:55:32.831378+0000","mapping_epoch":82,"log_start":"86'12816","ondisk_log_start":"86'12816","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105185280,"num_objects":1605,"num_object_clones":0,"num_object_copies":4815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12840,"num_write_kb":102720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'12752","reported_seq":12771,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.897242+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:32.897242+0000","last_peered":"2026-02-24T07:55:32.897242+0000","last_clean":"2026-02-24T07:55:32.897242+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:32.897242+0000","last_undegraded":"2026-02-24T07:55:32.897242+0000","last_fullsized":"2026-02-24T07:55:32.897242+0000","mapping_epoch":82,"log_start":"86'12748","ondisk_log_start":"86'12748","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104464384,"num_objects":1594,"num_object_clones":0,"num_object_copies":4782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12752,"num_write_kb":102016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"86'12224","reported_seq":12243,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.846687+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:32.846687+0000","last_peered":"2026-02-24T07:55:32.846687+0000","last_clean":"2026-02-24T07:55:32.846687+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:32.846687+0000","last_undegraded":"2026-02-24T07:55:32.846687+0000","last_fullsized":"2026-02-24T07:55:32.846687+0000","mapping_epoch":82,"log_start":"86'12202","ondisk_log_start":"86'12202","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100139008,"num_objects":1528,"num_object_clones":0,"num_object_copies":4584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12224,"num_write_kb":97792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"86'13056","reported_seq":13068,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.976786+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:32.976786+0000","last_peered":"2026-02-24T07:55:32.976786+0000","last_clean":"2026-02-24T07:55:32.976786+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:32.976786+0000","last_undegraded":"2026-02-24T07:55:32.976786+0000","last_fullsized":"2026-02-24T07:55:32.976786+0000","mapping_epoch":82,"log_start":"86'13048","ondisk_log_start":"86'13048","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":1632,"num_object_clones":0,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13056,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"86'13152","reported_seq":13171,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.822185+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:32.822185+0000","last_peered":"2026-02-24T07:55:32.822185+0000","last_clean":"2026-02-24T07:55:32.822185+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:32.822185+0000","last_undegraded":"2026-02-24T07:55:32.822185+0000","last_fullsized":"2026-02-24T07:55:32.822185+0000","mapping_epoch":82,"log_start":"86'13146","ondisk_log_start":"86'13146","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107741184,"num_objects":1644,"num_object_clones":0,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13152,"num_write_kb":105216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"86'12928","reported_seq":12947,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.966662+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:32.966662+0000","last_peered":"2026-02-24T07:55:32.966662+0000","last_clean":"2026-02-24T07:55:32.966662+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:32.966662+0000","last_undegraded":"2026-02-24T07:55:32.966662+0000","last_fullsized":"2026-02-24T07:55:32.966662+0000","mapping_epoch":82,"log_start":"86'12920","ondisk_log_start":"86'12920","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105906176,"num_objects":1616,"num_object_clones":0,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12928,"num_write_kb":103424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"86'12200","reported_seq":12219,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.800284+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:32.800284+0000","last_peered":"2026-02-24T07:55:32.800284+0000","last_clean":"2026-02-24T07:55:32.800284+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:32.800284+0000","last_undegraded":"2026-02-24T07:55:32.800284+0000","last_fullsized":"2026-02-24T07:55:32.800284+0000","mapping_epoch":82,"log_start":"86'12184","ondisk_log_start":"86'12184","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99942400,"num_objects":1525,"num_object_clones":0,"num_object_copies":4575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12200,"num_write_kb":97600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"86'12808","reported_seq":12827,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.848398+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:32.848398+0000","last_peered":"2026-02-24T07:55:32.848398+0000","last_clean":"2026-02-24T07:55:32.848398+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:32.848398+0000","last_undegraded":"2026-02-24T07:55:32.848398+0000","last_fullsized":"2026-02-24T07:55:32.848398+0000","mapping_epoch":82,"log_start":"86'12800","ondisk_log_start":"86'12800","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104923136,"num_objects":1601,"num_object_clones":0,"num_object_copies":4803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12808,"num_write_kb":102464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"86'13081","reported_seq":13097,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.982012+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:32.982012+0000","last_peered":"2026-02-24T07:55:32.982012+0000","last_clean":"2026-02-24T07:55:32.982012+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:32.982012+0000","last_undegraded":"2026-02-24T07:55:32.982012+0000","last_fullsized":"2026-02-24T07:55:32.982012+0000","mapping_epoch":82,"log_start":"86'13072","ondisk_log_start":"86'13072","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107159552,"num_objects":1636,"num_object_clones":0,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13081,"num_write_kb":104648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"86'12512","reported_seq":12531,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.886263+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:32.886263+0000","last_peered":"2026-02-24T07:55:32.886263+0000","last_clean":"2026-02-24T07:55:32.886263+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:32.886263+0000","last_undegraded":"2026-02-24T07:55:32.886263+0000","last_fullsized":"2026-02-24T07:55:32.886263+0000","mapping_epoch":82,"log_start":"86'12504","ondisk_log_start":"86'12504","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102498304,"num_objects":1564,"num_object_clones":0,"num_object_copies":4692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12512,"num_write_kb":100096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'13288","reported_seq":13301,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:32.846598+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:32.846598+0000","last_peered":"2026-02-24T07:55:32.846598+0000","last_clean":"2026-02-24T07:55:32.846598+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:32.846598+0000","last_undegraded":"2026-02-24T07:55:32.846598+0000","last_fullsized":"2026-02-24T07:55:32.846598+0000","mapping_epoch":82,"log_start":"86'13280","ondisk_log_start":"86'13280","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108855296,"num_objects":1661,"num_object_clones":0,"num_object_copies":4983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13288,"num_write_kb":106304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:14.852957+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:55:14.852957+0000","last_peered":"2026-02-24T07:55:14.852957+0000","last_clean":"2026-02-24T07:55:14.852957+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:14.852957+0000","last_undegraded":"2026-02-24T07:55:14.852957+0000","last_fullsized":"2026-02-24T07:55:14.852957+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1678213120,"num_objects":25609,"num_object_clones":0,"num_object_copies":76827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204860,"num_write_kb":1638880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5035237376,"data_stored":5035237376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215212,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2873720,"kb_used_data":1011556,"kb_used_omap":12,"kb_used_meta":1862131,"kb_avail":731129480,"statfs":{"total":751619276800,"available":748676587520,"internally_reserved":0,"allocated":1035833344,"data_stored":1035224631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12457,"internal_metadata":1906822999},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,12],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1780456,"kb_used_data":1196756,"kb_used_omap":12,"kb_used_meta":583667,"kb_avail":732222744,"statfs":{"total":751619276800,"available":749796089856,"internally_reserved":0,"allocated":1225478144,"data_stored":1224869431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12358,"internal_metadata":597675962},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3262636,"kb_used_data":1405528,"kb_used_omap":13,"kb_used_meta":1857074,"kb_avail":730740564,"statfs":{"total":751619276800,"available":748278337536,"internally_reserved":0,"allocated":1439260672,"data_stored":1438655511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13942,"internal_metadata":1901644170},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705778,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2402672,"kb_used_data":1226780,"kb_used_omap":11,"kb_used_meta":1175860,"kb_avail":731600528,"statfs":{"total":751619276800,"available":749158940672,"internally_reserved":0,"allocated":1256222720,"data_stored":1255614007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11717,"internal_metadata":1204081211},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1263665152,"data_stored":1263665152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1471143936,"data_stored":1471143936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1256562688,"data_stored":1256562688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1043865600,"data_stored":1043865600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:38 trial016 ceph-mon[39544]: pgmap v326: 17 pgs: 17 active+clean; 1.6 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 6.98k op/s 2026-02-24T07:55:39.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3198831043' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:40.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 265554 265426 69.1163 72.0938 0.00518187 0.0144628 2026-02-24T07:55:41.056 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:41.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 127 274795 274668 69.2157 72.2031 0.0150053 0.0144426 2026-02-24T07:55:41.198 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:40 trial016 ceph-mon[39544]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:40 trial016 ceph-mon[39544]: pgmap v327: 17 pgs: 17 active+clean; 1.9 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 83 MiB/s wr, 10.67k op/s 2026-02-24T07:55:41.456 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:41.453+0000 7febadc49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:41.456 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:41.453+0000 7febadc49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:41.474 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:41.474 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:41.497 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:41.497 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:41.513 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:41.513 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:41.527 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:41.528 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:42.086 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 127 283562 283435 69.1929 68.4922 0.0147557 0.0144481 2026-02-24T07:55:42.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4084243172' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:43.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 128 293007 292879 69.3318 73.7812 0.0048624 0.0144178 2026-02-24T07:55:43.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:42 trial016 ceph-mon[39544]: pgmap v328: 17 pgs: 17 active+clean; 1.9 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.72k op/s 2026-02-24T07:55:43.575 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:43.723 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:43.848 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:43.845+0000 7f7d1900f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:43.848 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:43.846+0000 7f7d1900f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:43.864 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:43.865 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:43.888 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:43.888 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:43.902 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:43.902 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:43.914 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:43.914 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:44.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 127 301972 301845 69.3527 70.0469 0.0156179 0.0144106 2026-02-24T07:55:44.092 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:44.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:44.093 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:44.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2853432938' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:44.239 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:44.373 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:44.370+0000 7fbe00ef7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:44.373 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:44.370+0000 7fbe00ef7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:44.514 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:44.515 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:44.565 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2026-02-24T07:55:43.811590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2386379296,"num_objects":36407,"num_object_clones":0,"num_object_copies":109221,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36407,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":291369,"num_write_kb":2332022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10038580,"kb_used_data":6924196,"kb_used_omap":43,"kb_used_meta":3114260,"kb_avail":2925974220,"statfs":{"total":3006477107200,"available":2996197601280,"internally_reserved":0,"allocated":7090376704,"data_stored":7087945404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44322,"internal_metadata":3189002974},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,8,0,0,35,26],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1005895680,"num_objects":15349,"num_object_clones":0,"num_object_copies":46047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122790,"num_write_kb":982320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001497"},"pg_stats":[{"pgid":"6.f","version":"86'17848","reported_seq":17867,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.976851+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:42.976851+0000","last_peered":"2026-02-24T07:55:42.976851+0000","last_clean":"2026-02-24T07:55:42.976851+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:42.976851+0000","last_undegraded":"2026-02-24T07:55:42.976851+0000","last_fullsized":"2026-02-24T07:55:42.976851+0000","mapping_epoch":82,"log_start":"86'17840","ondisk_log_start":"86'17840","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146210816,"num_objects":2231,"num_object_clones":0,"num_object_copies":6693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17848,"num_write_kb":142784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"86'17928","reported_seq":17947,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.836433+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:42.836433+0000","last_peered":"2026-02-24T07:55:42.836433+0000","last_clean":"2026-02-24T07:55:42.836433+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:42.836433+0000","last_undegraded":"2026-02-24T07:55:42.836433+0000","last_fullsized":"2026-02-24T07:55:42.836433+0000","mapping_epoch":82,"log_start":"86'17904","ondisk_log_start":"86'17904","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146866176,"num_objects":2241,"num_object_clones":0,"num_object_copies":6723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17928,"num_write_kb":143424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"86'19080","reported_seq":19099,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.835642+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:42.835642+0000","last_peered":"2026-02-24T07:55:42.835642+0000","last_clean":"2026-02-24T07:55:42.835642+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:42.835642+0000","last_undegraded":"2026-02-24T07:55:42.835642+0000","last_fullsized":"2026-02-24T07:55:42.835642+0000","mapping_epoch":82,"log_start":"86'19055","ondisk_log_start":"86'19055","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156303360,"num_objects":2385,"num_object_clones":0,"num_object_copies":7155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19080,"num_write_kb":152640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"86'17904","reported_seq":17911,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.985741+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:42.985741+0000","last_peered":"2026-02-24T07:55:42.985741+0000","last_clean":"2026-02-24T07:55:42.985741+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:42.985741+0000","last_undegraded":"2026-02-24T07:55:42.985741+0000","last_fullsized":"2026-02-24T07:55:42.985741+0000","mapping_epoch":82,"log_start":"86'17880","ondisk_log_start":"86'17880","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146669568,"num_objects":2238,"num_object_clones":0,"num_object_copies":6714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17904,"num_write_kb":143232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"86'18096","reported_seq":18115,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.965447+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:42.965447+0000","last_peered":"2026-02-24T07:55:42.965447+0000","last_clean":"2026-02-24T07:55:42.965447+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:42.965447+0000","last_undegraded":"2026-02-24T07:55:42.965447+0000","last_fullsized":"2026-02-24T07:55:42.965447+0000","mapping_epoch":82,"log_start":"86'18088","ondisk_log_start":"86'18088","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148242432,"num_objects":2262,"num_object_clones":0,"num_object_copies":6786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18096,"num_write_kb":144768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'18352","reported_seq":18371,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.805867+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:42.805867+0000","last_peered":"2026-02-24T07:55:42.805867+0000","last_clean":"2026-02-24T07:55:42.805867+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:42.805867+0000","last_undegraded":"2026-02-24T07:55:42.805867+0000","last_fullsized":"2026-02-24T07:55:42.805867+0000","mapping_epoch":82,"log_start":"86'18336","ondisk_log_start":"86'18336","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150339584,"num_objects":2294,"num_object_clones":0,"num_object_copies":6882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18352,"num_write_kb":146816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'18375","reported_seq":18390,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.913580+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:42.913580+0000","last_peered":"2026-02-24T07:55:42.913580+0000","last_clean":"2026-02-24T07:55:42.913580+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:42.913580+0000","last_undegraded":"2026-02-24T07:55:42.913580+0000","last_fullsized":"2026-02-24T07:55:42.913580+0000","mapping_epoch":82,"log_start":"86'18368","ondisk_log_start":"86'18368","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150528000,"num_objects":2297,"num_object_clones":0,"num_object_copies":6891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18375,"num_write_kb":147000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"86'17536","reported_seq":17555,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.841466+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:42.841466+0000","last_peered":"2026-02-24T07:55:42.841466+0000","last_clean":"2026-02-24T07:55:42.841466+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:42.841466+0000","last_undegraded":"2026-02-24T07:55:42.841466+0000","last_fullsized":"2026-02-24T07:55:42.841466+0000","mapping_epoch":82,"log_start":"86'17528","ondisk_log_start":"86'17528","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143654912,"num_objects":2192,"num_object_clones":0,"num_object_copies":6576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17536,"num_write_kb":140288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"86'18680","reported_seq":18699,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.981676+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:42.981676+0000","last_peered":"2026-02-24T07:55:42.981676+0000","last_clean":"2026-02-24T07:55:42.981676+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:42.981676+0000","last_undegraded":"2026-02-24T07:55:42.981676+0000","last_fullsized":"2026-02-24T07:55:42.981676+0000","mapping_epoch":82,"log_start":"86'18657","ondisk_log_start":"86'18657","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153026560,"num_objects":2335,"num_object_clones":0,"num_object_copies":7005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18680,"num_write_kb":149440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"86'18304","reported_seq":18323,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.820922+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:42.820922+0000","last_peered":"2026-02-24T07:55:42.820922+0000","last_clean":"2026-02-24T07:55:42.820922+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:42.820922+0000","last_undegraded":"2026-02-24T07:55:42.820922+0000","last_fullsized":"2026-02-24T07:55:42.820922+0000","mapping_epoch":82,"log_start":"86'18300","ondisk_log_start":"86'18300","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149946368,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18304,"num_write_kb":146432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"86'18496","reported_seq":18515,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.966697+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:42.966697+0000","last_peered":"2026-02-24T07:55:42.966697+0000","last_clean":"2026-02-24T07:55:42.966697+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:42.966697+0000","last_undegraded":"2026-02-24T07:55:42.966697+0000","last_fullsized":"2026-02-24T07:55:42.966697+0000","mapping_epoch":82,"log_start":"86'18472","ondisk_log_start":"86'18472","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151519232,"num_objects":2312,"num_object_clones":0,"num_object_copies":6936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18496,"num_write_kb":147968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"86'17672","reported_seq":17691,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.836936+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:42.836936+0000","last_peered":"2026-02-24T07:55:42.836936+0000","last_clean":"2026-02-24T07:55:42.836936+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:42.836936+0000","last_undegraded":"2026-02-24T07:55:42.836936+0000","last_fullsized":"2026-02-24T07:55:42.836936+0000","mapping_epoch":82,"log_start":"86'17656","ondisk_log_start":"86'17656","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144769024,"num_objects":2209,"num_object_clones":0,"num_object_copies":6627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17672,"num_write_kb":141376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"86'17800","reported_seq":17819,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.848078+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:42.848078+0000","last_peered":"2026-02-24T07:55:42.848078+0000","last_clean":"2026-02-24T07:55:42.848078+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:42.848078+0000","last_undegraded":"2026-02-24T07:55:42.848078+0000","last_fullsized":"2026-02-24T07:55:42.848078+0000","mapping_epoch":82,"log_start":"86'17789","ondisk_log_start":"86'17789","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145817600,"num_objects":2225,"num_object_clones":0,"num_object_copies":6675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17800,"num_write_kb":142400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"86'18571","reported_seq":18587,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.981179+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:42.981179+0000","last_peered":"2026-02-24T07:55:42.981179+0000","last_clean":"2026-02-24T07:55:42.981179+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:42.981179+0000","last_undegraded":"2026-02-24T07:55:42.981179+0000","last_fullsized":"2026-02-24T07:55:42.981179+0000","mapping_epoch":82,"log_start":"86'18564","ondisk_log_start":"86'18564","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152133632,"num_objects":2322,"num_object_clones":0,"num_object_copies":6966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18571,"num_write_kb":148568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"86'17736","reported_seq":17755,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.908602+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:42.908602+0000","last_peered":"2026-02-24T07:55:42.908602+0000","last_clean":"2026-02-24T07:55:42.908602+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:42.908602+0000","last_undegraded":"2026-02-24T07:55:42.908602+0000","last_fullsized":"2026-02-24T07:55:42.908602+0000","mapping_epoch":82,"log_start":"86'17728","ondisk_log_start":"86'17728","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145293312,"num_objects":2217,"num_object_clones":0,"num_object_copies":6651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17736,"num_write_kb":141888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'18856","reported_seq":18869,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:42.845301+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:42.845301+0000","last_peered":"2026-02-24T07:55:42.845301+0000","last_clean":"2026-02-24T07:55:42.845301+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:42.845301+0000","last_undegraded":"2026-02-24T07:55:42.845301+0000","last_fullsized":"2026-02-24T07:55:42.845301+0000","mapping_epoch":82,"log_start":"86'18848","ondisk_log_start":"86'18848","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154468352,"num_objects":2357,"num_object_clones":0,"num_object_copies":7071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18856,"num_write_kb":150848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:14.852957+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:55:14.852957+0000","last_peered":"2026-02-24T07:55:14.852957+0000","last_clean":"2026-02-24T07:55:14.852957+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:14.852957+0000","last_undegraded":"2026-02-24T07:55:14.852957+0000","last_fullsized":"2026-02-24T07:55:14.852957+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2385788928,"num_objects":36405,"num_object_clones":0,"num_object_copies":109215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291234,"num_write_kb":2329872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157293056,"data_stored":7157293056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215214,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1990864,"kb_used_data":1446460,"kb_used_omap":12,"kb_used_meta":544371,"kb_avail":732012336,"statfs":{"total":751619276800,"available":749580632064,"internally_reserved":0,"allocated":1481175040,"data_stored":1480566327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12457,"internal_metadata":557436759},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444143,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2457952,"kb_used_data":1711820,"kb_used_omap":12,"kb_used_meta":746099,"kb_avail":731545248,"statfs":{"total":751619276800,"available":749102333952,"internally_reserved":0,"allocated":1752903680,"data_stored":1752294967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12358,"internal_metadata":764006330},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3065556,"kb_used_data":2020480,"kb_used_omap":7,"kb_used_meta":1045048,"kb_avail":730937644,"statfs":{"total":751619276800,"available":748480147456,"internally_reserved":0,"allocated":2068971520,"data_stored":2068366359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7790,"internal_metadata":1070129554},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,8,0,0,23,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705780,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2524208,"kb_used_data":1745436,"kb_used_omap":11,"kb_used_meta":778740,"kb_avail":731478992,"statfs":{"total":751619276800,"available":749034487808,"internally_reserved":0,"allocated":1787326464,"data_stored":1786717751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11717,"internal_metadata":797430331},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1792843776,"data_stored":1792843776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2094972928,"data_stored":2094972928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1783136256,"data_stored":1783136256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1486340096,"data_stored":1486340096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:45.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 310968 310840 69.3788 70.2734 0.0194669 0.0144093 2026-02-24T07:55:45.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:44 trial016 ceph-mon[39544]: pgmap v329: 17 pgs: 17 active+clean; 2.2 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 80 MiB/s wr, 10.23k op/s 2026-02-24T07:55:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:45.960 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:46.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 320135 320007 69.4409 71.6172 0.00498204 0.0143959 2026-02-24T07:55:46.109 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:46.135 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:45 trial016 ceph-mon[39544]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:46.238 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:46.235+0000 7fdb0d0b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:46.238 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:46.235+0000 7fdb0d0b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:46.254 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:46.255 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:46.281 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:46.281 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:46.308 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:46.308 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:46.320 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:46.320 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:47.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 127 329526 329399 69.547 73.375 0.013731 0.0143734 2026-02-24T07:55:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:46 trial016 ceph-mon[39544]: pgmap v330: 17 pgs: 17 active+clean; 2.2 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.20k op/s 2026-02-24T07:55:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/17636687' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:48.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 339060 338932 69.6766 74.4766 0.00285565 0.0143474 2026-02-24T07:55:48.366 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:48.514 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:48.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:48.647+0000 7fe00032a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:48.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:48.647+0000 7fe00032a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:48.665 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:48.665 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:48.687 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:48.687 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:48.702 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:48.702 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:48.715 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:48.716 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:48 trial016 ceph-mon[39544]: pgmap v331: 17 pgs: 17 active+clean; 2.2 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.20k op/s 2026-02-24T07:55:49.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3855522968' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:49.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 127 348570 348443 69.7951 74.3047 0.00311528 0.0143234 2026-02-24T07:55:49.568 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:49.568 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:49.568 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T07:55:49.569 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:49.719 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:49.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:49.841+0000 7f5748c75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:49.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:49.841+0000 7f5748c75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:50.001 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:50.002 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:50.049 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2026-02-24T07:55:49.812380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2763522592,"num_objects":42162,"num_object_clones":0,"num_object_copies":126486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42162,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":337407,"num_write_kb":2700326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11545284,"kb_used_data":8033844,"kb_used_omap":43,"kb_used_meta":3511316,"kb_avail":2924467516,"statfs":{"total":3006477107200,"available":2994654736384,"internally_reserved":0,"allocated":8226656256,"data_stored":8224224956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44322,"internal_metadata":3595588318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[24,9,10,1,16,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1084719104,"num_objects":16551,"num_object_clones":0,"num_object_copies":49653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132412,"num_write_kb":1059296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001561"},"pg_stats":[{"pgid":"6.f","version":"86'20592","reported_seq":20604,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.986543+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:47.986543+0000","last_peered":"2026-02-24T07:55:47.986543+0000","last_clean":"2026-02-24T07:55:47.986543+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:47.986543+0000","last_undegraded":"2026-02-24T07:55:47.986543+0000","last_fullsized":"2026-02-24T07:55:47.986543+0000","mapping_epoch":82,"log_start":"86'20573","ondisk_log_start":"86'20573","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168689664,"num_objects":2574,"num_object_clones":0,"num_object_copies":7722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20592,"num_write_kb":164736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"86'20832","reported_seq":20851,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.818261+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:47.818261+0000","last_peered":"2026-02-24T07:55:47.818261+0000","last_clean":"2026-02-24T07:55:47.818261+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:47.818261+0000","last_undegraded":"2026-02-24T07:55:47.818261+0000","last_fullsized":"2026-02-24T07:55:47.818261+0000","mapping_epoch":82,"log_start":"86'20816","ondisk_log_start":"86'20816","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170655744,"num_objects":2604,"num_object_clones":0,"num_object_copies":7812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20832,"num_write_kb":166656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"86'21920","reported_seq":21939,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.836408+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:47.836408+0000","last_peered":"2026-02-24T07:55:47.836408+0000","last_clean":"2026-02-24T07:55:47.836408+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:47.836408+0000","last_undegraded":"2026-02-24T07:55:47.836408+0000","last_fullsized":"2026-02-24T07:55:47.836408+0000","mapping_epoch":82,"log_start":"86'21912","ondisk_log_start":"86'21912","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179568640,"num_objects":2740,"num_object_clones":0,"num_object_copies":8220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21920,"num_write_kb":175360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"86'20776","reported_seq":20795,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.970199+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:47.970199+0000","last_peered":"2026-02-24T07:55:47.970199+0000","last_clean":"2026-02-24T07:55:47.970199+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:47.970199+0000","last_undegraded":"2026-02-24T07:55:47.970199+0000","last_fullsized":"2026-02-24T07:55:47.970199+0000","mapping_epoch":82,"log_start":"86'20768","ondisk_log_start":"86'20768","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196992,"num_objects":2597,"num_object_clones":0,"num_object_copies":7791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20776,"num_write_kb":166208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"86'21232","reported_seq":21251,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.976974+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:47.976974+0000","last_peered":"2026-02-24T07:55:47.976974+0000","last_clean":"2026-02-24T07:55:47.976974+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:47.976974+0000","last_undegraded":"2026-02-24T07:55:47.976974+0000","last_fullsized":"2026-02-24T07:55:47.976974+0000","mapping_epoch":82,"log_start":"86'21216","ondisk_log_start":"86'21216","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173932544,"num_objects":2654,"num_object_clones":0,"num_object_copies":7962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21232,"num_write_kb":169856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'21395","reported_seq":21411,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.838002+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:47.838002+0000","last_peered":"2026-02-24T07:55:47.838002+0000","last_clean":"2026-02-24T07:55:47.838002+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:47.838002+0000","last_undegraded":"2026-02-24T07:55:47.838002+0000","last_fullsized":"2026-02-24T07:55:47.838002+0000","mapping_epoch":82,"log_start":"86'21385","ondisk_log_start":"86'21385","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175267840,"num_objects":2675,"num_object_clones":0,"num_object_copies":8025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21395,"num_write_kb":171160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'21232","reported_seq":21251,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.906411+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:47.906411+0000","last_peered":"2026-02-24T07:55:47.906411+0000","last_clean":"2026-02-24T07:55:47.906411+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:47.906411+0000","last_undegraded":"2026-02-24T07:55:47.906411+0000","last_fullsized":"2026-02-24T07:55:47.906411+0000","mapping_epoch":82,"log_start":"86'21229","ondisk_log_start":"86'21229","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173932544,"num_objects":2654,"num_object_clones":0,"num_object_copies":7962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21232,"num_write_kb":169856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"86'20360","reported_seq":20379,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.849001+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:47.849001+0000","last_peered":"2026-02-24T07:55:47.849001+0000","last_clean":"2026-02-24T07:55:47.849001+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:47.849001+0000","last_undegraded":"2026-02-24T07:55:47.849001+0000","last_fullsized":"2026-02-24T07:55:47.849001+0000","mapping_epoch":82,"log_start":"86'20328","ondisk_log_start":"86'20328","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166789120,"num_objects":2545,"num_object_clones":0,"num_object_copies":7635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20360,"num_write_kb":162880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"86'21728","reported_seq":21747,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.961256+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:47.961256+0000","last_peered":"2026-02-24T07:55:47.961256+0000","last_clean":"2026-02-24T07:55:47.961256+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:47.961256+0000","last_undegraded":"2026-02-24T07:55:47.961256+0000","last_fullsized":"2026-02-24T07:55:47.961256+0000","mapping_epoch":82,"log_start":"86'21720","ondisk_log_start":"86'21720","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177995776,"num_objects":2716,"num_object_clones":0,"num_object_copies":8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21728,"num_write_kb":173824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"86'21264","reported_seq":21280,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.840481+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:47.840481+0000","last_peered":"2026-02-24T07:55:47.840481+0000","last_clean":"2026-02-24T07:55:47.840481+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:47.840481+0000","last_undegraded":"2026-02-24T07:55:47.840481+0000","last_fullsized":"2026-02-24T07:55:47.840481+0000","mapping_epoch":82,"log_start":"86'21260","ondisk_log_start":"86'21260","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174194688,"num_objects":2658,"num_object_clones":0,"num_object_copies":7974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21264,"num_write_kb":170112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"86'21344","reported_seq":21347,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.987098+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:47.987098+0000","last_peered":"2026-02-24T07:55:47.987098+0000","last_clean":"2026-02-24T07:55:47.987098+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:47.987098+0000","last_undegraded":"2026-02-24T07:55:47.987098+0000","last_fullsized":"2026-02-24T07:55:47.987098+0000","mapping_epoch":82,"log_start":"86'21327","ondisk_log_start":"86'21327","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174850048,"num_objects":2668,"num_object_clones":0,"num_object_copies":8004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21344,"num_write_kb":170752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"86'20584","reported_seq":20603,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.835557+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:47.835557+0000","last_peered":"2026-02-24T07:55:47.835557+0000","last_clean":"2026-02-24T07:55:47.835557+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:47.835557+0000","last_undegraded":"2026-02-24T07:55:47.835557+0000","last_fullsized":"2026-02-24T07:55:47.835557+0000","mapping_epoch":82,"log_start":"86'20568","ondisk_log_start":"86'20568","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168624128,"num_objects":2573,"num_object_clones":0,"num_object_copies":7719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20584,"num_write_kb":164672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"86'20576","reported_seq":20595,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.832048+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:47.832048+0000","last_peered":"2026-02-24T07:55:47.832048+0000","last_clean":"2026-02-24T07:55:47.832048+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:47.832048+0000","last_undegraded":"2026-02-24T07:55:47.832048+0000","last_fullsized":"2026-02-24T07:55:47.832048+0000","mapping_epoch":82,"log_start":"86'20560","ondisk_log_start":"86'20560","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168558592,"num_objects":2572,"num_object_clones":0,"num_object_copies":7716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20576,"num_write_kb":164608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"86'21112","reported_seq":21131,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.981023+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:47.981023+0000","last_peered":"2026-02-24T07:55:47.981023+0000","last_clean":"2026-02-24T07:55:47.981023+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:47.981023+0000","last_undegraded":"2026-02-24T07:55:47.981023+0000","last_fullsized":"2026-02-24T07:55:47.981023+0000","mapping_epoch":82,"log_start":"86'21104","ondisk_log_start":"86'21104","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172949504,"num_objects":2639,"num_object_clones":0,"num_object_copies":7917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21112,"num_write_kb":168896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"86'20600","reported_seq":20619,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.861435+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:47.861435+0000","last_peered":"2026-02-24T07:55:47.861435+0000","last_clean":"2026-02-24T07:55:47.861435+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:47.861435+0000","last_undegraded":"2026-02-24T07:55:47.861435+0000","last_fullsized":"2026-02-24T07:55:47.861435+0000","mapping_epoch":82,"log_start":"86'20592","ondisk_log_start":"86'20592","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168755200,"num_objects":2575,"num_object_clones":0,"num_object_copies":7725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20600,"num_write_kb":164800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'21725","reported_seq":21739,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:47.848065+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:47.848065+0000","last_peered":"2026-02-24T07:55:47.848065+0000","last_clean":"2026-02-24T07:55:47.848065+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:47.848065+0000","last_undegraded":"2026-02-24T07:55:47.848065+0000","last_fullsized":"2026-02-24T07:55:47.848065+0000","mapping_epoch":82,"log_start":"86'21716","ondisk_log_start":"86'21716","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177971200,"num_objects":2716,"num_object_clones":0,"num_object_copies":8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21725,"num_write_kb":173800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":362,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:14.853015+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:55:14.853015+0000","last_peered":"2026-02-24T07:55:14.853015+0000","last_clean":"2026-02-24T07:55:14.853015+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:14.853015+0000","last_undegraded":"2026-02-24T07:55:14.853015+0000","last_fullsized":"2026-02-24T07:55:14.853015+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2762932224,"num_objects":42160,"num_object_clones":0,"num_object_copies":126480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337272,"num_write_kb":2698176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8289583104,"data_stored":8289583104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215215,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2308216,"kb_used_data":1673572,"kb_used_omap":12,"kb_used_meta":634611,"kb_avail":731694984,"statfs":{"total":751619276800,"available":749255663616,"internally_reserved":0,"allocated":1713737728,"data_stored":1713129015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12457,"internal_metadata":649842519},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444144,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2861208,"kb_used_data":1988740,"kb_used_omap":12,"kb_used_meta":872435,"kb_avail":731141992,"statfs":{"total":751619276800,"available":748689399808,"internally_reserved":0,"allocated":2036469760,"data_stored":2035861047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12358,"internal_metadata":893374394},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3499828,"kb_used_data":2346464,"kb_used_omap":7,"kb_used_meta":1153336,"kb_avail":730503372,"statfs":{"total":751619276800,"available":748035452928,"internally_reserved":0,"allocated":2402779136,"data_stored":2402173975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7790,"internal_metadata":1181016466},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,9,10,1,16,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705781,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2876032,"kb_used_data":2025068,"kb_used_omap":11,"kb_used_meta":850932,"kb_avail":731127168,"statfs":{"total":751619276800,"available":748674220032,"internally_reserved":0,"allocated":2073669632,"data_stored":2073060919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11717,"internal_metadata":871354939},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2074943488,"data_stored":2074943488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2425503744,"data_stored":2425503744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2068619264,"data_stored":2068619264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1720516608,"data_stored":1720516608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:50.050 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:55:50.050 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 36 2026-02-24T07:55:50.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:55:50.085942+0000 min lat: 0.000575227 max lat: 0.128434 avg lat: 0.0143144 2026-02-24T07:55:50.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:55:50.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 128 357723 357595 69.8376 71.5 0.00122754 0.0143144 2026-02-24T07:55:50.201 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:50.327 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:50.324+0000 7fd225445640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:50.327 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:50.324+0000 7fd225445640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:50.478 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:55:50.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:55:50.763 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:50.918 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:51.060 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:51.056+0000 7f181679c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:51.060 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:51.056+0000 7f181679c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:51.060 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:50 trial016 ceph-mon[39544]: pgmap v332: 17 pgs: 17 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.03k op/s 2026-02-24T07:55:51.061 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:50 trial016 ceph-mon[39544]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:51.061 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1799066503' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:55:51.080 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:51.080 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:51.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 127 366818 366691 69.8673 71.0625 0.01254 0.0143096 2026-02-24T07:55:51.108 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:51.109 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:51.121 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:51.122 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:51.136 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:51.137 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:52.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 128 375956 375828 69.9033 71.3828 0.0156057 0.0143008 2026-02-24T07:55:52.217 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2862579187' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:53.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 127 384879 384752 69.8989 69.7188 0.0101349 0.0143018 2026-02-24T07:55:53.183 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:53.211 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:52 trial016 ceph-mon[39544]: pgmap v333: 17 pgs: 17 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.34k op/s 2026-02-24T07:55:53.332 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:53.470 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:53.467+0000 7f0d9409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:53.470 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:53.467+0000 7f0d9409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:53.484 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:53.484 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:53.507 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:53.508 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:53.525 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:53.525 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:53.539 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:53.539 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:54.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 393712 393584 69.8783 69 0.0200158 0.0143061 2026-02-24T07:55:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/248708824' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:55.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 128 403106 402978 69.9563 73.3906 0.00194743 0.0142904 2026-02-24T07:55:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:54 trial016 ceph-mon[39544]: pgmap v334: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.18k op/s 2026-02-24T07:55:55.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:55:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:55:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:55:55.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:55:55.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:55:55.524 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T07:55:55.525 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:55:55.592 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:55:55.683 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:55.761 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:55.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:55.872+0000 7fb4a9614640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:55.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:55.872+0000 7fb4a9614640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:55.878 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:55.876+0000 7fbfa14ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:55.879 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:55.877+0000 7fbfa14ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:55.890 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:55.890 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:55.911 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:55.911 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:55.934 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:55.934 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:55.948 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:55.948 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:56.021 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:55:56.021 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:55:56.059 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2325051119' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:55:56.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 127 411708 411581 69.8965 67.2109 0.00974375 0.0143027 2026-02-24T07:55:56.190 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2026-02-24T07:55:55.813209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3140796960,"num_objects":47918,"num_object_clones":0,"num_object_copies":143754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47918,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":383461,"num_write_kb":3068758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12983780,"kb_used_data":9147476,"kb_used_omap":43,"kb_used_meta":3836180,"kb_avail":2923029020,"statfs":{"total":3006477107200,"available":2993181716480,"internally_reserved":0,"allocated":9367015424,"data_stored":9364584124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44322,"internal_metadata":3928249054},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":754417664,"num_objects":11511,"num_object_clones":0,"num_object_copies":34533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11511,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92092,"num_write_kb":736736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001619"},"pg_stats":[{"pgid":"6.f","version":"86'23496","reported_seq":23515,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.970637+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:55:52.970637+0000","last_peered":"2026-02-24T07:55:52.970637+0000","last_clean":"2026-02-24T07:55:52.970637+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:55:52.970637+0000","last_undegraded":"2026-02-24T07:55:52.970637+0000","last_fullsized":"2026-02-24T07:55:52.970637+0000","mapping_epoch":82,"log_start":"86'23472","ondisk_log_start":"86'23472","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192479232,"num_objects":2937,"num_object_clones":0,"num_object_copies":8811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23496,"num_write_kb":187968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"86'23632","reported_seq":23651,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.831496+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:55:52.831496+0000","last_peered":"2026-02-24T07:55:52.831496+0000","last_clean":"2026-02-24T07:55:52.831496+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:55:52.831496+0000","last_undegraded":"2026-02-24T07:55:52.831496+0000","last_fullsized":"2026-02-24T07:55:52.831496+0000","mapping_epoch":82,"log_start":"86'23608","ondisk_log_start":"86'23608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193593344,"num_objects":2954,"num_object_clones":0,"num_object_copies":8862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23632,"num_write_kb":189056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"86'24752","reported_seq":24771,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.831234+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:55:52.831234+0000","last_peered":"2026-02-24T07:55:52.831234+0000","last_clean":"2026-02-24T07:55:52.831234+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:55:52.831234+0000","last_undegraded":"2026-02-24T07:55:52.831234+0000","last_fullsized":"2026-02-24T07:55:52.831234+0000","mapping_epoch":82,"log_start":"86'24744","ondisk_log_start":"86'24744","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202768384,"num_objects":3094,"num_object_clones":0,"num_object_copies":9282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24752,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"86'23520","reported_seq":23539,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.967587+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:55:52.967587+0000","last_peered":"2026-02-24T07:55:52.967587+0000","last_clean":"2026-02-24T07:55:52.967587+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:55:52.967587+0000","last_undegraded":"2026-02-24T07:55:52.967587+0000","last_fullsized":"2026-02-24T07:55:52.967587+0000","mapping_epoch":82,"log_start":"86'23504","ondisk_log_start":"86'23504","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192675840,"num_objects":2940,"num_object_clones":0,"num_object_copies":8820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23520,"num_write_kb":188160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"86'24328","reported_seq":24347,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.970009+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:55:52.970009+0000","last_peered":"2026-02-24T07:55:52.970009+0000","last_clean":"2026-02-24T07:55:52.970009+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:55:52.970009+0000","last_undegraded":"2026-02-24T07:55:52.970009+0000","last_fullsized":"2026-02-24T07:55:52.970009+0000","mapping_epoch":82,"log_start":"86'24312","ondisk_log_start":"86'24312","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199294976,"num_objects":3041,"num_object_clones":0,"num_object_copies":9123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":194624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'23960","reported_seq":23979,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.786430+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:55:52.786430+0000","last_peered":"2026-02-24T07:55:52.786430+0000","last_clean":"2026-02-24T07:55:52.786430+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:55:52.786430+0000","last_undegraded":"2026-02-24T07:55:52.786430+0000","last_fullsized":"2026-02-24T07:55:52.786430+0000","mapping_epoch":82,"log_start":"86'23952","ondisk_log_start":"86'23952","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196280320,"num_objects":2995,"num_object_clones":0,"num_object_copies":8985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23960,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'24464","reported_seq":24483,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.892872+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:55:52.892872+0000","last_peered":"2026-02-24T07:55:52.892872+0000","last_clean":"2026-02-24T07:55:52.892872+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:55:52.892872+0000","last_undegraded":"2026-02-24T07:55:52.892872+0000","last_fullsized":"2026-02-24T07:55:52.892872+0000","mapping_epoch":82,"log_start":"86'24456","ondisk_log_start":"86'24456","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200409088,"num_objects":3058,"num_object_clones":0,"num_object_copies":9174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3058,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24464,"num_write_kb":195712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"86'23136","reported_seq":23155,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.819138+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:55:52.819138+0000","last_peered":"2026-02-24T07:55:52.819138+0000","last_clean":"2026-02-24T07:55:52.819138+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:55:52.819138+0000","last_undegraded":"2026-02-24T07:55:52.819138+0000","last_fullsized":"2026-02-24T07:55:52.819138+0000","mapping_epoch":82,"log_start":"86'23120","ondisk_log_start":"86'23120","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189530112,"num_objects":2892,"num_object_clones":0,"num_object_copies":8676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23136,"num_write_kb":185088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"86'24424","reported_seq":24443,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.963132+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:55:52.963132+0000","last_peered":"2026-02-24T07:55:52.963132+0000","last_clean":"2026-02-24T07:55:52.963132+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:55:52.963132+0000","last_undegraded":"2026-02-24T07:55:52.963132+0000","last_fullsized":"2026-02-24T07:55:52.963132+0000","mapping_epoch":82,"log_start":"86'24409","ondisk_log_start":"86'24409","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200081408,"num_objects":3053,"num_object_clones":0,"num_object_copies":9159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24424,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"86'24136","reported_seq":24155,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.839451+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:55:52.839451+0000","last_peered":"2026-02-24T07:55:52.839451+0000","last_clean":"2026-02-24T07:55:52.839451+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:55:52.839451+0000","last_undegraded":"2026-02-24T07:55:52.839451+0000","last_fullsized":"2026-02-24T07:55:52.839451+0000","mapping_epoch":82,"log_start":"86'24128","ondisk_log_start":"86'24128","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197722112,"num_objects":3017,"num_object_clones":0,"num_object_copies":9051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24136,"num_write_kb":193088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"86'24240","reported_seq":24251,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.975758+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:55:52.975758+0000","last_peered":"2026-02-24T07:55:52.975758+0000","last_clean":"2026-02-24T07:55:52.975758+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:55:52.975758+0000","last_undegraded":"2026-02-24T07:55:52.975758+0000","last_fullsized":"2026-02-24T07:55:52.975758+0000","mapping_epoch":82,"log_start":"86'24224","ondisk_log_start":"86'24224","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198574080,"num_objects":3030,"num_object_clones":0,"num_object_copies":9090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3030,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24240,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"86'23864","reported_seq":23883,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.830740+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:55:52.830740+0000","last_peered":"2026-02-24T07:55:52.830740+0000","last_clean":"2026-02-24T07:55:52.830740+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:55:52.830740+0000","last_undegraded":"2026-02-24T07:55:52.830740+0000","last_fullsized":"2026-02-24T07:55:52.830740+0000","mapping_epoch":82,"log_start":"86'23848","ondisk_log_start":"86'23848","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195493888,"num_objects":2983,"num_object_clones":0,"num_object_copies":8949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23864,"num_write_kb":190912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"86'23408","reported_seq":23427,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.821212+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:55:52.821212+0000","last_peered":"2026-02-24T07:55:52.821212+0000","last_clean":"2026-02-24T07:55:52.821212+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:55:52.821212+0000","last_undegraded":"2026-02-24T07:55:52.821212+0000","last_fullsized":"2026-02-24T07:55:52.821212+0000","mapping_epoch":82,"log_start":"86'23400","ondisk_log_start":"86'23400","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191758336,"num_objects":2926,"num_object_clones":0,"num_object_copies":8778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23408,"num_write_kb":187264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"86'24206","reported_seq":24223,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.990239+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:55:52.990239+0000","last_peered":"2026-02-24T07:55:52.990239+0000","last_clean":"2026-02-24T07:55:52.990239+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:52.990239+0000","last_undegraded":"2026-02-24T07:55:52.990239+0000","last_fullsized":"2026-02-24T07:55:52.990239+0000","mapping_epoch":82,"log_start":"86'24203","ondisk_log_start":"86'24203","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198295552,"num_objects":3026,"num_object_clones":0,"num_object_copies":9078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":193648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"86'23200","reported_seq":23219,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.903567+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:55:52.903567+0000","last_peered":"2026-02-24T07:55:52.903567+0000","last_clean":"2026-02-24T07:55:52.903567+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:55:52.903567+0000","last_undegraded":"2026-02-24T07:55:52.903567+0000","last_fullsized":"2026-02-24T07:55:52.903567+0000","mapping_epoch":82,"log_start":"86'23197","ondisk_log_start":"86'23197","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190054400,"num_objects":2900,"num_object_clones":0,"num_object_copies":8700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2900,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23200,"num_write_kb":185600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'24560","reported_seq":24579,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:52.851423+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:55:52.851423+0000","last_peered":"2026-02-24T07:55:52.851423+0000","last_clean":"2026-02-24T07:55:52.851423+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:55:52.851423+0000","last_undegraded":"2026-02-24T07:55:52.851423+0000","last_fullsized":"2026-02-24T07:55:52.851423+0000","mapping_epoch":82,"log_start":"86'24552","ondisk_log_start":"86'24552","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201195520,"num_objects":3070,"num_object_clones":0,"num_object_copies":9210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24560,"num_write_kb":196480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":362,"reported_epoch":86,"state":"active+clean","last_fresh":"2026-02-24T07:55:14.853015+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:55:14.853015+0000","last_peered":"2026-02-24T07:55:14.853015+0000","last_clean":"2026-02-24T07:55:14.853015+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:55:14.853015+0000","last_undegraded":"2026-02-24T07:55:14.853015+0000","last_fullsized":"2026-02-24T07:55:14.853015+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":3140206592,"num_objects":47916,"num_object_clones":0,"num_object_copies":143748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383326,"num_write_kb":3066608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9420136448,"data_stored":9420136448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215216,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2615712,"kb_used_data":1908876,"kb_used_omap":12,"kb_used_meta":706803,"kb_avail":731387488,"statfs":{"total":751619276800,"available":748940787712,"internally_reserved":0,"allocated":1954689024,"data_stored":1954080311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12457,"internal_metadata":723767127},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444145,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3211272,"kb_used_data":2266612,"kb_used_omap":12,"kb_used_meta":944627,"kb_avail":730791928,"statfs":{"total":751619276800,"available":748330934272,"internally_reserved":0,"allocated":2321010688,"data_stored":2320401975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12358,"internal_metadata":967299002},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3917428,"kb_used_data":2673824,"kb_used_omap":7,"kb_used_meta":1243576,"kb_avail":730085772,"statfs":{"total":751619276800,"available":747607830528,"internally_reserved":0,"allocated":2737995776,"data_stored":2737390615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7790,"internal_metadata":1273422226},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3239368,"kb_used_data":2298164,"kb_used_omap":11,"kb_used_meta":941172,"kb_avail":730763832,"statfs":{"total":751619276800,"available":748302163968,"internally_reserved":0,"allocated":2353319936,"data_stored":2352711223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11717,"internal_metadata":963760699},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2352807936,"data_stored":2352807936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2755158016,"data_stored":2755158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2348859392,"data_stored":2348859392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1963311104,"data_stored":1963311104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:55:56.191 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:55:56.191 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 46 2026-02-24T07:55:56.381 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:56.872 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:56.825+0000 7f7426746640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:56.872 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:56.825+0000 7f7426746640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:56.967 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:55:57.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:56 trial016 ceph-mon[39544]: pgmap v335: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.67k op/s 2026-02-24T07:55:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:55:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:55:57.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:56 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:55:57.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 128 418948 418820 69.6125 56.5547 0.01009 0.0143614 2026-02-24T07:55:57.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:55:58.062 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:55:58.087 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 427311 427183 69.5233 65.3359 0.0203931 0.0143797 2026-02-24T07:55:58.209 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:55:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='client.15190 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:55:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1378283397' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T07:55:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:55:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:55:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:55:58.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:55:58.643 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:58.622+0000 7fdb4f35c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:58.644 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:55:58.622+0000 7fdb4f35c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:55:58.644 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:55:58.644 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:55:58.672 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:55:58.673 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:55:58.687 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:55:58.688 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:55:58.702 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:55:58.702 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:55:59.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 128 434335 434207 69.2243 54.875 0.0541469 0.0144418 2026-02-24T07:55:59.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:58 trial016 ceph-mon[39544]: pgmap v336: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.67k op/s 2026-02-24T07:55:59.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:55:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3769948296' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:00.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 127 443028 442901 69.1976 67.9219 0.0126601 0.014448 2026-02-24T07:56:01.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 452007 451879 69.216 70.1406 0.0195747 0.0144439 2026-02-24T07:56:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:00 trial016 ceph-mon[39544]: pgmap v337: 17 pgs: 17 active+clean; 3.2 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.20k op/s 2026-02-24T07:56:01.422 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:01.571 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:01.690 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:01.687+0000 7f3c6a232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:01.691 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:01.687+0000 7f3c6a232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:01.704 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:01.705 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:01.730 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:01.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:01.745 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:01.745 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:01.759 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:01.759 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:02.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 460771 460643 69.2015 68.4688 0.0207093 0.0144464 2026-02-24T07:56:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1843707860' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:02.602 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:02.603 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:56:02.743 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:02.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:02.865+0000 7fd6e6e2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:02.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:02.865+0000 7fd6e6e2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:03.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 128 469863 469735 69.236 71.0312 0.00476467 0.0144408 2026-02-24T07:56:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:03 trial016 ceph-mon[39544]: pgmap v338: 17 pgs: 17 active+clean; 3.2 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.36k op/s 2026-02-24T07:56:03.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:03 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:56:03.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:03 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:56:03.808 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:03.955 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:04.004 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:56:04.056 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:56:04.081 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:04.078+0000 7f437e718640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:04.081 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:04.078+0000 7f437e718640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:04.084 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/861560349' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:56:04.084 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:04 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:56:04.084 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:04 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:56:04.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 128 479041 478913 69.2815 71.7031 0.0050066 0.0144297 2026-02-24T07:56:04.098 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:04.098 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:04.126 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:04.126 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:04.140 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:04.141 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:04.155 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:04.155 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:04.259 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:04.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:04.921+0000 7fe024800640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:04.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:04.921+0000 7fe024800640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:05.088 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 127 485837 485710 68.9873 53.1016 0.00336008 0.0144925 2026-02-24T07:56:05.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:05 trial016 ceph-mon[39544]: pgmap v339: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.90k op/s 2026-02-24T07:56:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/861560349' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:56:05.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:05 trial016 ceph-mon[39544]: osdmap e87: 4 total, 4 up, 4 in 2026-02-24T07:56:05.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/913958845' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:05.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:05 trial016 ceph-mon[39544]: osdmap e88: 4 total, 4 up, 4 in 2026-02-24T07:56:06.007 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:56:06.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 494854 494726 69.0131 70.4375 0.0141696 0.0144873 2026-02-24T07:56:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3289290951' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:56:06.355 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:56:06.509 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:06.575 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:06.647 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:06.643+0000 7f1b6ea6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:06.647 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:06.644+0000 7f1b6ea6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:06.725 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:06.853 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:06.851+0000 7f2530fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:06.853 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:06.851+0000 7f2530fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:06.869 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:06.870 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:06.893 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:06.894 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:06.906 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:06.907 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:06.922 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:06.922 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:07.008 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:56:07.057 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:56:07.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 127 503780 503653 69.0258 69.7422 0.0202046 0.014484 2026-02-24T07:56:07.114 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:07 trial016 ceph-mon[39544]: pgmap v342: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 83 MiB/s wr, 10.60k op/s 2026-02-24T07:56:07.114 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3289290951' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:56:07.114 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:07 trial016 ceph-mon[39544]: osdmap e89: 4 total, 4 up, 4 in 2026-02-24T07:56:07.114 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1250988896' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:56:07.114 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3552649500' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:07.234 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:07.366 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:07.364+0000 7f9cea940640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:07.367 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:07.364+0000 7f9cea940640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:08.013 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:56:08.061 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:56:08.061 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:08.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 512983 512856 69.0752 71.8984 0.0243546 0.0144726 2026-02-24T07:56:08.234 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:08.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1250988896' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:56:08.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:08 trial016 ceph-mon[39544]: osdmap e90: 4 total, 4 up, 4 in 2026-02-24T07:56:08.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/839269196' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:56:08.364 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:08.361+0000 7f6a318d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:08.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:08.362+0000 7f6a318d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:08.510 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:08.511 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:08.563 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2026-02-24T07:56:08.011548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4189356576,"num_objects":63920,"num_object_clones":0,"num_object_copies":191760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63920,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":511459,"num_write_kb":4092742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16977840,"kb_used_data":12184992,"kb_used_omap":54,"kb_used_meta":4792713,"kb_avail":2919034960,"statfs":{"total":3006477107200,"available":2989091799040,"internally_reserved":0,"allocated":12477431808,"data_stored":12474882291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55400,"internal_metadata":4907739032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6,7,22,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":353648640,"num_objects":5396,"num_object_clones":0,"num_object_copies":16188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43170,"num_write_kb":345360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008630"},"pg_stats":[{"pgid":"6.f","version":"90'32032","reported_seq":32051,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.989735+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:56:07.989735+0000","last_peered":"2026-02-24T07:56:07.989735+0000","last_clean":"2026-02-24T07:56:07.989735+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:07.989735+0000","last_undegraded":"2026-02-24T07:56:07.989735+0000","last_fullsized":"2026-02-24T07:56:07.989735+0000","mapping_epoch":82,"log_start":"90'32020","ondisk_log_start":"90'32020","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262406144,"num_objects":4004,"num_object_clones":0,"num_object_copies":12012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32032,"num_write_kb":256256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"90'31332","reported_seq":31354,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.837668+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:56:07.837668+0000","last_peered":"2026-02-24T07:56:07.837668+0000","last_clean":"2026-02-24T07:56:07.837668+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:07.837668+0000","last_undegraded":"2026-02-24T07:56:07.837668+0000","last_fullsized":"2026-02-24T07:56:07.837668+0000","mapping_epoch":82,"log_start":"90'31320","ondisk_log_start":"90'31320","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256671744,"num_objects":3917,"num_object_clones":0,"num_object_copies":11751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31332,"num_write_kb":250656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"90'32520","reported_seq":32547,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.835938+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:07.835938+0000","last_peered":"2026-02-24T07:56:07.835938+0000","last_clean":"2026-02-24T07:56:07.835938+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:07.835938+0000","last_undegraded":"2026-02-24T07:56:07.835938+0000","last_fullsized":"2026-02-24T07:56:07.835938+0000","mapping_epoch":82,"log_start":"90'32504","ondisk_log_start":"90'32504","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266403840,"num_objects":4065,"num_object_clones":0,"num_object_copies":12195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32520,"num_write_kb":260160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"90'31616","reported_seq":31639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.987243+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:07.987243+0000","last_peered":"2026-02-24T07:56:07.987243+0000","last_clean":"2026-02-24T07:56:07.987243+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:07.987243+0000","last_undegraded":"2026-02-24T07:56:07.987243+0000","last_fullsized":"2026-02-24T07:56:07.987243+0000","mapping_epoch":82,"log_start":"90'31608","ondisk_log_start":"90'31608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":3952,"num_object_clones":0,"num_object_copies":11856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31616,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"90'32185","reported_seq":32211,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.990866+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:56:07.990866+0000","last_peered":"2026-02-24T07:56:07.990866+0000","last_clean":"2026-02-24T07:56:07.990866+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:07.990866+0000","last_undegraded":"2026-02-24T07:56:07.990866+0000","last_fullsized":"2026-02-24T07:56:07.990866+0000","mapping_epoch":82,"log_start":"90'32177","ondisk_log_start":"90'32177","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263659520,"num_objects":4024,"num_object_clones":0,"num_object_copies":12072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32185,"num_write_kb":257480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"90'32264","reported_seq":32291,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.836621+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:07.836621+0000","last_peered":"2026-02-24T07:56:07.836621+0000","last_clean":"2026-02-24T07:56:07.836621+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:07.836621+0000","last_undegraded":"2026-02-24T07:56:07.836621+0000","last_fullsized":"2026-02-24T07:56:07.836621+0000","mapping_epoch":82,"log_start":"90'32256","ondisk_log_start":"90'32256","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264306688,"num_objects":4033,"num_object_clones":0,"num_object_copies":12099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32264,"num_write_kb":258112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'32208","reported_seq":32235,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.909760+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:56:07.909760+0000","last_peered":"2026-02-24T07:56:07.909760+0000","last_clean":"2026-02-24T07:56:07.909760+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:07.909760+0000","last_undegraded":"2026-02-24T07:56:07.909760+0000","last_fullsized":"2026-02-24T07:56:07.909760+0000","mapping_epoch":82,"log_start":"90'32200","ondisk_log_start":"90'32200","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263847936,"num_objects":4026,"num_object_clones":0,"num_object_copies":12078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32208,"num_write_kb":257664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"90'31240","reported_seq":31267,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.841875+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:07.841875+0000","last_peered":"2026-02-24T07:56:07.841875+0000","last_clean":"2026-02-24T07:56:07.841875+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:07.841875+0000","last_undegraded":"2026-02-24T07:56:07.841875+0000","last_fullsized":"2026-02-24T07:56:07.841875+0000","mapping_epoch":82,"log_start":"90'31232","ondisk_log_start":"90'31232","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255918080,"num_objects":3905,"num_object_clones":0,"num_object_copies":11715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31240,"num_write_kb":249920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"90'32424","reported_seq":32451,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.976822+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:56:07.976822+0000","last_peered":"2026-02-24T07:56:07.976822+0000","last_clean":"2026-02-24T07:56:07.976822+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:07.976822+0000","last_undegraded":"2026-02-24T07:56:07.976822+0000","last_fullsized":"2026-02-24T07:56:07.976822+0000","mapping_epoch":82,"log_start":"90'32416","ondisk_log_start":"90'32416","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265617408,"num_objects":4053,"num_object_clones":0,"num_object_copies":12159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32424,"num_write_kb":259392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"90'32008","reported_seq":32031,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844580+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:07.844580+0000","last_peered":"2026-02-24T07:56:07.844580+0000","last_clean":"2026-02-24T07:56:07.844580+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:07.844580+0000","last_undegraded":"2026-02-24T07:56:07.844580+0000","last_fullsized":"2026-02-24T07:56:07.844580+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209536,"num_objects":4001,"num_object_clones":0,"num_object_copies":12003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32008,"num_write_kb":256064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"90'32341","reported_seq":32355,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.986866+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:07.986866+0000","last_peered":"2026-02-24T07:56:07.986866+0000","last_clean":"2026-02-24T07:56:07.986866+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:07.986866+0000","last_undegraded":"2026-02-24T07:56:07.986866+0000","last_fullsized":"2026-02-24T07:56:07.986866+0000","mapping_epoch":82,"log_start":"90'32322","ondisk_log_start":"90'32322","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264937472,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32341,"num_write_kb":258728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"90'32416","reported_seq":32443,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.834393+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:07.834393+0000","last_peered":"2026-02-24T07:56:07.834393+0000","last_clean":"2026-02-24T07:56:07.834393+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:07.834393+0000","last_undegraded":"2026-02-24T07:56:07.834393+0000","last_fullsized":"2026-02-24T07:56:07.834393+0000","mapping_epoch":82,"log_start":"90'32408","ondisk_log_start":"90'32408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265551872,"num_objects":4052,"num_object_clones":0,"num_object_copies":12156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32416,"num_write_kb":259328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"90'30864","reported_seq":30891,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844220+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:56:07.844220+0000","last_peered":"2026-02-24T07:56:07.844220+0000","last_clean":"2026-02-24T07:56:07.844220+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:07.844220+0000","last_undegraded":"2026-02-24T07:56:07.844220+0000","last_fullsized":"2026-02-24T07:56:07.844220+0000","mapping_epoch":82,"log_start":"90'30857","ondisk_log_start":"90'30857","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"90'32016","reported_seq":32035,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.991102+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:07.991102+0000","last_peered":"2026-02-24T07:56:07.991102+0000","last_clean":"2026-02-24T07:56:07.991102+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.991102+0000","last_undegraded":"2026-02-24T07:56:07.991102+0000","last_fullsized":"2026-02-24T07:56:07.991102+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262275072,"num_objects":4002,"num_object_clones":0,"num_object_copies":12006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32016,"num_write_kb":256128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"90'31354","reported_seq":31377,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.916507+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:07.916507+0000","last_peered":"2026-02-24T07:56:07.916507+0000","last_clean":"2026-02-24T07:56:07.916507+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.916507+0000","last_undegraded":"2026-02-24T07:56:07.916507+0000","last_fullsized":"2026-02-24T07:56:07.916507+0000","mapping_epoch":82,"log_start":"90'31344","ondisk_log_start":"90'31344","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256851968,"num_objects":3920,"num_object_clones":0,"num_object_copies":11760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31354,"num_write_kb":250832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"90'32504","reported_seq":32523,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.842422+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:07.842422+0000","last_peered":"2026-02-24T07:56:07.842422+0000","last_clean":"2026-02-24T07:56:07.842422+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:07.842422+0000","last_undegraded":"2026-02-24T07:56:07.842422+0000","last_fullsized":"2026-02-24T07:56:07.842422+0000","mapping_epoch":82,"log_start":"90'32495","ondisk_log_start":"90'32495","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266272768,"num_objects":4063,"num_object_clones":0,"num_object_copies":12189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32504,"num_write_kb":260032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":370,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.013759+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:56:07.013759+0000","last_peered":"2026-02-24T07:56:07.013759+0000","last_clean":"2026-02-24T07:56:07.013759+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:07.013759+0000","last_undegraded":"2026-02-24T07:56:07.013759+0000","last_fullsized":"2026-02-24T07:56:07.013759+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":4188766208,"num_objects":63918,"num_object_clones":0,"num_object_copies":191754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511324,"num_write_kb":4090592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12567126016,"data_stored":12567126016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215219,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3399724,"kb_used_data":2512408,"kb_used_omap":14,"kb_used_meta":887281,"kb_avail":730603476,"statfs":{"total":751619276800,"available":748137959424,"internally_reserved":0,"allocated":2572705792,"data_stored":2572073434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14407,"internal_metadata":908576697},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4236280,"kb_used_data":3038948,"kb_used_omap":14,"kb_used_meta":1197297,"kb_avail":729766920,"statfs":{"total":751619276800,"available":747281326080,"internally_reserved":0,"allocated":3111882752,"data_stored":3111242515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14966,"internal_metadata":1226032522},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5112868,"kb_used_data":3580496,"kb_used_omap":10,"kb_used_meta":1532341,"kb_avail":728890332,"statfs":{"total":751619276800,"available":746383699968,"internally_reserved":0,"allocated":3666427904,"data_stored":3665791219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11050,"internal_metadata":1569117398},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,6,7,17,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4228968,"kb_used_data":3053140,"kb_used_omap":14,"kb_used_meta":1175793,"kb_avail":729774232,"statfs":{"total":751619276800,"available":747288813568,"internally_reserved":0,"allocated":3126415360,"data_stored":3125775123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14977,"internal_metadata":1204012415},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3131842560,"data_stored":3131842560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3678994432,"data_stored":3678994432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3137994752,"data_stored":3137994752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2618294272,"data_stored":2618294272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:08.565 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:08.716 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:08.843 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:08.841+0000 7fa33a245640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:08.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:08.841+0000 7fa33a245640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:08.973 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:08.999 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:08.999 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:09.031 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:09 trial016 ceph-mon[39544]: pgmap v345: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:56:09.031 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/839269196' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:56:09.031 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:09 trial016 ceph-mon[39544]: osdmap e91: 4 total, 4 up, 4 in 2026-02-24T07:56:09.031 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:09 trial016 ceph-mon[39544]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:09.032 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:09 trial016 ceph-mon[39544]: from='client.15212 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:09.055 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2026-02-24T07:56:08.011548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4189356576,"num_objects":63920,"num_object_clones":0,"num_object_copies":191760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63920,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":511459,"num_write_kb":4092742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16977840,"kb_used_data":12184992,"kb_used_omap":54,"kb_used_meta":4792713,"kb_avail":2919034960,"statfs":{"total":3006477107200,"available":2989091799040,"internally_reserved":0,"allocated":12477431808,"data_stored":12474882291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55400,"internal_metadata":4907739032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6,7,22,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":353648640,"num_objects":5396,"num_object_clones":0,"num_object_copies":16188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43170,"num_write_kb":345360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008630"},"pg_stats":[{"pgid":"6.f","version":"90'32032","reported_seq":32051,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.989735+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:56:07.989735+0000","last_peered":"2026-02-24T07:56:07.989735+0000","last_clean":"2026-02-24T07:56:07.989735+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:07.989735+0000","last_undegraded":"2026-02-24T07:56:07.989735+0000","last_fullsized":"2026-02-24T07:56:07.989735+0000","mapping_epoch":82,"log_start":"90'32020","ondisk_log_start":"90'32020","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262406144,"num_objects":4004,"num_object_clones":0,"num_object_copies":12012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32032,"num_write_kb":256256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"90'31332","reported_seq":31354,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.837668+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:56:07.837668+0000","last_peered":"2026-02-24T07:56:07.837668+0000","last_clean":"2026-02-24T07:56:07.837668+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:07.837668+0000","last_undegraded":"2026-02-24T07:56:07.837668+0000","last_fullsized":"2026-02-24T07:56:07.837668+0000","mapping_epoch":82,"log_start":"90'31320","ondisk_log_start":"90'31320","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256671744,"num_objects":3917,"num_object_clones":0,"num_object_copies":11751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31332,"num_write_kb":250656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"90'32520","reported_seq":32547,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.835938+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:07.835938+0000","last_peered":"2026-02-24T07:56:07.835938+0000","last_clean":"2026-02-24T07:56:07.835938+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:07.835938+0000","last_undegraded":"2026-02-24T07:56:07.835938+0000","last_fullsized":"2026-02-24T07:56:07.835938+0000","mapping_epoch":82,"log_start":"90'32504","ondisk_log_start":"90'32504","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266403840,"num_objects":4065,"num_object_clones":0,"num_object_copies":12195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32520,"num_write_kb":260160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"90'31616","reported_seq":31639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.987243+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:07.987243+0000","last_peered":"2026-02-24T07:56:07.987243+0000","last_clean":"2026-02-24T07:56:07.987243+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:07.987243+0000","last_undegraded":"2026-02-24T07:56:07.987243+0000","last_fullsized":"2026-02-24T07:56:07.987243+0000","mapping_epoch":82,"log_start":"90'31608","ondisk_log_start":"90'31608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":3952,"num_object_clones":0,"num_object_copies":11856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31616,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"90'32185","reported_seq":32211,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.990866+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:56:07.990866+0000","last_peered":"2026-02-24T07:56:07.990866+0000","last_clean":"2026-02-24T07:56:07.990866+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:07.990866+0000","last_undegraded":"2026-02-24T07:56:07.990866+0000","last_fullsized":"2026-02-24T07:56:07.990866+0000","mapping_epoch":82,"log_start":"90'32177","ondisk_log_start":"90'32177","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263659520,"num_objects":4024,"num_object_clones":0,"num_object_copies":12072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32185,"num_write_kb":257480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"90'32264","reported_seq":32291,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.836621+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:07.836621+0000","last_peered":"2026-02-24T07:56:07.836621+0000","last_clean":"2026-02-24T07:56:07.836621+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:07.836621+0000","last_undegraded":"2026-02-24T07:56:07.836621+0000","last_fullsized":"2026-02-24T07:56:07.836621+0000","mapping_epoch":82,"log_start":"90'32256","ondisk_log_start":"90'32256","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264306688,"num_objects":4033,"num_object_clones":0,"num_object_copies":12099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32264,"num_write_kb":258112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'32208","reported_seq":32235,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.909760+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:56:07.909760+0000","last_peered":"2026-02-24T07:56:07.909760+0000","last_clean":"2026-02-24T07:56:07.909760+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:07.909760+0000","last_undegraded":"2026-02-24T07:56:07.909760+0000","last_fullsized":"2026-02-24T07:56:07.909760+0000","mapping_epoch":82,"log_start":"90'32200","ondisk_log_start":"90'32200","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263847936,"num_objects":4026,"num_object_clones":0,"num_object_copies":12078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32208,"num_write_kb":257664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"90'31240","reported_seq":31267,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.841875+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:07.841875+0000","last_peered":"2026-02-24T07:56:07.841875+0000","last_clean":"2026-02-24T07:56:07.841875+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:07.841875+0000","last_undegraded":"2026-02-24T07:56:07.841875+0000","last_fullsized":"2026-02-24T07:56:07.841875+0000","mapping_epoch":82,"log_start":"90'31232","ondisk_log_start":"90'31232","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255918080,"num_objects":3905,"num_object_clones":0,"num_object_copies":11715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31240,"num_write_kb":249920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"90'32424","reported_seq":32451,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.976822+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:56:07.976822+0000","last_peered":"2026-02-24T07:56:07.976822+0000","last_clean":"2026-02-24T07:56:07.976822+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:07.976822+0000","last_undegraded":"2026-02-24T07:56:07.976822+0000","last_fullsized":"2026-02-24T07:56:07.976822+0000","mapping_epoch":82,"log_start":"90'32416","ondisk_log_start":"90'32416","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265617408,"num_objects":4053,"num_object_clones":0,"num_object_copies":12159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32424,"num_write_kb":259392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"90'32008","reported_seq":32031,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844580+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:07.844580+0000","last_peered":"2026-02-24T07:56:07.844580+0000","last_clean":"2026-02-24T07:56:07.844580+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:07.844580+0000","last_undegraded":"2026-02-24T07:56:07.844580+0000","last_fullsized":"2026-02-24T07:56:07.844580+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209536,"num_objects":4001,"num_object_clones":0,"num_object_copies":12003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32008,"num_write_kb":256064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"90'32341","reported_seq":32355,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.986866+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:07.986866+0000","last_peered":"2026-02-24T07:56:07.986866+0000","last_clean":"2026-02-24T07:56:07.986866+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:07.986866+0000","last_undegraded":"2026-02-24T07:56:07.986866+0000","last_fullsized":"2026-02-24T07:56:07.986866+0000","mapping_epoch":82,"log_start":"90'32322","ondisk_log_start":"90'32322","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264937472,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32341,"num_write_kb":258728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"90'32416","reported_seq":32443,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.834393+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:07.834393+0000","last_peered":"2026-02-24T07:56:07.834393+0000","last_clean":"2026-02-24T07:56:07.834393+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:07.834393+0000","last_undegraded":"2026-02-24T07:56:07.834393+0000","last_fullsized":"2026-02-24T07:56:07.834393+0000","mapping_epoch":82,"log_start":"90'32408","ondisk_log_start":"90'32408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265551872,"num_objects":4052,"num_object_clones":0,"num_object_copies":12156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32416,"num_write_kb":259328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"90'30864","reported_seq":30891,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844220+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:56:07.844220+0000","last_peered":"2026-02-24T07:56:07.844220+0000","last_clean":"2026-02-24T07:56:07.844220+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:07.844220+0000","last_undegraded":"2026-02-24T07:56:07.844220+0000","last_fullsized":"2026-02-24T07:56:07.844220+0000","mapping_epoch":82,"log_start":"90'30857","ondisk_log_start":"90'30857","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"90'32016","reported_seq":32035,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.991102+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:07.991102+0000","last_peered":"2026-02-24T07:56:07.991102+0000","last_clean":"2026-02-24T07:56:07.991102+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.991102+0000","last_undegraded":"2026-02-24T07:56:07.991102+0000","last_fullsized":"2026-02-24T07:56:07.991102+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262275072,"num_objects":4002,"num_object_clones":0,"num_object_copies":12006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32016,"num_write_kb":256128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"90'31354","reported_seq":31377,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.916507+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:07.916507+0000","last_peered":"2026-02-24T07:56:07.916507+0000","last_clean":"2026-02-24T07:56:07.916507+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.916507+0000","last_undegraded":"2026-02-24T07:56:07.916507+0000","last_fullsized":"2026-02-24T07:56:07.916507+0000","mapping_epoch":82,"log_start":"90'31344","ondisk_log_start":"90'31344","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256851968,"num_objects":3920,"num_object_clones":0,"num_object_copies":11760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31354,"num_write_kb":250832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"90'32504","reported_seq":32523,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.842422+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:07.842422+0000","last_peered":"2026-02-24T07:56:07.842422+0000","last_clean":"2026-02-24T07:56:07.842422+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:07.842422+0000","last_undegraded":"2026-02-24T07:56:07.842422+0000","last_fullsized":"2026-02-24T07:56:07.842422+0000","mapping_epoch":82,"log_start":"90'32495","ondisk_log_start":"90'32495","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266272768,"num_objects":4063,"num_object_clones":0,"num_object_copies":12189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32504,"num_write_kb":260032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":370,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.013759+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:56:07.013759+0000","last_peered":"2026-02-24T07:56:07.013759+0000","last_clean":"2026-02-24T07:56:07.013759+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:07.013759+0000","last_undegraded":"2026-02-24T07:56:07.013759+0000","last_fullsized":"2026-02-24T07:56:07.013759+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":4188766208,"num_objects":63918,"num_object_clones":0,"num_object_copies":191754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511324,"num_write_kb":4090592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12567126016,"data_stored":12567126016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215219,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3399724,"kb_used_data":2512408,"kb_used_omap":14,"kb_used_meta":887281,"kb_avail":730603476,"statfs":{"total":751619276800,"available":748137959424,"internally_reserved":0,"allocated":2572705792,"data_stored":2572073434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14407,"internal_metadata":908576697},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4236280,"kb_used_data":3038948,"kb_used_omap":14,"kb_used_meta":1197297,"kb_avail":729766920,"statfs":{"total":751619276800,"available":747281326080,"internally_reserved":0,"allocated":3111882752,"data_stored":3111242515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14966,"internal_metadata":1226032522},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5112868,"kb_used_data":3580496,"kb_used_omap":10,"kb_used_meta":1532341,"kb_avail":728890332,"statfs":{"total":751619276800,"available":746383699968,"internally_reserved":0,"allocated":3666427904,"data_stored":3665791219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11050,"internal_metadata":1569117398},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,6,7,17,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4228968,"kb_used_data":3053140,"kb_used_omap":14,"kb_used_meta":1175793,"kb_avail":729774232,"statfs":{"total":751619276800,"available":747288813568,"internally_reserved":0,"allocated":3126415360,"data_stored":3125775123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14977,"internal_metadata":1204012415},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3131842560,"data_stored":3131842560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3678994432,"data_stored":3678994432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3137994752,"data_stored":3137994752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2618294272,"data_stored":2618294272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:09.057 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:56:09.058 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:09.058 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T07:56:09.058 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:09.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 127 522105 521978 69.1123 71.2656 0.0269974 0.0144653 2026-02-24T07:56:09.128 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:09.240 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:09.260 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.258+0000 7f7787161640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:09.261 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.259+0000 7f7787161640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:09.281 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:09.281 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:09.310 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:09.310 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:09.325 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:09.325 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:09.341 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:09.341 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:09.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.370+0000 7fc430381640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:09.373 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.370+0000 7fc430381640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:09.533 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:09.534 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:09.585 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2026-02-24T07:56:08.011548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4189356576,"num_objects":63920,"num_object_clones":0,"num_object_copies":191760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63920,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":511459,"num_write_kb":4092742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16977840,"kb_used_data":12184992,"kb_used_omap":54,"kb_used_meta":4792713,"kb_avail":2919034960,"statfs":{"total":3006477107200,"available":2989091799040,"internally_reserved":0,"allocated":12477431808,"data_stored":12474882291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55400,"internal_metadata":4907739032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6,7,22,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":353648640,"num_objects":5396,"num_object_clones":0,"num_object_copies":16188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43170,"num_write_kb":345360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008630"},"pg_stats":[{"pgid":"6.f","version":"90'32032","reported_seq":32051,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.989735+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:56:07.989735+0000","last_peered":"2026-02-24T07:56:07.989735+0000","last_clean":"2026-02-24T07:56:07.989735+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:07.989735+0000","last_undegraded":"2026-02-24T07:56:07.989735+0000","last_fullsized":"2026-02-24T07:56:07.989735+0000","mapping_epoch":82,"log_start":"90'32020","ondisk_log_start":"90'32020","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262406144,"num_objects":4004,"num_object_clones":0,"num_object_copies":12012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32032,"num_write_kb":256256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"90'31332","reported_seq":31354,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.837668+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:56:07.837668+0000","last_peered":"2026-02-24T07:56:07.837668+0000","last_clean":"2026-02-24T07:56:07.837668+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:07.837668+0000","last_undegraded":"2026-02-24T07:56:07.837668+0000","last_fullsized":"2026-02-24T07:56:07.837668+0000","mapping_epoch":82,"log_start":"90'31320","ondisk_log_start":"90'31320","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256671744,"num_objects":3917,"num_object_clones":0,"num_object_copies":11751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31332,"num_write_kb":250656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"90'32520","reported_seq":32547,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.835938+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:07.835938+0000","last_peered":"2026-02-24T07:56:07.835938+0000","last_clean":"2026-02-24T07:56:07.835938+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:07.835938+0000","last_undegraded":"2026-02-24T07:56:07.835938+0000","last_fullsized":"2026-02-24T07:56:07.835938+0000","mapping_epoch":82,"log_start":"90'32504","ondisk_log_start":"90'32504","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266403840,"num_objects":4065,"num_object_clones":0,"num_object_copies":12195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32520,"num_write_kb":260160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"90'31616","reported_seq":31639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.987243+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:07.987243+0000","last_peered":"2026-02-24T07:56:07.987243+0000","last_clean":"2026-02-24T07:56:07.987243+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:07.987243+0000","last_undegraded":"2026-02-24T07:56:07.987243+0000","last_fullsized":"2026-02-24T07:56:07.987243+0000","mapping_epoch":82,"log_start":"90'31608","ondisk_log_start":"90'31608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":3952,"num_object_clones":0,"num_object_copies":11856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31616,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"90'32185","reported_seq":32211,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.990866+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:56:07.990866+0000","last_peered":"2026-02-24T07:56:07.990866+0000","last_clean":"2026-02-24T07:56:07.990866+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:07.990866+0000","last_undegraded":"2026-02-24T07:56:07.990866+0000","last_fullsized":"2026-02-24T07:56:07.990866+0000","mapping_epoch":82,"log_start":"90'32177","ondisk_log_start":"90'32177","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263659520,"num_objects":4024,"num_object_clones":0,"num_object_copies":12072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32185,"num_write_kb":257480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"90'32264","reported_seq":32291,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.836621+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:07.836621+0000","last_peered":"2026-02-24T07:56:07.836621+0000","last_clean":"2026-02-24T07:56:07.836621+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:07.836621+0000","last_undegraded":"2026-02-24T07:56:07.836621+0000","last_fullsized":"2026-02-24T07:56:07.836621+0000","mapping_epoch":82,"log_start":"90'32256","ondisk_log_start":"90'32256","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264306688,"num_objects":4033,"num_object_clones":0,"num_object_copies":12099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32264,"num_write_kb":258112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'32208","reported_seq":32235,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.909760+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:56:07.909760+0000","last_peered":"2026-02-24T07:56:07.909760+0000","last_clean":"2026-02-24T07:56:07.909760+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:07.909760+0000","last_undegraded":"2026-02-24T07:56:07.909760+0000","last_fullsized":"2026-02-24T07:56:07.909760+0000","mapping_epoch":82,"log_start":"90'32200","ondisk_log_start":"90'32200","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263847936,"num_objects":4026,"num_object_clones":0,"num_object_copies":12078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32208,"num_write_kb":257664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"90'31240","reported_seq":31267,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.841875+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:07.841875+0000","last_peered":"2026-02-24T07:56:07.841875+0000","last_clean":"2026-02-24T07:56:07.841875+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:07.841875+0000","last_undegraded":"2026-02-24T07:56:07.841875+0000","last_fullsized":"2026-02-24T07:56:07.841875+0000","mapping_epoch":82,"log_start":"90'31232","ondisk_log_start":"90'31232","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255918080,"num_objects":3905,"num_object_clones":0,"num_object_copies":11715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31240,"num_write_kb":249920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"90'32424","reported_seq":32451,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.976822+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:56:07.976822+0000","last_peered":"2026-02-24T07:56:07.976822+0000","last_clean":"2026-02-24T07:56:07.976822+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:07.976822+0000","last_undegraded":"2026-02-24T07:56:07.976822+0000","last_fullsized":"2026-02-24T07:56:07.976822+0000","mapping_epoch":82,"log_start":"90'32416","ondisk_log_start":"90'32416","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265617408,"num_objects":4053,"num_object_clones":0,"num_object_copies":12159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32424,"num_write_kb":259392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"90'32008","reported_seq":32031,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844580+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:07.844580+0000","last_peered":"2026-02-24T07:56:07.844580+0000","last_clean":"2026-02-24T07:56:07.844580+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:07.844580+0000","last_undegraded":"2026-02-24T07:56:07.844580+0000","last_fullsized":"2026-02-24T07:56:07.844580+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209536,"num_objects":4001,"num_object_clones":0,"num_object_copies":12003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32008,"num_write_kb":256064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"90'32341","reported_seq":32355,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.986866+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:07.986866+0000","last_peered":"2026-02-24T07:56:07.986866+0000","last_clean":"2026-02-24T07:56:07.986866+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:07.986866+0000","last_undegraded":"2026-02-24T07:56:07.986866+0000","last_fullsized":"2026-02-24T07:56:07.986866+0000","mapping_epoch":82,"log_start":"90'32322","ondisk_log_start":"90'32322","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264937472,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32341,"num_write_kb":258728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"90'32416","reported_seq":32443,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.834393+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:07.834393+0000","last_peered":"2026-02-24T07:56:07.834393+0000","last_clean":"2026-02-24T07:56:07.834393+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:07.834393+0000","last_undegraded":"2026-02-24T07:56:07.834393+0000","last_fullsized":"2026-02-24T07:56:07.834393+0000","mapping_epoch":82,"log_start":"90'32408","ondisk_log_start":"90'32408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265551872,"num_objects":4052,"num_object_clones":0,"num_object_copies":12156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32416,"num_write_kb":259328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"90'30864","reported_seq":30891,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.844220+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:56:07.844220+0000","last_peered":"2026-02-24T07:56:07.844220+0000","last_clean":"2026-02-24T07:56:07.844220+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:07.844220+0000","last_undegraded":"2026-02-24T07:56:07.844220+0000","last_fullsized":"2026-02-24T07:56:07.844220+0000","mapping_epoch":82,"log_start":"90'30857","ondisk_log_start":"90'30857","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"90'32016","reported_seq":32035,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.991102+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:07.991102+0000","last_peered":"2026-02-24T07:56:07.991102+0000","last_clean":"2026-02-24T07:56:07.991102+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.991102+0000","last_undegraded":"2026-02-24T07:56:07.991102+0000","last_fullsized":"2026-02-24T07:56:07.991102+0000","mapping_epoch":82,"log_start":"90'32000","ondisk_log_start":"90'32000","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262275072,"num_objects":4002,"num_object_clones":0,"num_object_copies":12006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32016,"num_write_kb":256128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"90'31354","reported_seq":31377,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.916507+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:07.916507+0000","last_peered":"2026-02-24T07:56:07.916507+0000","last_clean":"2026-02-24T07:56:07.916507+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:07.916507+0000","last_undegraded":"2026-02-24T07:56:07.916507+0000","last_fullsized":"2026-02-24T07:56:07.916507+0000","mapping_epoch":82,"log_start":"90'31344","ondisk_log_start":"90'31344","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256851968,"num_objects":3920,"num_object_clones":0,"num_object_copies":11760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31354,"num_write_kb":250832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"90'32504","reported_seq":32523,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.842422+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:07.842422+0000","last_peered":"2026-02-24T07:56:07.842422+0000","last_clean":"2026-02-24T07:56:07.842422+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:07.842422+0000","last_undegraded":"2026-02-24T07:56:07.842422+0000","last_fullsized":"2026-02-24T07:56:07.842422+0000","mapping_epoch":82,"log_start":"90'32495","ondisk_log_start":"90'32495","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266272768,"num_objects":4063,"num_object_clones":0,"num_object_copies":12189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32504,"num_write_kb":260032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":370,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-24T07:56:07.013759+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:56:07.013759+0000","last_peered":"2026-02-24T07:56:07.013759+0000","last_clean":"2026-02-24T07:56:07.013759+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:07.013759+0000","last_undegraded":"2026-02-24T07:56:07.013759+0000","last_fullsized":"2026-02-24T07:56:07.013759+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":4188766208,"num_objects":63918,"num_object_clones":0,"num_object_copies":191754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511324,"num_write_kb":4090592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12567126016,"data_stored":12567126016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215219,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3399724,"kb_used_data":2512408,"kb_used_omap":14,"kb_used_meta":887281,"kb_avail":730603476,"statfs":{"total":751619276800,"available":748137959424,"internally_reserved":0,"allocated":2572705792,"data_stored":2572073434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14407,"internal_metadata":908576697},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4236280,"kb_used_data":3038948,"kb_used_omap":14,"kb_used_meta":1197297,"kb_avail":729766920,"statfs":{"total":751619276800,"available":747281326080,"internally_reserved":0,"allocated":3111882752,"data_stored":3111242515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14966,"internal_metadata":1226032522},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5112868,"kb_used_data":3580496,"kb_used_omap":10,"kb_used_meta":1532341,"kb_avail":728890332,"statfs":{"total":751619276800,"available":746383699968,"internally_reserved":0,"allocated":3666427904,"data_stored":3665791219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11050,"internal_metadata":1569117398},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,6,7,17,39,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4228968,"kb_used_data":3053140,"kb_used_omap":14,"kb_used_meta":1175793,"kb_avail":729774232,"statfs":{"total":751619276800,"available":747288813568,"internally_reserved":0,"allocated":3126415360,"data_stored":3125775123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14977,"internal_metadata":1204012415},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6170,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3131842560,"data_stored":3131842560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3678994432,"data_stored":3678994432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3137994752,"data_stored":3137994752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2618294272,"data_stored":2618294272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:09.587 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:56:09.588 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 56 2026-02-24T07:56:09.729 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:09.857 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.855+0000 7f7b4229f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:09.857 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:09.855+0000 7f7b4229f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:10.008 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:56:10.052 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1840954222' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:10.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:10 trial016 ceph-mon[39544]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:10.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:10 trial016 ceph-mon[39544]: pgmap v347: 17 pgs: 17 active+clean; 3.9 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.70k op/s 2026-02-24T07:56:10.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:10 trial016 ceph-mon[39544]: osdmap e92: 4 total, 4 up, 4 in 2026-02-24T07:56:10.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/659234177' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T07:56:10.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:56:10.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:56:10.087796+0000 min lat: 0.000575227 max lat: 0.128434 avg lat: 0.0144571 2026-02-24T07:56:10.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:56:10.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 531289 531161 69.156 71.7422 0.00652746 0.0144571 2026-02-24T07:56:11.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 127 540907 540780 69.2542 75.1484 0.00932228 0.0144364 2026-02-24T07:56:11.394 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:11.540 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:11.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:11.712+0000 7f734f010640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:11.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:11.712+0000 7f734f010640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:11.731 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:11.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:11.749 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:11.749 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:11.768 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:11.769 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:11.782 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:11.782 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:11.970 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/592774707' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:12.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 549865 549737 69.2657 69.9766 0.00192535 0.0144347 2026-02-24T07:56:13.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:12 trial016 ceph-mon[39544]: pgmap v349: 17 pgs: 17 active+clean; 3.9 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.43k op/s 2026-02-24T07:56:13.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 558754 558626 69.2685 69.4453 0.0131026 0.0144328 2026-02-24T07:56:14.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 128 567853 567725 69.2968 71.0859 0.0138915 0.0144274 2026-02-24T07:56:14.439 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:14.584 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:14.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:14.712+0000 7efff9f7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:14.715 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:14.713+0000 7efff9f7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:14.731 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:14.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:14.760 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:14.761 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:14.783 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:14.783 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:14.797 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:14.797 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:15.054 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:15.055 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:15.055 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T07:56:15.055 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:15.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:15.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:14 trial016 ceph-mon[39544]: pgmap v350: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 102 MiB/s wr, 13.06k op/s 2026-02-24T07:56:15.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1810451352' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:15.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 128 577094 576966 69.3413 72.1953 0.0109097 0.0144181 2026-02-24T07:56:15.211 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:15.335 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:15.332+0000 7f5ee3f80640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:15.335 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:15.333+0000 7f5ee3f80640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:15.485 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:15.486 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:15.536 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2026-02-24T07:56:13.815568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4564255264,"num_objects":69640,"num_object_clones":0,"num_object_copies":208920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69640,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":557223,"num_write_kb":4458854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18002292,"kb_used_data":13281380,"kb_used_omap":59,"kb_used_meta":4720772,"kb_avail":2918010508,"statfs":{"total":3006477107200,"available":2988042760192,"internally_reserved":0,"allocated":13600133120,"data_stored":13597512660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61271,"internal_metadata":4834070697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1,1,8,24],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728547328,"num_objects":11116,"num_object_clones":0,"num_object_copies":33348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88934,"num_write_kb":711472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.808970"},"pg_stats":[{"pgid":"6.f","version":"92'34903","reported_seq":34925,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:13.002344+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:56:13.002344+0000","last_peered":"2026-02-24T07:56:13.002344+0000","last_clean":"2026-02-24T07:56:13.002344+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:13.002344+0000","last_undegraded":"2026-02-24T07:56:13.002344+0000","last_fullsized":"2026-02-24T07:56:13.002344+0000","mapping_epoch":82,"log_start":"92'34889","ondisk_log_start":"92'34889","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285925376,"num_objects":4363,"num_object_clones":0,"num_object_copies":13089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34903,"num_write_kb":279224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"92'34216","reported_seq":34247,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.840245+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:56:12.840245+0000","last_peered":"2026-02-24T07:56:12.840245+0000","last_clean":"2026-02-24T07:56:12.840245+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:12.840245+0000","last_undegraded":"2026-02-24T07:56:12.840245+0000","last_fullsized":"2026-02-24T07:56:12.840245+0000","mapping_epoch":82,"log_start":"92'34208","ondisk_log_start":"92'34208","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34216,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"92'35312","reported_seq":35343,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.841069+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:12.841069+0000","last_peered":"2026-02-24T07:56:12.841069+0000","last_clean":"2026-02-24T07:56:12.841069+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:12.841069+0000","last_undegraded":"2026-02-24T07:56:12.841069+0000","last_fullsized":"2026-02-24T07:56:12.841069+0000","mapping_epoch":82,"log_start":"92'35296","ondisk_log_start":"92'35296","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289275904,"num_objects":4414,"num_object_clones":0,"num_object_copies":13242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35312,"num_write_kb":282496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"92'34528","reported_seq":34559,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.984499+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:12.984499+0000","last_peered":"2026-02-24T07:56:12.984499+0000","last_clean":"2026-02-24T07:56:12.984499+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:12.984499+0000","last_undegraded":"2026-02-24T07:56:12.984499+0000","last_fullsized":"2026-02-24T07:56:12.984499+0000","mapping_epoch":82,"log_start":"92'34512","ondisk_log_start":"92'34512","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282853376,"num_objects":4316,"num_object_clones":0,"num_object_copies":12948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34528,"num_write_kb":276224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"92'34895","reported_seq":34911,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:13.000583+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:56:13.000583+0000","last_peered":"2026-02-24T07:56:13.000583+0000","last_clean":"2026-02-24T07:56:13.000583+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:13.000583+0000","last_undegraded":"2026-02-24T07:56:13.000583+0000","last_fullsized":"2026-02-24T07:56:13.000583+0000","mapping_epoch":82,"log_start":"92'34879","ondisk_log_start":"92'34879","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285859840,"num_objects":4362,"num_object_clones":0,"num_object_copies":13086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34895,"num_write_kb":279160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'35411","reported_seq":35439,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.841968+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:12.841968+0000","last_peered":"2026-02-24T07:56:12.841968+0000","last_clean":"2026-02-24T07:56:12.841968+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:12.841968+0000","last_undegraded":"2026-02-24T07:56:12.841968+0000","last_fullsized":"2026-02-24T07:56:12.841968+0000","mapping_epoch":82,"log_start":"92'35392","ondisk_log_start":"92'35392","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290086912,"num_objects":4427,"num_object_clones":0,"num_object_copies":13281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35411,"num_write_kb":283288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'35232","reported_seq":35263,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.913899+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:56:12.913899+0000","last_peered":"2026-02-24T07:56:12.913899+0000","last_clean":"2026-02-24T07:56:12.913899+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:12.913899+0000","last_undegraded":"2026-02-24T07:56:12.913899+0000","last_fullsized":"2026-02-24T07:56:12.913899+0000","mapping_epoch":82,"log_start":"92'35224","ondisk_log_start":"92'35224","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:13.780395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288620544,"num_objects":4404,"num_object_clones":0,"num_object_copies":13212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35232,"num_write_kb":281856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"92'33900","reported_seq":33922,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.845656+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:12.845656+0000","last_peered":"2026-02-24T07:56:12.845656+0000","last_clean":"2026-02-24T07:56:12.845656+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:12.845656+0000","last_undegraded":"2026-02-24T07:56:12.845656+0000","last_fullsized":"2026-02-24T07:56:12.845656+0000","mapping_epoch":82,"log_start":"92'33890","ondisk_log_start":"92'33890","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277708800,"num_objects":4238,"num_object_clones":0,"num_object_copies":12714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33900,"num_write_kb":271200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"92'35360","reported_seq":35391,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.976128+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:56:12.976128+0000","last_peered":"2026-02-24T07:56:12.976128+0000","last_clean":"2026-02-24T07:56:12.976128+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:12.976128+0000","last_undegraded":"2026-02-24T07:56:12.976128+0000","last_fullsized":"2026-02-24T07:56:12.976128+0000","mapping_epoch":82,"log_start":"92'35349","ondisk_log_start":"92'35349","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35360,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"92'35112","reported_seq":35139,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.845521+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:12.845521+0000","last_peered":"2026-02-24T07:56:12.845521+0000","last_clean":"2026-02-24T07:56:12.845521+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:12.845521+0000","last_undegraded":"2026-02-24T07:56:12.845521+0000","last_fullsized":"2026-02-24T07:56:12.845521+0000","mapping_epoch":82,"log_start":"92'35107","ondisk_log_start":"92'35107","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287637504,"num_objects":4389,"num_object_clones":0,"num_object_copies":13167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35112,"num_write_kb":280896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"92'35168","reported_seq":35190,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:13.001715+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:13.001715+0000","last_peered":"2026-02-24T07:56:13.001715+0000","last_clean":"2026-02-24T07:56:13.001715+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:13.001715+0000","last_undegraded":"2026-02-24T07:56:13.001715+0000","last_fullsized":"2026-02-24T07:56:13.001715+0000","mapping_epoch":82,"log_start":"92'35154","ondisk_log_start":"92'35154","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288096256,"num_objects":4396,"num_object_clones":0,"num_object_copies":13188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35168,"num_write_kb":281344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"92'35048","reported_seq":35079,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.841814+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:12.841814+0000","last_peered":"2026-02-24T07:56:12.841814+0000","last_clean":"2026-02-24T07:56:12.841814+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:12.841814+0000","last_undegraded":"2026-02-24T07:56:12.841814+0000","last_fullsized":"2026-02-24T07:56:12.841814+0000","mapping_epoch":82,"log_start":"92'35040","ondisk_log_start":"92'35040","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287113216,"num_objects":4381,"num_object_clones":0,"num_object_copies":13143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35048,"num_write_kb":280384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"92'33616","reported_seq":33647,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.852471+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:56:12.852471+0000","last_peered":"2026-02-24T07:56:12.852471+0000","last_clean":"2026-02-24T07:56:12.852471+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:12.852471+0000","last_undegraded":"2026-02-24T07:56:12.852471+0000","last_fullsized":"2026-02-24T07:56:12.852471+0000","mapping_epoch":82,"log_start":"92'33608","ondisk_log_start":"92'33608","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275382272,"num_objects":4202,"num_object_clones":0,"num_object_copies":12606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33616,"num_write_kb":268928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"92'34653","reported_seq":34676,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:13.000406+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:13.000406+0000","last_peered":"2026-02-24T07:56:13.000406+0000","last_clean":"2026-02-24T07:56:13.000406+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:13.000406+0000","last_undegraded":"2026-02-24T07:56:13.000406+0000","last_fullsized":"2026-02-24T07:56:13.000406+0000","mapping_epoch":82,"log_start":"92'34644","ondisk_log_start":"92'34644","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283877376,"num_objects":4332,"num_object_clones":0,"num_object_copies":12996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34653,"num_write_kb":277224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"92'34272","reported_seq":34303,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.901008+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:12.901008+0000","last_peered":"2026-02-24T07:56:12.901008+0000","last_clean":"2026-02-24T07:56:12.901008+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:12.901008+0000","last_undegraded":"2026-02-24T07:56:12.901008+0000","last_fullsized":"2026-02-24T07:56:12.901008+0000","mapping_epoch":82,"log_start":"92'34264","ondisk_log_start":"92'34264","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280756224,"num_objects":4284,"num_object_clones":0,"num_object_copies":12852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34272,"num_write_kb":274176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'35462","reported_seq":35488,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:12.830697+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:12.830697+0000","last_peered":"2026-02-24T07:56:12.830697+0000","last_clean":"2026-02-24T07:56:12.830697+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:12.830697+0000","last_undegraded":"2026-02-24T07:56:12.830697+0000","last_fullsized":"2026-02-24T07:56:12.830697+0000","mapping_epoch":82,"log_start":"92'35456","ondisk_log_start":"92'35456","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290504704,"num_objects":4433,"num_object_clones":0,"num_object_copies":13299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35462,"num_write_kb":283696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":374,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:09.851929+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:56:09.851929+0000","last_peered":"2026-02-24T07:56:09.851929+0000","last_clean":"2026-02-24T07:56:09.851929+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:09.851929+0000","last_undegraded":"2026-02-24T07:56:09.851929+0000","last_fullsized":"2026-02-24T07:56:09.851929+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":4563664896,"num_objects":69638,"num_object_clones":0,"num_object_copies":208914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557088,"num_write_kb":4456704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13690912768,"data_stored":13690912768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6196,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215220,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3684152,"kb_used_data":2742692,"kb_used_omap":15,"kb_used_meta":941424,"kb_avail":730319048,"statfs":{"total":751619276800,"available":747846705152,"internally_reserved":0,"allocated":2808516608,"data_stored":2807860605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16366,"internal_metadata":964018194},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4601192,"kb_used_data":3313620,"kb_used_omap":15,"kb_used_meta":1287536,"kb_avail":729402008,"statfs":{"total":751619276800,"available":746907656192,"internally_reserved":0,"allocated":3393146880,"data_stored":3392490877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16270,"internal_metadata":1318436978},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,1,8,24],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5068084,"kb_used_data":3896416,"kb_used_omap":12,"kb_used_meta":1171635,"kb_avail":728935116,"statfs":{"total":751619276800,"available":746429558784,"internally_reserved":0,"allocated":3989929984,"data_stored":3989277533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12354,"internal_metadata":1199755198},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705786,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4648864,"kb_used_data":3328652,"kb_used_omap":15,"kb_used_meta":1320176,"kb_avail":729354336,"statfs":{"total":751619276800,"available":746858840064,"internally_reserved":0,"allocated":3408539648,"data_stored":3407883645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16281,"internal_metadata":1351860327},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6196,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3414949888,"data_stored":3414949888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4006125568,"data_stored":4006125568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3420487680,"data_stored":3420487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2849349632,"data_stored":2849349632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:15.537 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:56:15.537 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 66 2026-02-24T07:56:15.723 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:15.851 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:15.849+0000 7f537ef6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:15.852 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:15.849+0000 7f537ef6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:16.001 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:56:16.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:56:16.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 586384 586256 69.3903 72.5781 0.0130762 0.0144086 2026-02-24T07:56:16.843 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:16.992 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:17.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 127 595697 595570 69.4406 72.7656 0.00922764 0.0143981 2026-02-24T07:56:17.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:16 trial016 ceph-mon[39544]: from='client.15224 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:17.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:16 trial016 ceph-mon[39544]: pgmap v351: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.12k op/s 2026-02-24T07:56:17.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/717498052' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T07:56:17.178 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:17.176+0000 7f52b4a82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:17.178 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:17.176+0000 7f52b4a82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:17.192 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:17.193 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:17.228 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:17.229 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:17.243 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:17.244 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:17.257 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:17.257 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:18.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 128 604619 604491 69.4442 69.6953 0.0194981 0.0143968 2026-02-24T07:56:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2472686969' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:19.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 613910 613782 69.4897 72.5859 0.0182184 0.0143878 2026-02-24T07:56:19.304 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:18 trial016 ceph-mon[39544]: pgmap v352: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.67k op/s 2026-02-24T07:56:19.454 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:19.838 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:19.835+0000 7f7ea4dc5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:19.838 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:19.835+0000 7f7ea4dc5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:19.853 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:19.854 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:19.880 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:19.880 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:19.895 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:19.896 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:19.909 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:19.910 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:20.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 128 621530 621402 69.3474 59.5312 0.0103662 0.0144176 2026-02-24T07:56:20.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1528617797' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:21.043 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:21.044 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:21.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:21.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 631069 630941 69.4202 74.5234 0.00611573 0.0144019 2026-02-24T07:56:21.191 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:21.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:20 trial016 ceph-mon[39544]: pgmap v353: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.16k op/s 2026-02-24T07:56:21.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:21.311+0000 7ff872a6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:21.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:21.312+0000 7ff872a6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:21.470 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:21.470 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:21.519 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2026-02-24T07:56:20.876375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4940079648,"num_objects":75375,"num_object_clones":0,"num_object_copies":226125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75375,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":603100,"num_write_kb":4825870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19492252,"kb_used_data":14428428,"kb_used_omap":59,"kb_used_meta":5063684,"kb_avail":2916520548,"statfs":{"total":3006477107200,"available":2986517041152,"internally_reserved":0,"allocated":14774710272,"data_stored":14772089812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61271,"internal_metadata":5185212585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[19,1,11,5,8,21],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":750723072,"num_objects":11455,"num_object_clones":0,"num_object_copies":34365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91641,"num_write_kb":733128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.024996"},"pg_stats":[{"pgid":"6.f","version":"92'37840","reported_seq":37863,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:18.001196+0000","last_change":"2026-02-24T07:55:08.999844+0000","last_active":"2026-02-24T07:56:18.001196+0000","last_peered":"2026-02-24T07:56:18.001196+0000","last_clean":"2026-02-24T07:56:18.001196+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:18.001196+0000","last_undegraded":"2026-02-24T07:56:18.001196+0000","last_fullsized":"2026-02-24T07:56:18.001196+0000","mapping_epoch":82,"log_start":"92'37826","ondisk_log_start":"92'37826","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:18.417110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309985280,"num_objects":4730,"num_object_clones":0,"num_object_copies":14190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37840,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"92'37040","reported_seq":37071,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.829490+0000","last_change":"2026-02-24T07:55:08.999426+0000","last_active":"2026-02-24T07:56:17.829490+0000","last_peered":"2026-02-24T07:56:17.829490+0000","last_clean":"2026-02-24T07:56:17.829490+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:17.829490+0000","last_undegraded":"2026-02-24T07:56:17.829490+0000","last_fullsized":"2026-02-24T07:56:17.829490+0000","mapping_epoch":82,"log_start":"92'37034","ondisk_log_start":"92'37034","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:21.605183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303431680,"num_objects":4630,"num_object_clones":0,"num_object_copies":13890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37040,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"92'38242","reported_seq":38271,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.831907+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:17.831907+0000","last_peered":"2026-02-24T07:56:17.831907+0000","last_clean":"2026-02-24T07:56:17.831907+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:17.831907+0000","last_undegraded":"2026-02-24T07:56:17.831907+0000","last_fullsized":"2026-02-24T07:56:17.831907+0000","mapping_epoch":82,"log_start":"92'38229","ondisk_log_start":"92'38229","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.949990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313278464,"num_objects":4781,"num_object_clones":0,"num_object_copies":14343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38242,"num_write_kb":305936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"92'37384","reported_seq":37415,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.969979+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:17.969979+0000","last_peered":"2026-02-24T07:56:17.969979+0000","last_clean":"2026-02-24T07:56:17.969979+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:17.969979+0000","last_undegraded":"2026-02-24T07:56:17.969979+0000","last_fullsized":"2026-02-24T07:56:17.969979+0000","mapping_epoch":82,"log_start":"92'37368","ondisk_log_start":"92'37368","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306249728,"num_objects":4673,"num_object_clones":0,"num_object_copies":14019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37384,"num_write_kb":299072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"92'37664","reported_seq":37695,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.969527+0000","last_change":"2026-02-24T07:55:09.000052+0000","last_active":"2026-02-24T07:56:17.969527+0000","last_peered":"2026-02-24T07:56:17.969527+0000","last_clean":"2026-02-24T07:56:17.969527+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:17.969527+0000","last_undegraded":"2026-02-24T07:56:17.969527+0000","last_fullsized":"2026-02-24T07:56:17.969527+0000","mapping_epoch":82,"log_start":"92'37653","ondisk_log_start":"92'37653","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.200418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308543488,"num_objects":4708,"num_object_clones":0,"num_object_copies":14124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37664,"num_write_kb":301312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'38320","reported_seq":38351,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.829783+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:17.829783+0000","last_peered":"2026-02-24T07:56:17.829783+0000","last_clean":"2026-02-24T07:56:17.829783+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:17.829783+0000","last_undegraded":"2026-02-24T07:56:17.829783+0000","last_fullsized":"2026-02-24T07:56:17.829783+0000","mapping_epoch":82,"log_start":"92'38304","ondisk_log_start":"92'38304","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313917440,"num_objects":4790,"num_object_clones":0,"num_object_copies":14370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38320,"num_write_kb":306560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'38000","reported_seq":38030,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.916532+0000","last_change":"2026-02-24T07:55:08.999169+0000","last_active":"2026-02-24T07:56:17.916532+0000","last_peered":"2026-02-24T07:56:17.916532+0000","last_clean":"2026-02-24T07:56:17.916532+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:17.916532+0000","last_undegraded":"2026-02-24T07:56:17.916532+0000","last_fullsized":"2026-02-24T07:56:17.916532+0000","mapping_epoch":82,"log_start":"92'37997","ondisk_log_start":"92'37997","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311296000,"num_objects":4750,"num_object_clones":0,"num_object_copies":14250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38000,"num_write_kb":304000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"92'36697","reported_seq":36727,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.841716+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:17.841716+0000","last_peered":"2026-02-24T07:56:17.841716+0000","last_clean":"2026-02-24T07:56:17.841716+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:17.841716+0000","last_undegraded":"2026-02-24T07:56:17.841716+0000","last_fullsized":"2026-02-24T07:56:17.841716+0000","mapping_epoch":82,"log_start":"92'36690","ondisk_log_start":"92'36690","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:24.450072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300621824,"num_objects":4588,"num_object_clones":0,"num_object_copies":13764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36697,"num_write_kb":293576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"92'38200","reported_seq":38231,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:18.003831+0000","last_change":"2026-02-24T07:55:08.998750+0000","last_active":"2026-02-24T07:56:18.003831+0000","last_peered":"2026-02-24T07:56:18.003831+0000","last_clean":"2026-02-24T07:56:18.003831+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:18.003831+0000","last_undegraded":"2026-02-24T07:56:18.003831+0000","last_fullsized":"2026-02-24T07:56:18.003831+0000","mapping_epoch":82,"log_start":"92'38179","ondisk_log_start":"92'38179","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:22.972862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312934400,"num_objects":4775,"num_object_clones":0,"num_object_copies":14325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38200,"num_write_kb":305600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"92'37872","reported_seq":37903,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.839899+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:17.839899+0000","last_peered":"2026-02-24T07:56:17.839899+0000","last_clean":"2026-02-24T07:56:17.839899+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:17.839899+0000","last_undegraded":"2026-02-24T07:56:17.839899+0000","last_fullsized":"2026-02-24T07:56:17.839899+0000","mapping_epoch":82,"log_start":"92'37869","ondisk_log_start":"92'37869","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:26.674166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310247424,"num_objects":4734,"num_object_clones":0,"num_object_copies":14202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37872,"num_write_kb":302976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"92'38216","reported_seq":38244,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.996548+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:17.996548+0000","last_peered":"2026-02-24T07:56:17.996548+0000","last_clean":"2026-02-24T07:56:17.996548+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:17.996548+0000","last_undegraded":"2026-02-24T07:56:17.996548+0000","last_fullsized":"2026-02-24T07:56:17.996548+0000","mapping_epoch":82,"log_start":"92'38208","ondisk_log_start":"92'38208","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313065472,"num_objects":4777,"num_object_clones":0,"num_object_copies":14331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38216,"num_write_kb":305728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"92'37978","reported_seq":38007,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.831277+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:17.831277+0000","last_peered":"2026-02-24T07:56:17.831277+0000","last_clean":"2026-02-24T07:56:17.831277+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:17.831277+0000","last_undegraded":"2026-02-24T07:56:17.831277+0000","last_fullsized":"2026-02-24T07:56:17.831277+0000","mapping_epoch":82,"log_start":"92'37963","ondisk_log_start":"92'37963","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311115776,"num_objects":4748,"num_object_clones":0,"num_object_copies":14244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37978,"num_write_kb":303824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"92'36568","reported_seq":36599,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.805353+0000","last_change":"2026-02-24T07:55:08.998698+0000","last_active":"2026-02-24T07:56:17.805353+0000","last_peered":"2026-02-24T07:56:17.805353+0000","last_clean":"2026-02-24T07:56:17.805353+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:17.805353+0000","last_undegraded":"2026-02-24T07:56:17.805353+0000","last_fullsized":"2026-02-24T07:56:17.805353+0000","mapping_epoch":82,"log_start":"92'36560","ondisk_log_start":"92'36560","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:19.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299565056,"num_objects":4571,"num_object_clones":0,"num_object_copies":13713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36568,"num_write_kb":292544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"92'37360","reported_seq":37391,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.982770+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:17.982770+0000","last_peered":"2026-02-24T07:56:17.982770+0000","last_clean":"2026-02-24T07:56:17.982770+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:17.982770+0000","last_undegraded":"2026-02-24T07:56:17.982770+0000","last_fullsized":"2026-02-24T07:56:17.982770+0000","mapping_epoch":82,"log_start":"92'37338","ondisk_log_start":"92'37338","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306053120,"num_objects":4670,"num_object_clones":0,"num_object_copies":14010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37360,"num_write_kb":298880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"92'37208","reported_seq":37239,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.883046+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:17.883046+0000","last_peered":"2026-02-24T07:56:17.883046+0000","last_clean":"2026-02-24T07:56:17.883046+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:17.883046+0000","last_undegraded":"2026-02-24T07:56:17.883046+0000","last_fullsized":"2026-02-24T07:56:17.883046+0000","mapping_epoch":82,"log_start":"92'37205","ondisk_log_start":"92'37205","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304807936,"num_objects":4651,"num_object_clones":0,"num_object_copies":13953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37208,"num_write_kb":297664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'38376","reported_seq":38407,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:17.843552+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:17.843552+0000","last_peered":"2026-02-24T07:56:17.843552+0000","last_clean":"2026-02-24T07:56:17.843552+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:17.843552+0000","last_undegraded":"2026-02-24T07:56:17.843552+0000","last_fullsized":"2026-02-24T07:56:17.843552+0000","mapping_epoch":82,"log_start":"92'38360","ondisk_log_start":"92'38360","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314376192,"num_objects":4797,"num_object_clones":0,"num_object_copies":14391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38376,"num_write_kb":307008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":374,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T07:56:09.851929+0000","last_change":"2026-02-24T07:55:13.787583+0000","last_active":"2026-02-24T07:56:09.851929+0000","last_peered":"2026-02-24T07:56:09.851929+0000","last_clean":"2026-02-24T07:56:09.851929+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:09.851929+0000","last_undegraded":"2026-02-24T07:56:09.851929+0000","last_fullsized":"2026-02-24T07:56:09.851929+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:55:13.787541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:55:13.787541+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:17.143902+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":4939489280,"num_objects":75373,"num_object_clones":0,"num_object_copies":226119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75373,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":602965,"num_write_kb":4823720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14821023744,"data_stored":14821023744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":182,"ondisk_log_size":182,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6196,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215221,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4024200,"kb_used_data":3010548,"kb_used_omap":15,"kb_used_meta":1013616,"kb_avail":729979000,"statfs":{"total":751619276800,"available":747498496000,"internally_reserved":0,"allocated":3082801152,"data_stored":3082145149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16366,"internal_metadata":1037942802},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5009424,"kb_used_data":3595516,"kb_used_omap":15,"kb_used_meta":1413872,"kb_avail":728993776,"statfs":{"total":751619276800,"available":746489626624,"internally_reserved":0,"allocated":3681808384,"data_stored":3681152381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16270,"internal_metadata":1447805042},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,1,11,5,8,21],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5468508,"kb_used_data":4224648,"kb_used_omap":12,"kb_used_meta":1243827,"kb_avail":728534692,"statfs":{"total":751619276800,"available":746019524608,"internally_reserved":0,"allocated":4326039552,"data_stored":4325387101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12354,"internal_metadata":1273679806},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705787,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4990120,"kb_used_data":3597716,"kb_used_omap":15,"kb_used_meta":1392368,"kb_avail":729013080,"statfs":{"total":751619276800,"available":746509393920,"internally_reserved":0,"allocated":3684061184,"data_stored":3683405181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16281,"internal_metadata":1425784935},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6196,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3696427008,"data_stored":3696427008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4335779840,"data_stored":4335779840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3706519552,"data_stored":3706519552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3082297344,"data_stored":3082297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:22.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:22.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 128 640624 640496 69.4927 74.6484 0.00464327 0.0143869 2026-02-24T07:56:22.194 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:22.221 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:21 trial016 ceph-mon[39544]: osdmap e93: 4 total, 4 up, 4 in 2026-02-24T07:56:22.324 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:22.321+0000 7f23b76e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:22.324 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:22.321+0000 7f23b76e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:22.340 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:22.340 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:22.353 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:22.354 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:22.377 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:22.377 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:22.399 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:22.399 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:23.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 650128 650000 69.5578 74.25 0.0132718 0.0143732 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: from='client.15232 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: pgmap v355: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.16k op/s 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: 6.f scrub starts 2026-02-24T07:56:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/200091889' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:24.089 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 658957 658829 69.5499 68.9766 0.0203841 0.0143748 2026-02-24T07:56:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:56:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:56:24.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:56:24.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:56:24.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: 6.f scrub ok 2026-02-24T07:56:24.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:23 trial016 ceph-mon[39544]: 6.9 scrub starts 2026-02-24T07:56:24.444 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:24.599 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:25.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:25.040+0000 7f0fbd827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:25.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:25.040+0000 7f0fbd827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:25.090 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:25.090 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:25.091 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:25.091 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:25.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 666957 666829 69.4558 62.5 0.00561603 0.0143947 2026-02-24T07:56:25.095 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:25.095 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:25.111 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:25.111 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:25.122 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:25.122 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:24 trial016 ceph-mon[39544]: 6.2 scrub starts 2026-02-24T07:56:25.122 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:24 trial016 ceph-mon[39544]: pgmap v356: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s wr, 9.13k op/s 2026-02-24T07:56:25.123 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:24 trial016 ceph-mon[39544]: 6.6 scrub starts 2026-02-24T07:56:25.123 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:24 trial016 ceph-mon[39544]: 6.9 scrub ok 2026-02-24T07:56:25.123 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:24 trial016 ceph-mon[39544]: osdmap e94: 4 total, 4 up, 4 in 2026-02-24T07:56:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:25 trial016 ceph-mon[39544]: 6.2 scrub ok 2026-02-24T07:56:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2843662358' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:26.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:25 trial016 ceph-mon[39544]: 6.6 scrub ok 2026-02-24T07:56:26.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 674151 674023 69.2814 56.2031 0.0182003 0.0144315 2026-02-24T07:56:26.522 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:26.522 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:56:26.681 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:26.818 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:26.816+0000 7ff8eb67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:26.818 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:26.816+0000 7ff8eb67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:27.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 128 682985 682857 69.2779 69.0156 0.00373423 0.0144318 2026-02-24T07:56:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:26 trial016 ceph-mon[39544]: pgmap v358: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 89 MiB/s wr, 11.41k op/s 2026-02-24T07:56:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:26 trial016 ceph-mon[39544]: 6.e scrub starts 2026-02-24T07:56:27.804 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:27.889 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:56:27.940 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:56:27.960 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:28.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:28.086+0000 7f95c8cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:28.088 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:27 trial016 ceph-mon[39544]: 6.b scrub starts 2026-02-24T07:56:28.088 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4138280991' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:56:28.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:28.086+0000 7f95c8cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:28.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 128 691527 691399 69.2452 66.7344 0.00924513 0.0144383 2026-02-24T07:56:28.100 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:28.108 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:28.109 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:28.145 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:28.146 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:28.158 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:28.159 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:28.173 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:28.173 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:28.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:28.233+0000 7f2646aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:28.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:28.233+0000 7f2646aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:28.890 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:56:28.942 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:56:29.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 128 700773 700645 69.2829 72.2344 0.0260751 0.01443 2026-02-24T07:56:29.138 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: 6.e scrub ok 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: pgmap v359: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 44 MiB/s wr, 5.67k op/s 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4138280991' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: osdmap e95: 4 total, 4 up, 4 in 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1696946274' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:29.165 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1233687551' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:56:29.270 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:29.268+0000 7f7cd99e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:29.270 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:29.268+0000 7f7cd99e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:29.892 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:56:29.944 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:56:30.090 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:30.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:56:30.089363+0000 min lat: 0.000575227 max lat: 0.128434 avg lat: 0.0144283 2026-02-24T07:56:30.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:56:30.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 709744 709616 69.2929 70.0859 0.0251858 0.0144283 2026-02-24T07:56:30.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:29 trial016 ceph-mon[39544]: 6.b scrub ok 2026-02-24T07:56:30.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1233687551' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:56:30.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:29 trial016 ceph-mon[39544]: osdmap e96: 4 total, 4 up, 4 in 2026-02-24T07:56:30.150 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:29 trial016 ceph-mon[39544]: 6.5 scrub starts 2026-02-24T07:56:30.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3231101881' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:56:30.222 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:30.220+0000 7f8429a8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:30.223 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:30.220+0000 7f8429a8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:30.225 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:30.377 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:30.895 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:30.897+0000 7f2faf96e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:30.898+0000 7f2faf96e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:30.946 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:30.960 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:30.960 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:30.975 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:30.976 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:31.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 128 717117 716989 69.1485 57.6016 0.00514295 0.0144548 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: 6.8 scrub starts 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: pgmap v362: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 6.98k op/s 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3231101881' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: osdmap e97: 4 total, 4 up, 4 in 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: 6.5 scrub ok 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3584157287' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:56:31.242 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:30 trial016 ceph-mon[39544]: 6.d scrub starts 2026-02-24T07:56:31.442 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:56:31.442 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:31.641 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:31.778 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:31.776+0000 7f2b3e10f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:31.779 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:31.776+0000 7f2b3e10f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:31.939 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:31.939 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:32.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3584157287' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:56:32.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:31 trial016 ceph-mon[39544]: osdmap e98: 4 total, 4 up, 4 in 2026-02-24T07:56:32.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1054307028' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:32.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:31 trial016 ceph-mon[39544]: 6.8 scrub ok 2026-02-24T07:56:32.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:31 trial016 ceph-mon[39544]: 6.0 scrub starts 2026-02-24T07:56:32.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 723966 723838 68.9577 53.5078 0.00623891 0.0144995 2026-02-24T07:56:32.298 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2026-02-24T07:56:31.818009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5655265824,"num_objects":86288,"num_object_clones":0,"num_object_copies":258864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86288,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":690403,"num_write_kb":5524294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21828956,"kb_used_data":16514188,"kb_used_omap":66,"kb_used_meta":5314621,"kb_avail":2914183844,"statfs":{"total":3006477107200,"available":2984124256256,"internally_reserved":0,"allocated":16910528512,"data_stored":16907845156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67840,"internal_metadata":5442172672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[19,3,4,45,51,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":343261184,"num_objects":5239,"num_object_clones":0,"num_object_copies":15717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41902,"num_write_kb":335216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000509"},"pg_stats":[{"pgid":"6.f","version":"95'43382","reported_seq":43477,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.049095+0000","last_change":"2026-02-24T07:56:23.502859+0000","last_active":"2026-02-24T07:56:28.049095+0000","last_peered":"2026-02-24T07:56:28.049095+0000","last_clean":"2026-02-24T07:56:28.049095+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:28.049095+0000","last_undegraded":"2026-02-24T07:56:28.049095+0000","last_fullsized":"2026-02-24T07:56:28.049095+0000","mapping_epoch":82,"log_start":"95'43376","ondisk_log_start":"95'43376","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40817","last_scrub_stamp":"2026-02-24T07:56:23.502797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:23.502797+0000","objects_scrubbed":5048,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:23.521387+0000","scrub_duration":1620,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355385344,"num_objects":5423,"num_object_clones":0,"num_object_copies":16269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43382,"num_write_kb":347056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"94'42531","reported_seq":42624,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.834371+0000","last_change":"2026-02-24T07:56:27.724495+0000","last_active":"2026-02-24T07:56:27.834371+0000","last_peered":"2026-02-24T07:56:27.834371+0000","last_clean":"2026-02-24T07:56:27.834371+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:27.834371+0000","last_undegraded":"2026-02-24T07:56:27.834371+0000","last_fullsized":"2026-02-24T07:56:27.834371+0000","mapping_epoch":82,"log_start":"94'42521","ondisk_log_start":"94'42521","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42472","last_scrub_stamp":"2026-02-24T07:56:27.724424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:27.724424+0000","objects_scrubbed":5255,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:51.044488+0000","scrub_duration":1391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348413952,"num_objects":5317,"num_object_clones":0,"num_object_copies":15951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42531,"num_write_kb":340248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"94'43745","reported_seq":43779,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.837676+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:27.837676+0000","last_peered":"2026-02-24T07:56:27.837676+0000","last_clean":"2026-02-24T07:56:27.837676+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:27.837676+0000","last_undegraded":"2026-02-24T07:56:27.837676+0000","last_fullsized":"2026-02-24T07:56:27.837676+0000","mapping_epoch":82,"log_start":"94'43733","ondisk_log_start":"94'43733","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358359040,"num_objects":5469,"num_object_clones":0,"num_object_copies":16407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43745,"num_write_kb":349960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"95'42808","reported_seq":42835,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.048168+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:28.048168+0000","last_peered":"2026-02-24T07:56:28.048168+0000","last_clean":"2026-02-24T07:56:28.048168+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:28.048168+0000","last_undegraded":"2026-02-24T07:56:28.048168+0000","last_fullsized":"2026-02-24T07:56:28.048168+0000","mapping_epoch":82,"log_start":"95'42795","ondisk_log_start":"95'42795","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350683136,"num_objects":5351,"num_object_clones":0,"num_object_copies":16053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42808,"num_write_kb":342464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"95'43176","reported_seq":43251,"reported_epoch":95,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:56:28.048247+0000","last_change":"2026-02-24T07:56:26.774124+0000","last_active":"2026-02-24T07:56:28.048247+0000","last_peered":"2026-02-24T07:56:28.048247+0000","last_clean":"2026-02-24T07:56:28.048247+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:28.048247+0000","last_undegraded":"2026-02-24T07:56:28.048247+0000","last_fullsized":"2026-02-24T07:56:28.048247+0000","mapping_epoch":82,"log_start":"95'43152","ondisk_log_start":"95'43152","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":3799,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353697792,"num_objects":5397,"num_object_clones":0,"num_object_copies":16191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43176,"num_write_kb":345408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'43770","reported_seq":43803,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.836429+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:27.836429+0000","last_peered":"2026-02-24T07:56:27.836429+0000","last_clean":"2026-02-24T07:56:27.836429+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:27.836429+0000","last_undegraded":"2026-02-24T07:56:27.836429+0000","last_fullsized":"2026-02-24T07:56:27.836429+0000","mapping_epoch":82,"log_start":"94'43759","ondisk_log_start":"94'43759","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358563840,"num_objects":5472,"num_object_clones":0,"num_object_copies":16416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43770,"num_write_kb":350160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43504","reported_seq":43598,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.919395+0000","last_change":"2026-02-24T07:56:24.341831+0000","last_active":"2026-02-24T07:56:27.919395+0000","last_peered":"2026-02-24T07:56:27.919395+0000","last_clean":"2026-02-24T07:56:27.919395+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:27.919395+0000","last_undegraded":"2026-02-24T07:56:27.919395+0000","last_fullsized":"2026-02-24T07:56:27.919395+0000","mapping_epoch":82,"log_start":"95'43497","ondisk_log_start":"95'43497","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'41680","last_scrub_stamp":"2026-02-24T07:56:24.341752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.341752+0000","objects_scrubbed":5191,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:40.303719+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356384768,"num_objects":5438,"num_object_clones":0,"num_object_copies":16314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43504,"num_write_kb":348032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"94'41936","reported_seq":41971,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.835541+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:27.835541+0000","last_peered":"2026-02-24T07:56:27.835541+0000","last_clean":"2026-02-24T07:56:27.835541+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:27.835541+0000","last_undegraded":"2026-02-24T07:56:27.835541+0000","last_fullsized":"2026-02-24T07:56:27.835541+0000","mapping_epoch":82,"log_start":"94'41918","ondisk_log_start":"94'41918","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343539712,"num_objects":5242,"num_object_clones":0,"num_object_copies":15726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41936,"num_write_kb":335488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"95'43432","reported_seq":43530,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.035628+0000","last_change":"2026-02-24T07:56:25.344225+0000","last_active":"2026-02-24T07:56:28.035628+0000","last_peered":"2026-02-24T07:56:28.035628+0000","last_clean":"2026-02-24T07:56:28.035628+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:28.035628+0000","last_undegraded":"2026-02-24T07:56:28.035628+0000","last_fullsized":"2026-02-24T07:56:28.035628+0000","mapping_epoch":82,"log_start":"95'43408","ondisk_log_start":"95'43408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42059","last_scrub_stamp":"2026-02-24T07:56:25.344176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:25.344176+0000","objects_scrubbed":5205,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:28.358762+0000","scrub_duration":1536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355794944,"num_objects":5429,"num_object_clones":0,"num_object_copies":16287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43432,"num_write_kb":347456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"94'43288","reported_seq":43323,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.830289+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:27.830289+0000","last_peered":"2026-02-24T07:56:27.830289+0000","last_clean":"2026-02-24T07:56:27.830289+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:27.830289+0000","last_undegraded":"2026-02-24T07:56:27.830289+0000","last_fullsized":"2026-02-24T07:56:27.830289+0000","mapping_epoch":82,"log_start":"94'43285","ondisk_log_start":"94'43285","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354615296,"num_objects":5411,"num_object_clones":0,"num_object_copies":16233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43288,"num_write_kb":346304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"95'43960","reported_seq":43997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.036566+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:28.036566+0000","last_peered":"2026-02-24T07:56:28.036566+0000","last_clean":"2026-02-24T07:56:28.036566+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:28.036566+0000","last_undegraded":"2026-02-24T07:56:28.036566+0000","last_fullsized":"2026-02-24T07:56:28.036566+0000","mapping_epoch":82,"log_start":"95'43943","ondisk_log_start":"95'43943","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360120320,"num_objects":5495,"num_object_clones":0,"num_object_copies":16485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43960,"num_write_kb":351680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"94'43120","reported_seq":43155,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.831629+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:27.831629+0000","last_peered":"2026-02-24T07:56:27.831629+0000","last_clean":"2026-02-24T07:56:27.831629+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:27.831629+0000","last_undegraded":"2026-02-24T07:56:27.831629+0000","last_fullsized":"2026-02-24T07:56:27.831629+0000","mapping_epoch":82,"log_start":"94'43088","ondisk_log_start":"94'43088","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353239040,"num_objects":5390,"num_object_clones":0,"num_object_copies":16170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43120,"num_write_kb":344960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"94'42120","reported_seq":42214,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.846607+0000","last_change":"2026-02-24T07:56:24.272992+0000","last_active":"2026-02-24T07:56:27.846607+0000","last_peered":"2026-02-24T07:56:27.846607+0000","last_clean":"2026-02-24T07:56:27.846607+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:27.846607+0000","last_undegraded":"2026-02-24T07:56:27.846607+0000","last_fullsized":"2026-02-24T07:56:27.846607+0000","mapping_epoch":82,"log_start":"94'42107","ondisk_log_start":"94'42107","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40200","last_scrub_stamp":"2026-02-24T07:56:24.272939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.272939+0000","objects_scrubbed":5006,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:42.376406+0000","scrub_duration":568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345047040,"num_objects":5265,"num_object_clones":0,"num_object_copies":15795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42120,"num_write_kb":336960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"95'42960","reported_seq":42997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.018075+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:28.018075+0000","last_peered":"2026-02-24T07:56:28.018075+0000","last_clean":"2026-02-24T07:56:28.018075+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:28.018075+0000","last_undegraded":"2026-02-24T07:56:28.018075+0000","last_fullsized":"2026-02-24T07:56:28.018075+0000","mapping_epoch":82,"log_start":"95'42948","ondisk_log_start":"95'42948","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351928320,"num_objects":5370,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42960,"num_write_kb":343680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"95'42544","reported_seq":42581,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.914028+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:27.914028+0000","last_peered":"2026-02-24T07:56:27.914028+0000","last_clean":"2026-02-24T07:56:27.914028+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:27.914028+0000","last_undegraded":"2026-02-24T07:56:27.914028+0000","last_fullsized":"2026-02-24T07:56:27.914028+0000","mapping_epoch":82,"log_start":"95'42536","ondisk_log_start":"95'42536","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348520448,"num_objects":5318,"num_object_clones":0,"num_object_copies":15954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42544,"num_write_kb":340352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'43992","reported_seq":44027,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.852825+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:27.852825+0000","last_peered":"2026-02-24T07:56:27.852825+0000","last_clean":"2026-02-24T07:56:27.852825+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:27.852825+0000","last_undegraded":"2026-02-24T07:56:27.852825+0000","last_fullsized":"2026-02-24T07:56:27.852825+0000","mapping_epoch":82,"log_start":"94'43984","ondisk_log_start":"94'43984","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360382464,"num_objects":5499,"num_object_clones":0,"num_object_copies":16497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43992,"num_write_kb":351936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":386,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:24.853628+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:24.853628+0000","last_peered":"2026-02-24T07:56:24.853628+0000","last_clean":"2026-02-24T07:56:24.853628+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:24.853628+0000","last_undegraded":"2026-02-24T07:56:24.853628+0000","last_fullsized":"2026-02-24T07:56:24.853628+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5654675456,"num_objects":86286,"num_object_clones":0,"num_object_copies":258858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690268,"num_write_kb":5522144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16961536000,"data_stored":16961536000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215223,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4631184,"kb_used_data":3437052,"kb_used_omap":17,"kb_used_meta":1194094,"kb_avail":729372016,"statfs":{"total":751619276800,"available":746876944384,"internally_reserved":0,"allocated":3519541248,"data_stored":3518869521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18371,"internal_metadata":1222752317},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,7,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5619800,"kb_used_data":4118660,"kb_used_omap":17,"kb_used_meta":1501102,"kb_avail":728383400,"statfs":{"total":751619276800,"available":745864601600,"internally_reserved":0,"allocated":4217507840,"data_stored":4216836113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18226,"internal_metadata":1537128654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5896644,"kb_used_data":4832112,"kb_used_omap":13,"kb_used_meta":1064498,"kb_avail":728106556,"statfs":{"total":751619276800,"available":745581113344,"internally_reserved":0,"allocated":4948082688,"data_stored":4947414513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13658,"internal_metadata":1090046630},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,3,0,6,42,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705789,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5681328,"kb_used_data":4126364,"kb_used_omap":17,"kb_used_meta":1554926,"kb_avail":728321872,"statfs":{"total":751619276800,"available":745801596928,"internally_reserved":0,"allocated":4225396736,"data_stored":4224725009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17585,"internal_metadata":1592245071},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,4,24],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231372800,"data_stored":4231372800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4959936512,"data_stored":4959936512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4243611648,"data_stored":4243611648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3526615040,"data_stored":3526615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:32.300 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:32.460 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:32.636 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:32.634+0000 7fd94b69d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:32.637 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:32.634+0000 7fd94b69d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:32.794 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:32.795 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:32.843 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2026-02-24T07:56:31.818009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5655265824,"num_objects":86288,"num_object_clones":0,"num_object_copies":258864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86288,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":690403,"num_write_kb":5524294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21828956,"kb_used_data":16514188,"kb_used_omap":66,"kb_used_meta":5314621,"kb_avail":2914183844,"statfs":{"total":3006477107200,"available":2984124256256,"internally_reserved":0,"allocated":16910528512,"data_stored":16907845156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67840,"internal_metadata":5442172672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[19,3,4,45,51,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":343261184,"num_objects":5239,"num_object_clones":0,"num_object_copies":15717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41902,"num_write_kb":335216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000509"},"pg_stats":[{"pgid":"6.f","version":"95'43382","reported_seq":43477,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.049095+0000","last_change":"2026-02-24T07:56:23.502859+0000","last_active":"2026-02-24T07:56:28.049095+0000","last_peered":"2026-02-24T07:56:28.049095+0000","last_clean":"2026-02-24T07:56:28.049095+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:28.049095+0000","last_undegraded":"2026-02-24T07:56:28.049095+0000","last_fullsized":"2026-02-24T07:56:28.049095+0000","mapping_epoch":82,"log_start":"95'43376","ondisk_log_start":"95'43376","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40817","last_scrub_stamp":"2026-02-24T07:56:23.502797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:23.502797+0000","objects_scrubbed":5048,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:23.521387+0000","scrub_duration":1620,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355385344,"num_objects":5423,"num_object_clones":0,"num_object_copies":16269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43382,"num_write_kb":347056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"94'42531","reported_seq":42624,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.834371+0000","last_change":"2026-02-24T07:56:27.724495+0000","last_active":"2026-02-24T07:56:27.834371+0000","last_peered":"2026-02-24T07:56:27.834371+0000","last_clean":"2026-02-24T07:56:27.834371+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:27.834371+0000","last_undegraded":"2026-02-24T07:56:27.834371+0000","last_fullsized":"2026-02-24T07:56:27.834371+0000","mapping_epoch":82,"log_start":"94'42521","ondisk_log_start":"94'42521","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42472","last_scrub_stamp":"2026-02-24T07:56:27.724424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:27.724424+0000","objects_scrubbed":5255,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:51.044488+0000","scrub_duration":1391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348413952,"num_objects":5317,"num_object_clones":0,"num_object_copies":15951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42531,"num_write_kb":340248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"94'43745","reported_seq":43779,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.837676+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:27.837676+0000","last_peered":"2026-02-24T07:56:27.837676+0000","last_clean":"2026-02-24T07:56:27.837676+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:27.837676+0000","last_undegraded":"2026-02-24T07:56:27.837676+0000","last_fullsized":"2026-02-24T07:56:27.837676+0000","mapping_epoch":82,"log_start":"94'43733","ondisk_log_start":"94'43733","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358359040,"num_objects":5469,"num_object_clones":0,"num_object_copies":16407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43745,"num_write_kb":349960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"95'42808","reported_seq":42835,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.048168+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:28.048168+0000","last_peered":"2026-02-24T07:56:28.048168+0000","last_clean":"2026-02-24T07:56:28.048168+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:28.048168+0000","last_undegraded":"2026-02-24T07:56:28.048168+0000","last_fullsized":"2026-02-24T07:56:28.048168+0000","mapping_epoch":82,"log_start":"95'42795","ondisk_log_start":"95'42795","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350683136,"num_objects":5351,"num_object_clones":0,"num_object_copies":16053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42808,"num_write_kb":342464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"95'43176","reported_seq":43251,"reported_epoch":95,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:56:28.048247+0000","last_change":"2026-02-24T07:56:26.774124+0000","last_active":"2026-02-24T07:56:28.048247+0000","last_peered":"2026-02-24T07:56:28.048247+0000","last_clean":"2026-02-24T07:56:28.048247+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:28.048247+0000","last_undegraded":"2026-02-24T07:56:28.048247+0000","last_fullsized":"2026-02-24T07:56:28.048247+0000","mapping_epoch":82,"log_start":"95'43152","ondisk_log_start":"95'43152","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":3799,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353697792,"num_objects":5397,"num_object_clones":0,"num_object_copies":16191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43176,"num_write_kb":345408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'43770","reported_seq":43803,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.836429+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:27.836429+0000","last_peered":"2026-02-24T07:56:27.836429+0000","last_clean":"2026-02-24T07:56:27.836429+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:27.836429+0000","last_undegraded":"2026-02-24T07:56:27.836429+0000","last_fullsized":"2026-02-24T07:56:27.836429+0000","mapping_epoch":82,"log_start":"94'43759","ondisk_log_start":"94'43759","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358563840,"num_objects":5472,"num_object_clones":0,"num_object_copies":16416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43770,"num_write_kb":350160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43504","reported_seq":43598,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.919395+0000","last_change":"2026-02-24T07:56:24.341831+0000","last_active":"2026-02-24T07:56:27.919395+0000","last_peered":"2026-02-24T07:56:27.919395+0000","last_clean":"2026-02-24T07:56:27.919395+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:27.919395+0000","last_undegraded":"2026-02-24T07:56:27.919395+0000","last_fullsized":"2026-02-24T07:56:27.919395+0000","mapping_epoch":82,"log_start":"95'43497","ondisk_log_start":"95'43497","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'41680","last_scrub_stamp":"2026-02-24T07:56:24.341752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.341752+0000","objects_scrubbed":5191,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:40.303719+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356384768,"num_objects":5438,"num_object_clones":0,"num_object_copies":16314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43504,"num_write_kb":348032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"94'41936","reported_seq":41971,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.835541+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:27.835541+0000","last_peered":"2026-02-24T07:56:27.835541+0000","last_clean":"2026-02-24T07:56:27.835541+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:27.835541+0000","last_undegraded":"2026-02-24T07:56:27.835541+0000","last_fullsized":"2026-02-24T07:56:27.835541+0000","mapping_epoch":82,"log_start":"94'41918","ondisk_log_start":"94'41918","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343539712,"num_objects":5242,"num_object_clones":0,"num_object_copies":15726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41936,"num_write_kb":335488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"95'43432","reported_seq":43530,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.035628+0000","last_change":"2026-02-24T07:56:25.344225+0000","last_active":"2026-02-24T07:56:28.035628+0000","last_peered":"2026-02-24T07:56:28.035628+0000","last_clean":"2026-02-24T07:56:28.035628+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:28.035628+0000","last_undegraded":"2026-02-24T07:56:28.035628+0000","last_fullsized":"2026-02-24T07:56:28.035628+0000","mapping_epoch":82,"log_start":"95'43408","ondisk_log_start":"95'43408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42059","last_scrub_stamp":"2026-02-24T07:56:25.344176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:25.344176+0000","objects_scrubbed":5205,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:28.358762+0000","scrub_duration":1536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355794944,"num_objects":5429,"num_object_clones":0,"num_object_copies":16287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43432,"num_write_kb":347456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"94'43288","reported_seq":43323,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.830289+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:27.830289+0000","last_peered":"2026-02-24T07:56:27.830289+0000","last_clean":"2026-02-24T07:56:27.830289+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:27.830289+0000","last_undegraded":"2026-02-24T07:56:27.830289+0000","last_fullsized":"2026-02-24T07:56:27.830289+0000","mapping_epoch":82,"log_start":"94'43285","ondisk_log_start":"94'43285","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354615296,"num_objects":5411,"num_object_clones":0,"num_object_copies":16233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43288,"num_write_kb":346304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"95'43960","reported_seq":43997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.036566+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:28.036566+0000","last_peered":"2026-02-24T07:56:28.036566+0000","last_clean":"2026-02-24T07:56:28.036566+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:28.036566+0000","last_undegraded":"2026-02-24T07:56:28.036566+0000","last_fullsized":"2026-02-24T07:56:28.036566+0000","mapping_epoch":82,"log_start":"95'43943","ondisk_log_start":"95'43943","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360120320,"num_objects":5495,"num_object_clones":0,"num_object_copies":16485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43960,"num_write_kb":351680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"94'43120","reported_seq":43155,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.831629+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:27.831629+0000","last_peered":"2026-02-24T07:56:27.831629+0000","last_clean":"2026-02-24T07:56:27.831629+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:27.831629+0000","last_undegraded":"2026-02-24T07:56:27.831629+0000","last_fullsized":"2026-02-24T07:56:27.831629+0000","mapping_epoch":82,"log_start":"94'43088","ondisk_log_start":"94'43088","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353239040,"num_objects":5390,"num_object_clones":0,"num_object_copies":16170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43120,"num_write_kb":344960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"94'42120","reported_seq":42214,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.846607+0000","last_change":"2026-02-24T07:56:24.272992+0000","last_active":"2026-02-24T07:56:27.846607+0000","last_peered":"2026-02-24T07:56:27.846607+0000","last_clean":"2026-02-24T07:56:27.846607+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:27.846607+0000","last_undegraded":"2026-02-24T07:56:27.846607+0000","last_fullsized":"2026-02-24T07:56:27.846607+0000","mapping_epoch":82,"log_start":"94'42107","ondisk_log_start":"94'42107","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40200","last_scrub_stamp":"2026-02-24T07:56:24.272939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.272939+0000","objects_scrubbed":5006,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:42.376406+0000","scrub_duration":568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345047040,"num_objects":5265,"num_object_clones":0,"num_object_copies":15795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42120,"num_write_kb":336960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"95'42960","reported_seq":42997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.018075+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:28.018075+0000","last_peered":"2026-02-24T07:56:28.018075+0000","last_clean":"2026-02-24T07:56:28.018075+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:28.018075+0000","last_undegraded":"2026-02-24T07:56:28.018075+0000","last_fullsized":"2026-02-24T07:56:28.018075+0000","mapping_epoch":82,"log_start":"95'42948","ondisk_log_start":"95'42948","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351928320,"num_objects":5370,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42960,"num_write_kb":343680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"95'42544","reported_seq":42581,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.914028+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:27.914028+0000","last_peered":"2026-02-24T07:56:27.914028+0000","last_clean":"2026-02-24T07:56:27.914028+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:27.914028+0000","last_undegraded":"2026-02-24T07:56:27.914028+0000","last_fullsized":"2026-02-24T07:56:27.914028+0000","mapping_epoch":82,"log_start":"95'42536","ondisk_log_start":"95'42536","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348520448,"num_objects":5318,"num_object_clones":0,"num_object_copies":15954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42544,"num_write_kb":340352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'43992","reported_seq":44027,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.852825+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:27.852825+0000","last_peered":"2026-02-24T07:56:27.852825+0000","last_clean":"2026-02-24T07:56:27.852825+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:27.852825+0000","last_undegraded":"2026-02-24T07:56:27.852825+0000","last_fullsized":"2026-02-24T07:56:27.852825+0000","mapping_epoch":82,"log_start":"94'43984","ondisk_log_start":"94'43984","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360382464,"num_objects":5499,"num_object_clones":0,"num_object_copies":16497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43992,"num_write_kb":351936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":386,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:24.853628+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:24.853628+0000","last_peered":"2026-02-24T07:56:24.853628+0000","last_clean":"2026-02-24T07:56:24.853628+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:24.853628+0000","last_undegraded":"2026-02-24T07:56:24.853628+0000","last_fullsized":"2026-02-24T07:56:24.853628+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5654675456,"num_objects":86286,"num_object_clones":0,"num_object_copies":258858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690268,"num_write_kb":5522144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16961536000,"data_stored":16961536000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215223,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4631184,"kb_used_data":3437052,"kb_used_omap":17,"kb_used_meta":1194094,"kb_avail":729372016,"statfs":{"total":751619276800,"available":746876944384,"internally_reserved":0,"allocated":3519541248,"data_stored":3518869521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18371,"internal_metadata":1222752317},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,7,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5619800,"kb_used_data":4118660,"kb_used_omap":17,"kb_used_meta":1501102,"kb_avail":728383400,"statfs":{"total":751619276800,"available":745864601600,"internally_reserved":0,"allocated":4217507840,"data_stored":4216836113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18226,"internal_metadata":1537128654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5896644,"kb_used_data":4832112,"kb_used_omap":13,"kb_used_meta":1064498,"kb_avail":728106556,"statfs":{"total":751619276800,"available":745581113344,"internally_reserved":0,"allocated":4948082688,"data_stored":4947414513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13658,"internal_metadata":1090046630},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,3,0,6,42,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705789,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5681328,"kb_used_data":4126364,"kb_used_omap":17,"kb_used_meta":1554926,"kb_avail":728321872,"statfs":{"total":751619276800,"available":745801596928,"internally_reserved":0,"allocated":4225396736,"data_stored":4224725009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17585,"internal_metadata":1592245071},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,4,24],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231372800,"data_stored":4231372800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4959936512,"data_stored":4959936512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4243611648,"data_stored":4243611648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3526615040,"data_stored":3526615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:32.845 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:56:32.846 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:32.846 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T07:56:32.846 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:32.998 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:33.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 128 732126 731998 68.8949 63.75 0.014913 0.0145125 2026-02-24T07:56:33.134 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.131+0000 7fc47a573640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.134 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.132+0000 7fc47a573640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.135 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:32 trial016 ceph-mon[39544]: pgmap v365: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.47k op/s 2026-02-24T07:56:33.135 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:32 trial016 ceph-mon[39544]: from='client.15250 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:33.135 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:32 trial016 ceph-mon[39544]: 6.d scrub ok 2026-02-24T07:56:33.135 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:32 trial016 ceph-mon[39544]: 6.0 scrub ok 2026-02-24T07:56:33.285 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:33.286 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:33.353 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2026-02-24T07:56:31.818009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5655265824,"num_objects":86288,"num_object_clones":0,"num_object_copies":258864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86288,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":690403,"num_write_kb":5524294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21828956,"kb_used_data":16514188,"kb_used_omap":66,"kb_used_meta":5314621,"kb_avail":2914183844,"statfs":{"total":3006477107200,"available":2984124256256,"internally_reserved":0,"allocated":16910528512,"data_stored":16907845156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67840,"internal_metadata":5442172672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[19,3,4,45,51,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":343261184,"num_objects":5239,"num_object_clones":0,"num_object_copies":15717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41902,"num_write_kb":335216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000509"},"pg_stats":[{"pgid":"6.f","version":"95'43382","reported_seq":43477,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.049095+0000","last_change":"2026-02-24T07:56:23.502859+0000","last_active":"2026-02-24T07:56:28.049095+0000","last_peered":"2026-02-24T07:56:28.049095+0000","last_clean":"2026-02-24T07:56:28.049095+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:28.049095+0000","last_undegraded":"2026-02-24T07:56:28.049095+0000","last_fullsized":"2026-02-24T07:56:28.049095+0000","mapping_epoch":82,"log_start":"95'43376","ondisk_log_start":"95'43376","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40817","last_scrub_stamp":"2026-02-24T07:56:23.502797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:23.502797+0000","objects_scrubbed":5048,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:23.521387+0000","scrub_duration":1620,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355385344,"num_objects":5423,"num_object_clones":0,"num_object_copies":16269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43382,"num_write_kb":347056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"94'42531","reported_seq":42624,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.834371+0000","last_change":"2026-02-24T07:56:27.724495+0000","last_active":"2026-02-24T07:56:27.834371+0000","last_peered":"2026-02-24T07:56:27.834371+0000","last_clean":"2026-02-24T07:56:27.834371+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:27.834371+0000","last_undegraded":"2026-02-24T07:56:27.834371+0000","last_fullsized":"2026-02-24T07:56:27.834371+0000","mapping_epoch":82,"log_start":"94'42521","ondisk_log_start":"94'42521","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42472","last_scrub_stamp":"2026-02-24T07:56:27.724424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:27.724424+0000","objects_scrubbed":5255,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:51.044488+0000","scrub_duration":1391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348413952,"num_objects":5317,"num_object_clones":0,"num_object_copies":15951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42531,"num_write_kb":340248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"94'43745","reported_seq":43779,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.837676+0000","last_change":"2026-02-24T07:55:08.999920+0000","last_active":"2026-02-24T07:56:27.837676+0000","last_peered":"2026-02-24T07:56:27.837676+0000","last_clean":"2026-02-24T07:56:27.837676+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:27.837676+0000","last_undegraded":"2026-02-24T07:56:27.837676+0000","last_fullsized":"2026-02-24T07:56:27.837676+0000","mapping_epoch":82,"log_start":"94'43733","ondisk_log_start":"94'43733","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358359040,"num_objects":5469,"num_object_clones":0,"num_object_copies":16407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43745,"num_write_kb":349960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"95'42808","reported_seq":42835,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.048168+0000","last_change":"2026-02-24T07:55:09.000118+0000","last_active":"2026-02-24T07:56:28.048168+0000","last_peered":"2026-02-24T07:56:28.048168+0000","last_clean":"2026-02-24T07:56:28.048168+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:28.048168+0000","last_undegraded":"2026-02-24T07:56:28.048168+0000","last_fullsized":"2026-02-24T07:56:28.048168+0000","mapping_epoch":82,"log_start":"95'42795","ondisk_log_start":"95'42795","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:29.918110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350683136,"num_objects":5351,"num_object_clones":0,"num_object_copies":16053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42808,"num_write_kb":342464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"95'43176","reported_seq":43251,"reported_epoch":95,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:56:28.048247+0000","last_change":"2026-02-24T07:56:26.774124+0000","last_active":"2026-02-24T07:56:28.048247+0000","last_peered":"2026-02-24T07:56:28.048247+0000","last_clean":"2026-02-24T07:56:28.048247+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:28.048247+0000","last_undegraded":"2026-02-24T07:56:28.048247+0000","last_fullsized":"2026-02-24T07:56:28.048247+0000","mapping_epoch":82,"log_start":"95'43152","ondisk_log_start":"95'43152","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":3799,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353697792,"num_objects":5397,"num_object_clones":0,"num_object_copies":16191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43176,"num_write_kb":345408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'43770","reported_seq":43803,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.836429+0000","last_change":"2026-02-24T07:55:08.999486+0000","last_active":"2026-02-24T07:56:27.836429+0000","last_peered":"2026-02-24T07:56:27.836429+0000","last_clean":"2026-02-24T07:56:27.836429+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:27.836429+0000","last_undegraded":"2026-02-24T07:56:27.836429+0000","last_fullsized":"2026-02-24T07:56:27.836429+0000","mapping_epoch":82,"log_start":"94'43759","ondisk_log_start":"94'43759","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:32.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358563840,"num_objects":5472,"num_object_clones":0,"num_object_copies":16416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43770,"num_write_kb":350160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43504","reported_seq":43598,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.919395+0000","last_change":"2026-02-24T07:56:24.341831+0000","last_active":"2026-02-24T07:56:27.919395+0000","last_peered":"2026-02-24T07:56:27.919395+0000","last_clean":"2026-02-24T07:56:27.919395+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:27.919395+0000","last_undegraded":"2026-02-24T07:56:27.919395+0000","last_fullsized":"2026-02-24T07:56:27.919395+0000","mapping_epoch":82,"log_start":"95'43497","ondisk_log_start":"95'43497","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'41680","last_scrub_stamp":"2026-02-24T07:56:24.341752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.341752+0000","objects_scrubbed":5191,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:40.303719+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356384768,"num_objects":5438,"num_object_clones":0,"num_object_copies":16314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43504,"num_write_kb":348032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"94'41936","reported_seq":41971,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.835541+0000","last_change":"2026-02-24T07:55:08.997888+0000","last_active":"2026-02-24T07:56:27.835541+0000","last_peered":"2026-02-24T07:56:27.835541+0000","last_clean":"2026-02-24T07:56:27.835541+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:27.835541+0000","last_undegraded":"2026-02-24T07:56:27.835541+0000","last_fullsized":"2026-02-24T07:56:27.835541+0000","mapping_epoch":82,"log_start":"94'41918","ondisk_log_start":"94'41918","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343539712,"num_objects":5242,"num_object_clones":0,"num_object_copies":15726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41936,"num_write_kb":335488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"95'43432","reported_seq":43530,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.035628+0000","last_change":"2026-02-24T07:56:25.344225+0000","last_active":"2026-02-24T07:56:28.035628+0000","last_peered":"2026-02-24T07:56:28.035628+0000","last_clean":"2026-02-24T07:56:28.035628+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:28.035628+0000","last_undegraded":"2026-02-24T07:56:28.035628+0000","last_fullsized":"2026-02-24T07:56:28.035628+0000","mapping_epoch":82,"log_start":"95'43408","ondisk_log_start":"95'43408","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42059","last_scrub_stamp":"2026-02-24T07:56:25.344176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:25.344176+0000","objects_scrubbed":5205,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:28.358762+0000","scrub_duration":1536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355794944,"num_objects":5429,"num_object_clones":0,"num_object_copies":16287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43432,"num_write_kb":347456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"94'43288","reported_seq":43323,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.830289+0000","last_change":"2026-02-24T07:55:08.999399+0000","last_active":"2026-02-24T07:56:27.830289+0000","last_peered":"2026-02-24T07:56:27.830289+0000","last_clean":"2026-02-24T07:56:27.830289+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:27.830289+0000","last_undegraded":"2026-02-24T07:56:27.830289+0000","last_fullsized":"2026-02-24T07:56:27.830289+0000","mapping_epoch":82,"log_start":"94'43285","ondisk_log_start":"94'43285","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354615296,"num_objects":5411,"num_object_clones":0,"num_object_copies":16233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43288,"num_write_kb":346304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"95'43960","reported_seq":43997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.036566+0000","last_change":"2026-02-24T07:55:08.999967+0000","last_active":"2026-02-24T07:56:28.036566+0000","last_peered":"2026-02-24T07:56:28.036566+0000","last_clean":"2026-02-24T07:56:28.036566+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:28.036566+0000","last_undegraded":"2026-02-24T07:56:28.036566+0000","last_fullsized":"2026-02-24T07:56:28.036566+0000","mapping_epoch":82,"log_start":"95'43943","ondisk_log_start":"95'43943","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.598085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360120320,"num_objects":5495,"num_object_clones":0,"num_object_copies":16485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43960,"num_write_kb":351680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"94'43120","reported_seq":43155,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.831629+0000","last_change":"2026-02-24T07:55:08.999655+0000","last_active":"2026-02-24T07:56:27.831629+0000","last_peered":"2026-02-24T07:56:27.831629+0000","last_clean":"2026-02-24T07:56:27.831629+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:27.831629+0000","last_undegraded":"2026-02-24T07:56:27.831629+0000","last_fullsized":"2026-02-24T07:56:27.831629+0000","mapping_epoch":82,"log_start":"94'43088","ondisk_log_start":"94'43088","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:34.777588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353239040,"num_objects":5390,"num_object_clones":0,"num_object_copies":16170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43120,"num_write_kb":344960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"94'42120","reported_seq":42214,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.846607+0000","last_change":"2026-02-24T07:56:24.272992+0000","last_active":"2026-02-24T07:56:27.846607+0000","last_peered":"2026-02-24T07:56:27.846607+0000","last_clean":"2026-02-24T07:56:27.846607+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:27.846607+0000","last_undegraded":"2026-02-24T07:56:27.846607+0000","last_fullsized":"2026-02-24T07:56:27.846607+0000","mapping_epoch":82,"log_start":"94'42107","ondisk_log_start":"94'42107","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40200","last_scrub_stamp":"2026-02-24T07:56:24.272939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.272939+0000","objects_scrubbed":5006,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:42.376406+0000","scrub_duration":568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345047040,"num_objects":5265,"num_object_clones":0,"num_object_copies":15795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42120,"num_write_kb":336960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"95'42960","reported_seq":42997,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:28.018075+0000","last_change":"2026-02-24T07:55:08.999574+0000","last_active":"2026-02-24T07:56:28.018075+0000","last_peered":"2026-02-24T07:56:28.018075+0000","last_clean":"2026-02-24T07:56:28.018075+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:28.018075+0000","last_undegraded":"2026-02-24T07:56:28.018075+0000","last_fullsized":"2026-02-24T07:56:28.018075+0000","mapping_epoch":82,"log_start":"95'42948","ondisk_log_start":"95'42948","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:33.585526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351928320,"num_objects":5370,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42960,"num_write_kb":343680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"95'42544","reported_seq":42581,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.914028+0000","last_change":"2026-02-24T07:55:08.998763+0000","last_active":"2026-02-24T07:56:27.914028+0000","last_peered":"2026-02-24T07:56:27.914028+0000","last_clean":"2026-02-24T07:56:27.914028+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:27.914028+0000","last_undegraded":"2026-02-24T07:56:27.914028+0000","last_fullsized":"2026-02-24T07:56:27.914028+0000","mapping_epoch":82,"log_start":"95'42536","ondisk_log_start":"95'42536","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:31.229309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348520448,"num_objects":5318,"num_object_clones":0,"num_object_copies":15954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42544,"num_write_kb":340352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'43992","reported_seq":44027,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:27.852825+0000","last_change":"2026-02-24T07:55:08.998772+0000","last_active":"2026-02-24T07:56:27.852825+0000","last_peered":"2026-02-24T07:56:27.852825+0000","last_clean":"2026-02-24T07:56:27.852825+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:27.852825+0000","last_undegraded":"2026-02-24T07:56:27.852825+0000","last_fullsized":"2026-02-24T07:56:27.852825+0000","mapping_epoch":82,"log_start":"94'43984","ondisk_log_start":"94'43984","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:55:07.985997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:56:36.649543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360382464,"num_objects":5499,"num_object_clones":0,"num_object_copies":16497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43992,"num_write_kb":351936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":386,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-24T07:56:24.853628+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:24.853628+0000","last_peered":"2026-02-24T07:56:24.853628+0000","last_clean":"2026-02-24T07:56:24.853628+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:24.853628+0000","last_undegraded":"2026-02-24T07:56:24.853628+0000","last_fullsized":"2026-02-24T07:56:24.853628+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5654675456,"num_objects":86286,"num_object_clones":0,"num_object_copies":258858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690268,"num_write_kb":5522144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16961536000,"data_stored":16961536000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215223,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4631184,"kb_used_data":3437052,"kb_used_omap":17,"kb_used_meta":1194094,"kb_avail":729372016,"statfs":{"total":751619276800,"available":746876944384,"internally_reserved":0,"allocated":3519541248,"data_stored":3518869521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18371,"internal_metadata":1222752317},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,7,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5619800,"kb_used_data":4118660,"kb_used_omap":17,"kb_used_meta":1501102,"kb_avail":728383400,"statfs":{"total":751619276800,"available":745864601600,"internally_reserved":0,"allocated":4217507840,"data_stored":4216836113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18226,"internal_metadata":1537128654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5896644,"kb_used_data":4832112,"kb_used_omap":13,"kb_used_meta":1064498,"kb_avail":728106556,"statfs":{"total":751619276800,"available":745581113344,"internally_reserved":0,"allocated":4948082688,"data_stored":4947414513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13658,"internal_metadata":1090046630},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,3,0,6,42,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705789,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5681328,"kb_used_data":4126364,"kb_used_omap":17,"kb_used_meta":1554926,"kb_avail":728321872,"statfs":{"total":751619276800,"available":745801596928,"internally_reserved":0,"allocated":4225396736,"data_stored":4224725009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17585,"internal_metadata":1592245071},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,4,24],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7166,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231372800,"data_stored":4231372800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4959936512,"data_stored":4959936512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4243611648,"data_stored":4243611648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3526615040,"data_stored":3526615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:33.356 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 66 2026-02-24T07:56:33.502 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:33.636 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.633+0000 7ff61491c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.636 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.633+0000 7ff61491c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.699 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:33.784 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:56:33.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:56:33.846 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:33.974 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.972+0000 7f394a0d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.974 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:33.972+0000 7f394a0d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:33.990 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:33.990 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:34.006 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:34.006 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:34.020 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:34.021 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:34.035 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:34.036 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:34.036 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:33 trial016 ceph-mon[39544]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:34.036 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4212143785' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "66"} : dispatch 2026-02-24T07:56:34.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 128 741375 741247 68.9349 72.2578 0.00323618 0.014503 2026-02-24T07:56:35.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 750516 750388 68.964 71.4141 0.00920557 0.0144981 2026-02-24T07:56:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:34 trial016 ceph-mon[39544]: from='client.15254 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:35.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:34 trial016 ceph-mon[39544]: 6.c scrub starts 2026-02-24T07:56:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:34 trial016 ceph-mon[39544]: pgmap v366: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.31k op/s 2026-02-24T07:56:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3356805927' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:35.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:36.083 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:36.090 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 128 759556 759428 68.9833 70.625 0.0258797 0.0144935 2026-02-24T07:56:36.229 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:36.353 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:36.350+0000 7f33fc2f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:36.353 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:36.350+0000 7f33fc2f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:36.368 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:36.368 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:36.386 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:36.387 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:36.404 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:36.404 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:36.417 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:36.418 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:37.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 127 768633 768506 69.0055 70.9219 0.0132892 0.0144891 2026-02-24T07:56:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:36 trial016 ceph-mon[39544]: 6.c scrub ok 2026-02-24T07:56:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:36 trial016 ceph-mon[39544]: pgmap v367: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.83k op/s 2026-02-24T07:56:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3684146661' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:36 trial016 ceph-mon[39544]: 6.a scrub starts 2026-02-24T07:56:38.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 127 777115 776988 68.9743 66.2656 0.0105464 0.0144956 2026-02-24T07:56:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:37 trial016 ceph-mon[39544]: 6.1 scrub starts 2026-02-24T07:56:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:37 trial016 ceph-mon[39544]: 6.3 scrub starts 2026-02-24T07:56:38.467 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:38.618 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:38.753 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:38.750+0000 7f34a3d32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:38.754 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:38.751+0000 7f34a3d32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:38.768 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:38.768 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:38.795 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:38.795 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:38.815 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:38.816 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:38.830 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:38.830 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:38.832 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:38.832 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:38.832 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:56:38.832 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:56:38.985 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:39.012 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:38 trial016 ceph-mon[39544]: pgmap v368: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 39 MiB/s wr, 5.05k op/s 2026-02-24T07:56:39.013 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:38 trial016 ceph-mon[39544]: osdmap e99: 4 total, 4 up, 4 in 2026-02-24T07:56:39.013 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:38 trial016 ceph-mon[39544]: 6.a scrub ok 2026-02-24T07:56:39.013 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:38 trial016 ceph-mon[39544]: 6.1 scrub ok 2026-02-24T07:56:39.013 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1138476026' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:39.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 785840 785712 68.965 68.1562 0.00700087 0.0144974 2026-02-24T07:56:39.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.111+0000 7fe146c7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.111+0000 7fe146c7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:56:39.135 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:56:39.136 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:56:39.136 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:56:39.136 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:56:39.136 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:56:39.136 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:56:39.174 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:56:39.175 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:56:39.175 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:56:39.325 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:39.458 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.455+0000 7fb904447640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.458 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.455+0000 7fb904447640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:56:39.496 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:56:39.497 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:56:39.497 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:56:39.497 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:56:39.497 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:56:39.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:56:39.536 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:56:39.536 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:56:39.686 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:39.818 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.815+0000 7f2920569640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.818 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:39.815+0000 7f2920569640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:56:39.843 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:56:39.844 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:56:39.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:56:39.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:56:39.883 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:56:40.032 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:40.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 2 794731 794729 68.9814 70.4453 0.0119923 0.0144948 2026-02-24T07:56:40.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:40.162+0000 7f286726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:40.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:40.162+0000 7f286726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:40.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:39 trial016 ceph-mon[39544]: 6.3 scrub ok 2026-02-24T07:56:40.164 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:39 trial016 ceph-mon[39544]: osdmap e100: 4 total, 4 up, 4 in 2026-02-24T07:56:40.182 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:56:40.182 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:56:40.182 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:56:40.183 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:56:40.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:56:40.214 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:56:40.881 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:41.003 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:41.091 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0073 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 794731 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 68.9815 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 7.59351 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 84.2734 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 45.2031 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 8829 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 971.97 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 10787 2026-02-24T07:56:41.092 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 5786 2026-02-24T07:56:41.093 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0144948 2026-02-24T07:56:41.093 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.00897093 2026-02-24T07:56:41.093 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.142031 2026-02-24T07:56:41.093 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000575227 2026-02-24T07:56:41.093 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:56:41.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:41.116+0000 7fa7cfd1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:41.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:41.116+0000 7fa7cfd1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:41.135 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:41.135 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:41.157 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:41.158 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:41.159 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:40 trial016 ceph-mon[39544]: 6.7 scrub starts 2026-02-24T07:56:41.159 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:40 trial016 ceph-mon[39544]: pgmap v370: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.9 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 75 MiB/s wr, 9.56k op/s 2026-02-24T07:56:41.172 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:41.173 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:41.187 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:41.187 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:42.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:41 trial016 ceph-mon[39544]: 6.7 scrub ok 2026-02-24T07:56:42.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:41 trial016 ceph-mon[39544]: 6.4 scrub starts 2026-02-24T07:56:42.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:41 trial016 ceph-mon[39544]: 6.4 scrub ok 2026-02-24T07:56:42.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/751954224' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:43.236 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:43.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:42 trial016 ceph-mon[39544]: pgmap v372: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.9 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 44 MiB/s wr, 5.61k op/s 2026-02-24T07:56:43.388 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:43.513 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:43.511+0000 7ff9effb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:43.513 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:43.511+0000 7ff9effb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:43.531 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:43.531 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:43.554 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:43.554 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:43.580 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:43.580 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:43.594 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:43.594 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:44.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1876974016' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:45.215 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:45.215 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:56:45.215 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T07:56:45.216 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:45.241 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:44 trial016 ceph-mon[39544]: pgmap v373: 17 pgs: 17 active+clean; 5.0 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 63 MiB/s wr, 10.26k op/s 2026-02-24T07:56:45.241 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:45.366 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:45.505 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:45.503+0000 7f7936fc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:45.506 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:45.503+0000 7f7936fc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:45.640 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:45.664 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:45.665 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:45.742 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2026-02-24T07:56:43.819575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5330068024,"num_objects":81325,"num_object_clones":0,"num_object_copies":243975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81325,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":812887,"num_write_kb":6359999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22361360,"kb_used_data":16179264,"kb_used_omap":79,"kb_used_meta":6181936,"kb_avail":2913651440,"statfs":{"total":3006477107200,"available":2983579074560,"internally_reserved":0,"allocated":16567566336,"data_stored":16564682004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81824,"internal_metadata":6330302560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,7,11,21,23],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-656310248,"num_objects":-10015,"num_object_clones":0,"num_object_copies":-30045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10015,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":82065,"num_write_kb":512353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000976"},"pg_stats":[{"pgid":"6.f","version":"100'51142","reported_seq":51242,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.051447+0000","last_change":"2026-02-24T07:56:23.502859+0000","last_active":"2026-02-24T07:56:43.051447+0000","last_peered":"2026-02-24T07:56:43.051447+0000","last_clean":"2026-02-24T07:56:43.051447+0000","last_became_active":"2026-02-24T07:55:08.999416+0000","last_became_peered":"2026-02-24T07:55:08.999416+0000","last_unstale":"2026-02-24T07:56:43.051447+0000","last_undegraded":"2026-02-24T07:56:43.051447+0000","last_fullsized":"2026-02-24T07:56:43.051447+0000","mapping_epoch":82,"log_start":"100'51131","ondisk_log_start":"100'51131","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40817","last_scrub_stamp":"2026-02-24T07:56:23.502797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:23.502797+0000","objects_scrubbed":5048,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:23.521387+0000","scrub_duration":1620,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335937536,"num_objects":5126,"num_object_clones":0,"num_object_copies":15378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51142,"num_write_kb":400128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"100'49941","reported_seq":50047,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.836312+0000","last_change":"2026-02-24T07:56:27.724495+0000","last_active":"2026-02-24T07:56:42.836312+0000","last_peered":"2026-02-24T07:56:42.836312+0000","last_clean":"2026-02-24T07:56:42.836312+0000","last_became_active":"2026-02-24T07:55:08.998708+0000","last_became_peered":"2026-02-24T07:55:08.998708+0000","last_unstale":"2026-02-24T07:56:42.836312+0000","last_undegraded":"2026-02-24T07:56:42.836312+0000","last_fullsized":"2026-02-24T07:56:42.836312+0000","mapping_epoch":82,"log_start":"100'49938","ondisk_log_start":"100'49938","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42472","last_scrub_stamp":"2026-02-24T07:56:27.724424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:27.724424+0000","objects_scrubbed":5255,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:51.044488+0000","scrub_duration":1391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330522624,"num_objects":5044,"num_object_clones":0,"num_object_copies":15132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49941,"num_write_kb":391000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"100'51703","reported_seq":51814,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.837369+0000","last_change":"2026-02-24T07:56:32.560441+0000","last_active":"2026-02-24T07:56:42.837369+0000","last_peered":"2026-02-24T07:56:42.837369+0000","last_clean":"2026-02-24T07:56:42.837369+0000","last_became_active":"2026-02-24T07:55:08.999155+0000","last_became_peered":"2026-02-24T07:55:08.999155+0000","last_unstale":"2026-02-24T07:56:42.837369+0000","last_undegraded":"2026-02-24T07:56:42.837369+0000","last_fullsized":"2026-02-24T07:56:42.837369+0000","mapping_epoch":82,"log_start":"100'51696","ondisk_log_start":"100'51696","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'46232","last_scrub_stamp":"2026-02-24T07:56:32.560383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:32.560383+0000","objects_scrubbed":5724,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:46.295195+0000","scrub_duration":2183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339345432,"num_objects":5179,"num_object_clones":0,"num_object_copies":15537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5179,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":51703,"num_write_kb":404481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"100'49909","reported_seq":50013,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.050666+0000","last_change":"2026-02-24T07:56:35.709930+0000","last_active":"2026-02-24T07:56:43.050666+0000","last_peered":"2026-02-24T07:56:43.050666+0000","last_clean":"2026-02-24T07:56:43.050666+0000","last_became_active":"2026-02-24T07:55:08.999850+0000","last_became_peered":"2026-02-24T07:55:08.999850+0000","last_unstale":"2026-02-24T07:56:43.050666+0000","last_undegraded":"2026-02-24T07:56:43.050666+0000","last_fullsized":"2026-02-24T07:56:43.050666+0000","mapping_epoch":82,"log_start":"100'49898","ondisk_log_start":"100'49898","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'46368","last_scrub_stamp":"2026-02-24T07:56:35.709855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:35.709855+0000","objects_scrubbed":5733,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:51.232673+0000","scrub_duration":1940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":4928,"num_object_clones":0,"num_object_copies":14784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49909,"num_write_kb":389952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"100'50751","reported_seq":50844,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.052632+0000","last_change":"2026-02-24T07:56:28.738928+0000","last_active":"2026-02-24T07:56:43.052632+0000","last_peered":"2026-02-24T07:56:43.052632+0000","last_clean":"2026-02-24T07:56:43.052632+0000","last_became_active":"2026-02-24T07:55:08.999778+0000","last_became_peered":"2026-02-24T07:55:08.999778+0000","last_unstale":"2026-02-24T07:56:43.052632+0000","last_undegraded":"2026-02-24T07:56:43.052632+0000","last_fullsized":"2026-02-24T07:56:43.052632+0000","mapping_epoch":82,"log_start":"100'50729","ondisk_log_start":"100'50729","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'43552","last_scrub_stamp":"2026-02-24T07:56:28.738855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:28.738855+0000","objects_scrubbed":5373,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:44.988152+0000","scrub_duration":1964,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327352320,"num_objects":4995,"num_object_clones":0,"num_object_copies":14985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50751,"num_write_kb":396416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'51939","reported_seq":52053,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.837419+0000","last_change":"2026-02-24T07:56:38.172601+0000","last_active":"2026-02-24T07:56:42.837419+0000","last_peered":"2026-02-24T07:56:42.837419+0000","last_clean":"2026-02-24T07:56:42.837419+0000","last_became_active":"2026-02-24T07:55:08.998766+0000","last_became_peered":"2026-02-24T07:55:08.998766+0000","last_unstale":"2026-02-24T07:56:42.837419+0000","last_undegraded":"2026-02-24T07:56:42.837419+0000","last_fullsized":"2026-02-24T07:56:42.837419+0000","mapping_epoch":82,"log_start":"100'51930","ondisk_log_start":"100'51930","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'49754","last_scrub_stamp":"2026-02-24T07:56:38.172555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:38.172555+0000","objects_scrubbed":6148,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:48.631493+0000","scrub_duration":1823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346226688,"num_objects":5283,"num_object_clones":0,"num_object_copies":15849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51939,"num_write_kb":406912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'51095","reported_seq":51198,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.921615+0000","last_change":"2026-02-24T07:56:24.341831+0000","last_active":"2026-02-24T07:56:42.921615+0000","last_peered":"2026-02-24T07:56:42.921615+0000","last_clean":"2026-02-24T07:56:42.921615+0000","last_became_active":"2026-02-24T07:55:08.999042+0000","last_became_peered":"2026-02-24T07:55:08.999042+0000","last_unstale":"2026-02-24T07:56:42.921615+0000","last_undegraded":"2026-02-24T07:56:42.921615+0000","last_fullsized":"2026-02-24T07:56:42.921615+0000","mapping_epoch":82,"log_start":"100'51091","ondisk_log_start":"100'51091","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'41680","last_scrub_stamp":"2026-02-24T07:56:24.341752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.341752+0000","objects_scrubbed":5191,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:40.303719+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336658432,"num_objects":5137,"num_object_clones":0,"num_object_copies":15411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51095,"num_write_kb":399872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"100'49514","reported_seq":49619,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.846712+0000","last_change":"2026-02-24T07:56:31.045562+0000","last_active":"2026-02-24T07:56:42.846712+0000","last_peered":"2026-02-24T07:56:42.846712+0000","last_clean":"2026-02-24T07:56:42.846712+0000","last_became_active":"2026-02-24T07:55:08.997728+0000","last_became_peered":"2026-02-24T07:55:08.997728+0000","last_unstale":"2026-02-24T07:56:42.846712+0000","last_undegraded":"2026-02-24T07:56:42.846712+0000","last_fullsized":"2026-02-24T07:56:42.846712+0000","mapping_epoch":82,"log_start":"100'49510","ondisk_log_start":"100'49510","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'43480","last_scrub_stamp":"2026-02-24T07:56:31.045473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:31.045473+0000","objects_scrubbed":5398,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:46.565097+0000","scrub_duration":1415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330563584,"num_objects":5044,"num_object_clones":0,"num_object_copies":15132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49514,"num_write_kb":387968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"100'51083","reported_seq":51185,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.047161+0000","last_change":"2026-02-24T07:56:25.344225+0000","last_active":"2026-02-24T07:56:43.047161+0000","last_peered":"2026-02-24T07:56:43.047161+0000","last_clean":"2026-02-24T07:56:43.047161+0000","last_became_active":"2026-02-24T07:55:08.998532+0000","last_became_peered":"2026-02-24T07:55:08.998532+0000","last_unstale":"2026-02-24T07:56:43.047161+0000","last_undegraded":"2026-02-24T07:56:43.047161+0000","last_fullsized":"2026-02-24T07:56:43.047161+0000","mapping_epoch":82,"log_start":"100'51076","ondisk_log_start":"100'51076","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42059","last_scrub_stamp":"2026-02-24T07:56:25.344176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:25.344176+0000","objects_scrubbed":5205,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:28.358762+0000","scrub_duration":1536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329777152,"num_objects":5032,"num_object_clones":0,"num_object_copies":15096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51083,"num_write_kb":399040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"100'51060","reported_seq":51170,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.846500+0000","last_change":"2026-02-24T07:56:30.081384+0000","last_active":"2026-02-24T07:56:42.846500+0000","last_peered":"2026-02-24T07:56:42.846500+0000","last_clean":"2026-02-24T07:56:42.846500+0000","last_became_active":"2026-02-24T07:55:08.998698+0000","last_became_peered":"2026-02-24T07:55:08.998698+0000","last_unstale":"2026-02-24T07:56:42.846500+0000","last_undegraded":"2026-02-24T07:56:42.846500+0000","last_fullsized":"2026-02-24T07:56:42.846500+0000","mapping_epoch":82,"log_start":"100'51057","ondisk_log_start":"100'51057","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'44624","last_scrub_stamp":"2026-02-24T07:56:30.081336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:30.081336+0000","objects_scrubbed":5561,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:58.490286+0000","scrub_duration":685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336592896,"num_objects":5136,"num_object_clones":0,"num_object_copies":15408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51060,"num_write_kb":399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"100'51101","reported_seq":51208,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.051804+0000","last_change":"2026-02-24T07:56:41.012951+0000","last_active":"2026-02-24T07:56:43.051804+0000","last_peered":"2026-02-24T07:56:43.051804+0000","last_clean":"2026-02-24T07:56:43.051804+0000","last_became_active":"2026-02-24T07:55:08.999597+0000","last_became_peered":"2026-02-24T07:55:08.999597+0000","last_unstale":"2026-02-24T07:56:43.051804+0000","last_undegraded":"2026-02-24T07:56:43.051804+0000","last_fullsized":"2026-02-24T07:56:43.051804+0000","mapping_epoch":82,"log_start":"100'51087","ondisk_log_start":"100'51087","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'49880","last_scrub_stamp":"2026-02-24T07:56:41.012904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:41.012904+0000","objects_scrubbed":6235,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:56.555531+0000","scrub_duration":303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328597504,"num_objects":5014,"num_object_clones":0,"num_object_copies":15042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51101,"num_write_kb":399040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"100'50262","reported_seq":50375,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.838214+0000","last_change":"2026-02-24T07:56:39.149773+0000","last_active":"2026-02-24T07:56:42.838214+0000","last_peered":"2026-02-24T07:56:42.838214+0000","last_clean":"2026-02-24T07:56:42.838214+0000","last_became_active":"2026-02-24T07:55:08.999121+0000","last_became_peered":"2026-02-24T07:55:08.999121+0000","last_unstale":"2026-02-24T07:56:42.838214+0000","last_undegraded":"2026-02-24T07:56:42.838214+0000","last_fullsized":"2026-02-24T07:56:42.838214+0000","mapping_epoch":82,"log_start":"100'50255","ondisk_log_start":"100'50255","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'48848","last_scrub_stamp":"2026-02-24T07:56:39.149750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:39.149750+0000","objects_scrubbed":6052,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:58.997745+0000","scrub_duration":1807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335216640,"num_objects":5115,"num_object_clones":0,"num_object_copies":15345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50262,"num_write_kb":393792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"100'49991","reported_seq":50096,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.860211+0000","last_change":"2026-02-24T07:56:24.272992+0000","last_active":"2026-02-24T07:56:42.860211+0000","last_peered":"2026-02-24T07:56:42.860211+0000","last_clean":"2026-02-24T07:56:42.860211+0000","last_became_active":"2026-02-24T07:55:08.998410+0000","last_became_peered":"2026-02-24T07:55:08.998410+0000","last_unstale":"2026-02-24T07:56:42.860211+0000","last_undegraded":"2026-02-24T07:56:42.860211+0000","last_fullsized":"2026-02-24T07:56:42.860211+0000","mapping_epoch":82,"log_start":"100'49988","ondisk_log_start":"100'49988","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'40200","last_scrub_stamp":"2026-02-24T07:56:24.272939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:24.272939+0000","objects_scrubbed":5006,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:42.376406+0000","scrub_duration":568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328794112,"num_objects":5017,"num_object_clones":0,"num_object_copies":15051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49991,"num_write_kb":391168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"100'50688","reported_seq":50799,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:43.048300+0000","last_change":"2026-02-24T07:56:38.193134+0000","last_active":"2026-02-24T07:56:43.048300+0000","last_peered":"2026-02-24T07:56:43.048300+0000","last_clean":"2026-02-24T07:56:43.048300+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:43.048300+0000","last_undegraded":"2026-02-24T07:56:43.048300+0000","last_fullsized":"2026-02-24T07:56:43.048300+0000","mapping_epoch":82,"log_start":"100'50677","ondisk_log_start":"100'50677","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'48424","last_scrub_stamp":"2026-02-24T07:56:38.193064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:38.193064+0000","objects_scrubbed":6011,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:59.778214+0000","scrub_duration":1458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326172672,"num_objects":4977,"num_object_clones":0,"num_object_copies":14931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4977,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50688,"num_write_kb":395840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"100'50601","reported_seq":50710,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.915732+0000","last_change":"2026-02-24T07:56:32.659730+0000","last_active":"2026-02-24T07:56:42.915732+0000","last_peered":"2026-02-24T07:56:42.915732+0000","last_clean":"2026-02-24T07:56:42.915732+0000","last_became_active":"2026-02-24T07:55:08.998544+0000","last_became_peered":"2026-02-24T07:55:08.998544+0000","last_unstale":"2026-02-24T07:56:42.915732+0000","last_undegraded":"2026-02-24T07:56:42.915732+0000","last_fullsized":"2026-02-24T07:56:42.915732+0000","mapping_epoch":82,"log_start":"100'50598","ondisk_log_start":"100'50598","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'45112","last_scrub_stamp":"2026-02-24T07:56:32.659647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:32.659647+0000","objects_scrubbed":5592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.211839+0000","scrub_duration":948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331874304,"num_objects":5064,"num_object_clones":0,"num_object_copies":15192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50601,"num_write_kb":395840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"100'51972","reported_seq":52088,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:42.847087+0000","last_change":"2026-02-24T07:56:40.268329+0000","last_active":"2026-02-24T07:56:42.847087+0000","last_peered":"2026-02-24T07:56:42.847087+0000","last_clean":"2026-02-24T07:56:42.847087+0000","last_became_active":"2026-02-24T07:55:08.998447+0000","last_became_peered":"2026-02-24T07:55:08.998447+0000","last_unstale":"2026-02-24T07:56:42.847087+0000","last_undegraded":"2026-02-24T07:56:42.847087+0000","last_fullsized":"2026-02-24T07:56:42.847087+0000","mapping_epoch":82,"log_start":"100'51960","ondisk_log_start":"100'51960","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'50848","last_scrub_stamp":"2026-02-24T07:56:40.268272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:55:07.985997+0000","last_clean_scrub_stamp":"2026-02-24T07:56:40.268272+0000","objects_scrubbed":6346,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:57.290976+0000","scrub_duration":723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342884352,"num_objects":5232,"num_object_clones":0,"num_object_copies":15696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51972,"num_write_kb":406784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":398,"reported_epoch":100,"state":"active+clean","last_fresh":"2026-02-24T07:56:39.860135+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:39.860135+0000","last_peered":"2026-02-24T07:56:39.860135+0000","last_clean":"2026-02-24T07:56:39.860135+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:39.860135+0000","last_undegraded":"2026-02-24T07:56:39.860135+0000","last_fullsized":"2026-02-24T07:56:39.860135+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5329477656,"num_objects":81323,"num_object_clones":0,"num_object_copies":243969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81323,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":812752,"num_write_kb":6357849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15995457536,"data_stored":15995445320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7282,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215226,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4813472,"kb_used_data":3420812,"kb_used_omap":20,"kb_used_meta":1392619,"kb_avail":729189728,"statfs":{"total":751619276800,"available":746690281472,"internally_reserved":0,"allocated":3502911488,"data_stored":3502192571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20619,"internal_metadata":1426042741},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,2,1,8,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444155,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5860348,"kb_used_data":4177704,"kb_used_omap":21,"kb_used_meta":1682602,"kb_avail":728142852,"statfs":{"total":751619276800,"available":745618280448,"internally_reserved":0,"allocated":4277968896,"data_stored":4277245907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22138,"internal_metadata":1722984838},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5965048,"kb_used_data":4647844,"kb_used_omap":17,"kb_used_meta":1317166,"kb_avail":728038152,"statfs":{"total":751619276800,"available":745511067648,"internally_reserved":0,"allocated":4759392256,"data_stored":4758672819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17570,"internal_metadata":1348778846},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,5,10,13,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705792,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5722492,"kb_used_data":3932904,"kb_used_omap":20,"kb_used_meta":1789547,"kb_avail":728280708,"statfs":{"total":751619276800,"available":745759444992,"internally_reserved":0,"allocated":4027293696,"data_stored":4026570707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21497,"internal_metadata":1832496135},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7282,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3989794816,"data_stored":3989790744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4601114624,"data_stored":4601110552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4040847360,"data_stored":4040843288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3363700736,"data_stored":3363700736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:56:45.744 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 66 2026-02-24T07:56:45.795 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:45.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:45.922+0000 7fc509bb5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:45.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:45.922+0000 7fc509bb5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:45.934 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:45.940 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:45.940 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:45.958 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:45.958 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:45.973 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:45.973 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:45.985 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:45.985 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:46.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:46.070+0000 7f513ee40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:46.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:46.070+0000 7f513ee40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:46.222 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:56:46.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:56:47.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:46 trial016 ceph-mon[39544]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:56:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:46 trial016 ceph-mon[39544]: pgmap v374: 17 pgs: 17 active+clean; 5.0 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 63 MiB/s wr, 10.25k op/s 2026-02-24T07:56:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:46 trial016 ceph-mon[39544]: osdmap e101: 4 total, 4 up, 4 in 2026-02-24T07:56:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/512801350' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:47.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3584351645' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "66"} : dispatch 2026-02-24T07:56:48.035 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:48.188 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:48.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:48.373+0000 7f9007586640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:48.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:48.373+0000 7f9007586640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:48.391 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:48.391 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:48.418 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:48.418 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:48.432 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:48.433 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:48.446 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:48.447 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:48 trial016 ceph-mon[39544]: pgmap v376: 17 pgs: 17 active+clean; 5.0 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 19 MiB/s wr, 4.64k op/s 2026-02-24T07:56:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2579552551' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:50.496 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:50.650 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:50.779 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:50.777+0000 7f62f0844640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:50.780 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:50.777+0000 7f62f0844640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:50.798 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:50.798 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:50.812 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:50.812 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:50.829 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:50.829 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:50.842 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:50.842 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:50 trial016 ceph-mon[39544]: pgmap v377: 17 pgs: 17 active+clean; 1.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 15 MiB/s wr, 8.79k op/s 2026-02-24T07:56:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:50 trial016 ceph-mon[39544]: osdmap e102: 4 total, 4 up, 4 in 2026-02-24T07:56:51.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1893872619' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:51.114 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 99342 objects 2026-02-24T07:56:51.114 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :10.0212 2026-02-24T07:56:51.271 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:56:51.272 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:56:51.388 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:51.487 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:51.484+0000 7f2ffb69f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:51.487 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:51.485+0000 7f2ffb69f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:51.864 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:56:51.906 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:56:52.022 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:52.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:52.116+0000 7f8f921a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:52.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3279245241' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:56:52.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:52.117+0000 7f8f921a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:52.864 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:56:52.890 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:56:53.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:52 trial016 ceph-mon[39544]: pgmap v379: 17 pgs: 17 active+clean; 1.9 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.30k op/s 2026-02-24T07:56:53.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3279245241' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:56:53.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:52 trial016 ceph-mon[39544]: osdmap e103: 4 total, 4 up, 4 in 2026-02-24T07:56:53.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1803640177' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:56:53.467 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:53.549 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:56:53.667 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:53.759 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-24T07:56:53.760 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-24T07:56:54.043 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:54.043 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:54.043 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:54.043 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:53.958+0000 7f2ed8594640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:53.958+0000 7f2ed8594640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:54.044 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:54.044 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1803640177' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:56:54.044 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:53 trial016 ceph-mon[39544]: osdmap e104: 4 total, 4 up, 4 in 2026-02-24T07:56:54.731 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:54.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:54.872+0000 7fe12d76a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:54.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:54.873+0000 7fe12d76a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:54.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:54.963+0000 7feecad7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:54.966 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:54.963+0000 7feecad7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:55.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:54 trial016 ceph-mon[39544]: pgmap v382: 17 pgs: 17 active+clean; 577 KiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 13.55k op/s 2026-02-24T07:56:55.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3663479638' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:55.067 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:56:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:56:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:56:55.871 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_4' removed 2026-02-24T07:56:55.872 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:56:56.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2379174168' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:56:56.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4244087913' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:56:56.634 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:56:56.634 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:56:56.635 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_5 2026-02-24T07:56:56.635 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_5 16 2026-02-24T07:56:56.757 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:56:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:56 trial016 ceph-mon[39544]: pgmap v383: 17 pgs: 17 active+clean; 577 KiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.14k op/s 2026-02-24T07:56:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2379174168' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:56:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:56 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4244087913' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:56:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:56 trial016 ceph-mon[39544]: osdmap e105: 4 total, 4 up, 4 in 2026-02-24T07:56:57.384 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:57.393 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:56:57.404 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:57.792 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:57.789+0000 7fa2f9be9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:57.792 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:57.789+0000 7fa2f9be9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:57.847 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:57.845+0000 7fcd21a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:57.847 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:57.845+0000 7fcd21a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:57.848 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:57.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:56:57.860 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:56:57.871 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:56:57.872 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:56:57.884 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:56:57.884 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:56:57.897 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:56:57.897 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:57.906 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2747161111' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:56:58.032 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:58.030+0000 7f5d44e8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:58.032 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:58.030+0000 7f5d44e8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:58.878 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:56:58.879 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_5' created 2026-02-24T07:56:59.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial043 to 43559M 2026-02-24T07:56:59.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: pgmap v385: 1 pgs: 1 active+clean; 577 KiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:56:59.154 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2177614553' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2925737651' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:56:59.155 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:56:59.522 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:56:59.522 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:56:59.567 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2026-02-24T07:56:59.639 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:59.683 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:56:59.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:59.806+0000 7fd2ab577640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:59.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:59.806+0000 7fd2ab577640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:59.842 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:59.840+0000 7f0afc4f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:59.842 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:56:59.840+0000 7f0afc4f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:56:59.922 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:56:59.922 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:56:59.961 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2026-02-24T07:56:59.878023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":6448588,"kb_used_data":5884,"kb_used_omap":95,"kb_used_meta":6442528,"kb_avail":2929564212,"statfs":{"total":3006477107200,"available":2999873753088,"internally_reserved":0,"allocated":6025216,"data_stored":3357692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97836,"internal_metadata":6597149140},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-894075,"num_write_kb":-6357849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.053855"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":408,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T07:56:56.072725+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:56.072725+0000","last_peered":"2026-02-24T07:56:56.072725+0000","last_clean":"2026-02-24T07:56:56.072725+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:56.072725+0000","last_undegraded":"2026-02-24T07:56:56.072725+0000","last_fullsized":"2026-02-24T07:56:56.072725+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1448420,"kb_used_data":1616,"kb_used_omap":25,"kb_used_meta":1446758,"kb_avail":732554780,"statfs":{"total":751619276800,"available":750136094720,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26199,"internal_metadata":1481480617},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1836516,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1834855,"kb_avail":732166684,"statfs":{"total":751619276800,"available":749738684416,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25398,"internal_metadata":1878891722},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1408480,"kb_used_data":1036,"kb_used_omap":20,"kb_used_meta":1407403,"kb_avail":732594720,"statfs":{"total":751619276800,"available":750176993280,"internally_reserved":0,"allocated":1060864,"data_stored":396647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20830,"internal_metadata":1441181346},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1755172,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1753511,"kb_avail":732248028,"statfs":{"total":751619276800,"available":749821980672,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25409,"internal_metadata":1795595455},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0}]}} 2026-02-24T07:56:59.962 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:00.044 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:00.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:59 trial016 ceph-mon[39544]: Adjusting osd_memory_target on trial016 to 41511M 2026-02-24T07:57:00.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2177614553' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]': finished 2026-02-24T07:57:00.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2925737651' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:57:00.065 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:56:59 trial016 ceph-mon[39544]: osdmap e106: 4 total, 4 up, 4 in 2026-02-24T07:57:00.081 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:00.160 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:00.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.192+0000 7f0fa420d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.192+0000 7f0fa420d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.262+0000 7fdf11a02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.265 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.262+0000 7fdf11a02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.277 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:00.277 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:00.289 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:00.289 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:00.300 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:00.301 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:00.307 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:00.308 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:00.311 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:00.311 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:00.350 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2026-02-24T07:56:59.878023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":6448588,"kb_used_data":5884,"kb_used_omap":95,"kb_used_meta":6442528,"kb_avail":2929564212,"statfs":{"total":3006477107200,"available":2999873753088,"internally_reserved":0,"allocated":6025216,"data_stored":3357692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97836,"internal_metadata":6597149140},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-894075,"num_write_kb":-6357849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.053855"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":408,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T07:56:56.072725+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:56.072725+0000","last_peered":"2026-02-24T07:56:56.072725+0000","last_clean":"2026-02-24T07:56:56.072725+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:56.072725+0000","last_undegraded":"2026-02-24T07:56:56.072725+0000","last_fullsized":"2026-02-24T07:56:56.072725+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1448420,"kb_used_data":1616,"kb_used_omap":25,"kb_used_meta":1446758,"kb_avail":732554780,"statfs":{"total":751619276800,"available":750136094720,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26199,"internal_metadata":1481480617},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1836516,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1834855,"kb_avail":732166684,"statfs":{"total":751619276800,"available":749738684416,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25398,"internal_metadata":1878891722},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1408480,"kb_used_data":1036,"kb_used_omap":20,"kb_used_meta":1407403,"kb_avail":732594720,"statfs":{"total":751619276800,"available":750176993280,"internally_reserved":0,"allocated":1060864,"data_stored":396647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20830,"internal_metadata":1441181346},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1755172,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1753511,"kb_avail":732248028,"statfs":{"total":751619276800,"available":749821980672,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25409,"internal_metadata":1795595455},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0}]}} 2026-02-24T07:57:00.351 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph status --format=json 2026-02-24T07:57:00.517 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:00.618 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.616+0000 7f88ae0dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.618 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:00.616+0000 7f88ae0dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:00.774 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:00.774 INFO:teuthology.orchestra.run.trial016.stdout:{"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":686,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":107,"num_osds":4,"num_up_osds":4,"osd_up_since":1771919203,"num_in_osds":4,"osd_in_since":1771919193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":1}],"num_pgs":17,"num_pools":2,"num_objects":2,"data_bytes":590368,"bytes_used":6603354112,"bytes_avail":2999873753088,"bytes_total":3006477107200,"unknown_pgs_ratio":0.94117647409439087},"fsmap":{"epoch":1,"btime":"2026-02-24T07:45:33:912318+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"services":{"dashboard":"https://10.20.193.16:8443/","prometheus":"http://10.20.193.16:9283/"}},"servicemap":{"epoch":2,"modified":"2026-02-24T07:47:53.749036+0000","services":{}},"progress_events":{}} 2026-02-24T07:57:00.809 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-24T07:57:00.809 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:00.884 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_5' 2026-02-24T07:57:00.925 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:01.032 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:01.030+0000 7fbbcc696640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:01.032 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:01.031+0000 7fbbcc696640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:01.144 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:01.144 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:01.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: pgmap v387: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:57:01.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: osdmap e107: 4 total, 4 up, 4 in 2026-02-24T07:57:01.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: from='client.15302 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:01.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3223607264' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:57:01.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3409406' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:01.146 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1380890997' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-24T07:57:01.179 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2026-02-24T07:57:00.883228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":6448588,"kb_used_data":5884,"kb_used_omap":95,"kb_used_meta":6442528,"kb_avail":2929564212,"statfs":{"total":3006477107200,"available":2999873753088,"internally_reserved":0,"allocated":6025216,"data_stored":3357692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97836,"internal_metadata":6597149140},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-894075,"num_write_kb":-6357849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.058808"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:56:58.873590+0000","last_change":"2026-02-24T07:56:58.873590+0000","last_active":"2026-02-24T07:56:58.873590+0000","last_peered":"2026-02-24T07:56:58.873590+0000","last_clean":"2026-02-24T07:56:58.873590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:56:58.873590+0000","last_undegraded":"2026-02-24T07:56:58.873590+0000","last_fullsized":"2026-02-24T07:56:58.873590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":408,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T07:56:56.072725+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:56:56.072725+0000","last_peered":"2026-02-24T07:56:56.072725+0000","last_clean":"2026-02-24T07:56:56.072725+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:56:56.072725+0000","last_undegraded":"2026-02-24T07:56:56.072725+0000","last_fullsized":"2026-02-24T07:56:56.072725+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1448420,"kb_used_data":1616,"kb_used_omap":25,"kb_used_meta":1446758,"kb_avail":732554780,"statfs":{"total":751619276800,"available":750136094720,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26199,"internal_metadata":1481480617},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1836516,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1834855,"kb_avail":732166684,"statfs":{"total":751619276800,"available":749738684416,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25398,"internal_metadata":1878891722},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1408480,"kb_used_data":1036,"kb_used_omap":20,"kb_used_meta":1407403,"kb_avail":732594720,"statfs":{"total":751619276800,"available":750176993280,"internally_reserved":0,"allocated":1060864,"data_stored":396647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20830,"internal_metadata":1441181346},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1755172,"kb_used_data":1616,"kb_used_omap":24,"kb_used_meta":1753511,"kb_avail":732248028,"statfs":{"total":751619276800,"available":749821980672,"internally_reserved":0,"allocated":1654784,"data_stored":987015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25409,"internal_metadata":1795595455},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7354,"internal_metadata":0}]}} 2026-02-24T07:57:01.928 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2026-02-24T07:57:01.931 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:57:01.931 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:57:01.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:57:01.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:57:01.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_133332 2026-02-24T07:57:01.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:57:01.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:57:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:01 trial016 ceph-mon[39544]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3223607264' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:57:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:01 trial016 ceph-mon[39544]: osdmap e108: 4 total, 4 up, 4 in 2026-02-24T07:57:02.363 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:02.517 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:02.645 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:02.643+0000 7f9b8a369640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:02.645 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:02.643+0000 7f9b8a369640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:02.667 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:02.667 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:02.682 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:02.682 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:02.695 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:02.696 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:02.710 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:02.710 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:02.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 8861 8733 68.2211 68.2266 0.00233668 0.0144297 2026-02-24T07:57:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:02 trial016 ceph-mon[39544]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:02 trial016 ceph-mon[39544]: pgmap v390: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:57:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2121649572' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:03.987 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 18629 18501 72.2648 76.3125 0.00633987 0.0137553 2026-02-24T07:57:04.182 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:04.335 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:04.474 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:04.470+0000 7f91a6c8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:04.474 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:04.470+0000 7f91a6c8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:04.634 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:04.634 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:04.686 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2026-02-24T07:57:03.825443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70222368,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1067,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":8635,"num_write_kb":70150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":251,"ondisk_log_size":251,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6656580,"kb_used_data":159732,"kb_used_omap":110,"kb_used_meta":6496657,"kb_avail":2929356220,"statfs":{"total":3006477107200,"available":2999660769280,"internally_reserved":0,"allocated":163565568,"data_stored":161794424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113472,"internal_metadata":6652576960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69632000,"num_objects":1065,"num_object_clones":0,"num_object_copies":3195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8500,"num_write_kb":68000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000783"},"pg_stats":[{"pgid":"7.f","version":"108'560","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926337+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:02.926337+0000","last_peered":"2026-02-24T07:57:02.926337+0000","last_clean":"2026-02-24T07:57:02.926337+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:02.926337+0000","last_undegraded":"2026-02-24T07:57:02.926337+0000","last_fullsized":"2026-02-24T07:57:02.926337+0000","mapping_epoch":106,"log_start":"108'544","ondisk_log_start":"108'544","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":544,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'680","reported_seq":670,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.046463+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:03.046463+0000","last_peered":"2026-02-24T07:57:03.046463+0000","last_clean":"2026-02-24T07:57:03.046463+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:03.046463+0000","last_undegraded":"2026-02-24T07:57:03.046463+0000","last_fullsized":"2026-02-24T07:57:03.046463+0000","mapping_epoch":106,"log_start":"108'656","ondisk_log_start":"108'656","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":656,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'521","reported_seq":518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.837899+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:02.837899+0000","last_peered":"2026-02-24T07:57:02.837899+0000","last_clean":"2026-02-24T07:57:02.837899+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:02.837899+0000","last_undegraded":"2026-02-24T07:57:02.837899+0000","last_fullsized":"2026-02-24T07:57:02.837899+0000","mapping_epoch":106,"log_start":"108'504","ondisk_log_start":"108'504","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":504,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4268032,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'560","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.831305+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:02.831305+0000","last_peered":"2026-02-24T07:57:02.831305+0000","last_clean":"2026-02-24T07:57:02.831305+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:02.831305+0000","last_undegraded":"2026-02-24T07:57:02.831305+0000","last_fullsized":"2026-02-24T07:57:02.831305+0000","mapping_epoch":106,"log_start":"108'552","ondisk_log_start":"108'552","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":552,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'544","reported_seq":540,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.051854+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:03.051854+0000","last_peered":"2026-02-24T07:57:03.051854+0000","last_clean":"2026-02-24T07:57:03.051854+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:03.051854+0000","last_undegraded":"2026-02-24T07:57:03.051854+0000","last_fullsized":"2026-02-24T07:57:03.051854+0000","mapping_epoch":106,"log_start":"108'526","ondisk_log_start":"108'526","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":526,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'688","reported_seq":702,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.051172+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:03.051172+0000","last_peered":"2026-02-24T07:57:03.051172+0000","last_clean":"2026-02-24T07:57:03.051172+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:03.051172+0000","last_undegraded":"2026-02-24T07:57:03.051172+0000","last_fullsized":"2026-02-24T07:57:03.051172+0000","mapping_epoch":106,"log_start":"108'680","ondisk_log_start":"108'680","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":680,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'510","reported_seq":502,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.896173+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:02.896173+0000","last_peered":"2026-02-24T07:57:02.896173+0000","last_clean":"2026-02-24T07:57:02.896173+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:02.896173+0000","last_undegraded":"2026-02-24T07:57:02.896173+0000","last_fullsized":"2026-02-24T07:57:02.896173+0000","mapping_epoch":106,"log_start":"108'488","ondisk_log_start":"108'488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":488,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4177920,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'672","reported_seq":667,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.048395+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:03.048395+0000","last_peered":"2026-02-24T07:57:03.048395+0000","last_clean":"2026-02-24T07:57:03.048395+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:03.048395+0000","last_undegraded":"2026-02-24T07:57:03.048395+0000","last_fullsized":"2026-02-24T07:57:03.048395+0000","mapping_epoch":106,"log_start":"108'653","ondisk_log_start":"108'653","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":653,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'384","reported_seq":398,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.848771+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:02.848771+0000","last_peered":"2026-02-24T07:57:02.848771+0000","last_clean":"2026-02-24T07:57:02.848771+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:02.848771+0000","last_undegraded":"2026-02-24T07:57:02.848771+0000","last_fullsized":"2026-02-24T07:57:02.848771+0000","mapping_epoch":106,"log_start":"108'381","ondisk_log_start":"108'381","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":381,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'431","reported_seq":438,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.864368+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:02.864368+0000","last_peered":"2026-02-24T07:57:02.864368+0000","last_clean":"2026-02-24T07:57:02.864368+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:02.864368+0000","last_undegraded":"2026-02-24T07:57:02.864368+0000","last_fullsized":"2026-02-24T07:57:02.864368+0000","mapping_epoch":106,"log_start":"108'424","ondisk_log_start":"108'424","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":424,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3530752,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":3448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'581","reported_seq":561,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926252+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:02.926252+0000","last_peered":"2026-02-24T07:57:02.926252+0000","last_clean":"2026-02-24T07:57:02.926252+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:02.926252+0000","last_undegraded":"2026-02-24T07:57:02.926252+0000","last_fullsized":"2026-02-24T07:57:02.926252+0000","mapping_epoch":106,"log_start":"108'545","ondisk_log_start":"108'545","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":545,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4759552,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'504","reported_seq":518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.913139+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:02.913139+0000","last_peered":"2026-02-24T07:57:02.913139+0000","last_clean":"2026-02-24T07:57:02.913139+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:02.913139+0000","last_undegraded":"2026-02-24T07:57:02.913139+0000","last_fullsized":"2026-02-24T07:57:02.913139+0000","mapping_epoch":106,"log_start":"108'496","ondisk_log_start":"108'496","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":496,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'392","reported_seq":406,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.898813+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:02.898813+0000","last_peered":"2026-02-24T07:57:02.898813+0000","last_clean":"2026-02-24T07:57:02.898813+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:02.898813+0000","last_undegraded":"2026-02-24T07:57:02.898813+0000","last_fullsized":"2026-02-24T07:57:02.898813+0000","mapping_epoch":106,"log_start":"108'371","ondisk_log_start":"108'371","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":371,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'481","reported_seq":494,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.809887+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:02.809887+0000","last_peered":"2026-02-24T07:57:02.809887+0000","last_clean":"2026-02-24T07:57:02.809887+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:02.809887+0000","last_undegraded":"2026-02-24T07:57:02.809887+0000","last_fullsized":"2026-02-24T07:57:02.809887+0000","mapping_epoch":106,"log_start":"108'478","ondisk_log_start":"108'478","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":478,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3940352,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":3848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'496","reported_seq":497,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.840826+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:02.840826+0000","last_peered":"2026-02-24T07:57:02.840826+0000","last_clean":"2026-02-24T07:57:02.840826+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:02.840826+0000","last_undegraded":"2026-02-24T07:57:02.840826+0000","last_fullsized":"2026-02-24T07:57:02.840826+0000","mapping_epoch":106,"log_start":"108'483","ondisk_log_start":"108'483","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":483,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'496","reported_seq":506,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926315+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:02.926315+0000","last_peered":"2026-02-24T07:57:02.926315+0000","last_clean":"2026-02-24T07:57:02.926315+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:02.926315+0000","last_undegraded":"2026-02-24T07:57:02.926315+0000","last_fullsized":"2026-02-24T07:57:02.926315+0000","mapping_epoch":106,"log_start":"108'471","ondisk_log_start":"108'471","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":471,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":69632000,"num_objects":1065,"num_object_clones":0,"num_object_copies":3195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8500,"num_write_kb":68000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208281600,"data_stored":208281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215230,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1491368,"kb_used_data":26516,"kb_used_omap":29,"kb_used_meta":1464802,"kb_avail":732511832,"statfs":{"total":751619276800,"available":750092115968,"internally_reserved":0,"allocated":27152384,"data_stored":26708710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1499957869},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1852728,"kb_used_data":17828,"kb_used_omap":28,"kb_used_meta":1834851,"kb_avail":732150472,"statfs":{"total":751619276800,"available":749722083328,"internally_reserved":0,"allocated":18255872,"data_stored":17812198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29310,"internal_metadata":1878887810},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1482548,"kb_used_data":57056,"kb_used_omap":24,"kb_used_meta":1425447,"kb_avail":732520652,"statfs":{"total":751619276800,"available":750101147648,"internally_reserved":0,"allocated":58425344,"data_stored":57985222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1459658586},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705796,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1829936,"kb_used_data":58332,"kb_used_omap":28,"kb_used_meta":1771555,"kb_avail":732173264,"statfs":{"total":751619276800,"available":749745422336,"internally_reserved":0,"allocated":59731968,"data_stored":59288294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29321,"internal_metadata":1814072695},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58671104,"data_stored":58671104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65232896,"data_stored":65232896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40615936,"data_stored":40615936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43761664,"data_stored":43761664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:04.688 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:57:04.688 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:04.688 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T07:57:04.688 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:04.759 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:04.837 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:04.909 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:04.973 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:04.969+0000 7fcedb79e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:04.973 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:04.970+0000 7fcedb79e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:04.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 27144 27017 70.3518 66.5312 0.004025 0.0141905 2026-02-24T07:57:05.033 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:05.029+0000 7ffbb82a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:05.033 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:05.030+0000 7ffbb82a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:05.052 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:05.052 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:05.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:04 trial016 ceph-mon[39544]: pgmap v391: 17 pgs: 17 active+clean; 67 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 11 MiB/s wr, 1.42k op/s 2026-02-24T07:57:05.053 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:05.067 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:05.067 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:05.081 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:05.081 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:05.095 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:05.095 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:05.136 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:05.136 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:05.183 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2026-02-24T07:57:03.825443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70222368,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1067,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":8635,"num_write_kb":70150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":251,"ondisk_log_size":251,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6656580,"kb_used_data":159732,"kb_used_omap":110,"kb_used_meta":6496657,"kb_avail":2929356220,"statfs":{"total":3006477107200,"available":2999660769280,"internally_reserved":0,"allocated":163565568,"data_stored":161794424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113472,"internal_metadata":6652576960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69632000,"num_objects":1065,"num_object_clones":0,"num_object_copies":3195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8500,"num_write_kb":68000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000783"},"pg_stats":[{"pgid":"7.f","version":"108'560","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926337+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:02.926337+0000","last_peered":"2026-02-24T07:57:02.926337+0000","last_clean":"2026-02-24T07:57:02.926337+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:02.926337+0000","last_undegraded":"2026-02-24T07:57:02.926337+0000","last_fullsized":"2026-02-24T07:57:02.926337+0000","mapping_epoch":106,"log_start":"108'544","ondisk_log_start":"108'544","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":544,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'680","reported_seq":670,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.046463+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:03.046463+0000","last_peered":"2026-02-24T07:57:03.046463+0000","last_clean":"2026-02-24T07:57:03.046463+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:03.046463+0000","last_undegraded":"2026-02-24T07:57:03.046463+0000","last_fullsized":"2026-02-24T07:57:03.046463+0000","mapping_epoch":106,"log_start":"108'656","ondisk_log_start":"108'656","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":656,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'521","reported_seq":518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.837899+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:02.837899+0000","last_peered":"2026-02-24T07:57:02.837899+0000","last_clean":"2026-02-24T07:57:02.837899+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:02.837899+0000","last_undegraded":"2026-02-24T07:57:02.837899+0000","last_fullsized":"2026-02-24T07:57:02.837899+0000","mapping_epoch":106,"log_start":"108'504","ondisk_log_start":"108'504","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":504,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4268032,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'560","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.831305+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:02.831305+0000","last_peered":"2026-02-24T07:57:02.831305+0000","last_clean":"2026-02-24T07:57:02.831305+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:02.831305+0000","last_undegraded":"2026-02-24T07:57:02.831305+0000","last_fullsized":"2026-02-24T07:57:02.831305+0000","mapping_epoch":106,"log_start":"108'552","ondisk_log_start":"108'552","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":552,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'544","reported_seq":540,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.051854+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:03.051854+0000","last_peered":"2026-02-24T07:57:03.051854+0000","last_clean":"2026-02-24T07:57:03.051854+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:03.051854+0000","last_undegraded":"2026-02-24T07:57:03.051854+0000","last_fullsized":"2026-02-24T07:57:03.051854+0000","mapping_epoch":106,"log_start":"108'526","ondisk_log_start":"108'526","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":526,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'688","reported_seq":702,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.051172+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:03.051172+0000","last_peered":"2026-02-24T07:57:03.051172+0000","last_clean":"2026-02-24T07:57:03.051172+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:03.051172+0000","last_undegraded":"2026-02-24T07:57:03.051172+0000","last_fullsized":"2026-02-24T07:57:03.051172+0000","mapping_epoch":106,"log_start":"108'680","ondisk_log_start":"108'680","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":680,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'510","reported_seq":502,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.896173+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:02.896173+0000","last_peered":"2026-02-24T07:57:02.896173+0000","last_clean":"2026-02-24T07:57:02.896173+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:02.896173+0000","last_undegraded":"2026-02-24T07:57:02.896173+0000","last_fullsized":"2026-02-24T07:57:02.896173+0000","mapping_epoch":106,"log_start":"108'488","ondisk_log_start":"108'488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":488,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4177920,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":4080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'672","reported_seq":667,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:03.048395+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:03.048395+0000","last_peered":"2026-02-24T07:57:03.048395+0000","last_clean":"2026-02-24T07:57:03.048395+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:03.048395+0000","last_undegraded":"2026-02-24T07:57:03.048395+0000","last_fullsized":"2026-02-24T07:57:03.048395+0000","mapping_epoch":106,"log_start":"108'653","ondisk_log_start":"108'653","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":653,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'384","reported_seq":398,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.848771+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:02.848771+0000","last_peered":"2026-02-24T07:57:02.848771+0000","last_clean":"2026-02-24T07:57:02.848771+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:02.848771+0000","last_undegraded":"2026-02-24T07:57:02.848771+0000","last_fullsized":"2026-02-24T07:57:02.848771+0000","mapping_epoch":106,"log_start":"108'381","ondisk_log_start":"108'381","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":381,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'431","reported_seq":438,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.864368+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:02.864368+0000","last_peered":"2026-02-24T07:57:02.864368+0000","last_clean":"2026-02-24T07:57:02.864368+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:02.864368+0000","last_undegraded":"2026-02-24T07:57:02.864368+0000","last_fullsized":"2026-02-24T07:57:02.864368+0000","mapping_epoch":106,"log_start":"108'424","ondisk_log_start":"108'424","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":424,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3530752,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":3448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'581","reported_seq":561,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926252+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:02.926252+0000","last_peered":"2026-02-24T07:57:02.926252+0000","last_clean":"2026-02-24T07:57:02.926252+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:02.926252+0000","last_undegraded":"2026-02-24T07:57:02.926252+0000","last_fullsized":"2026-02-24T07:57:02.926252+0000","mapping_epoch":106,"log_start":"108'545","ondisk_log_start":"108'545","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":545,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4759552,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'504","reported_seq":518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.913139+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:02.913139+0000","last_peered":"2026-02-24T07:57:02.913139+0000","last_clean":"2026-02-24T07:57:02.913139+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:02.913139+0000","last_undegraded":"2026-02-24T07:57:02.913139+0000","last_fullsized":"2026-02-24T07:57:02.913139+0000","mapping_epoch":106,"log_start":"108'496","ondisk_log_start":"108'496","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":496,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'392","reported_seq":406,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.898813+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:02.898813+0000","last_peered":"2026-02-24T07:57:02.898813+0000","last_clean":"2026-02-24T07:57:02.898813+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:02.898813+0000","last_undegraded":"2026-02-24T07:57:02.898813+0000","last_fullsized":"2026-02-24T07:57:02.898813+0000","mapping_epoch":106,"log_start":"108'371","ondisk_log_start":"108'371","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":371,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'481","reported_seq":494,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.809887+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:02.809887+0000","last_peered":"2026-02-24T07:57:02.809887+0000","last_clean":"2026-02-24T07:57:02.809887+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:02.809887+0000","last_undegraded":"2026-02-24T07:57:02.809887+0000","last_fullsized":"2026-02-24T07:57:02.809887+0000","mapping_epoch":106,"log_start":"108'478","ondisk_log_start":"108'478","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":478,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3940352,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":3848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'496","reported_seq":497,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.840826+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:02.840826+0000","last_peered":"2026-02-24T07:57:02.840826+0000","last_clean":"2026-02-24T07:57:02.840826+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:02.840826+0000","last_undegraded":"2026-02-24T07:57:02.840826+0000","last_fullsized":"2026-02-24T07:57:02.840826+0000","mapping_epoch":106,"log_start":"108'483","ondisk_log_start":"108'483","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":483,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'496","reported_seq":506,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:02.926315+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:02.926315+0000","last_peered":"2026-02-24T07:57:02.926315+0000","last_clean":"2026-02-24T07:57:02.926315+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:02.926315+0000","last_undegraded":"2026-02-24T07:57:02.926315+0000","last_fullsized":"2026-02-24T07:57:02.926315+0000","mapping_epoch":106,"log_start":"108'471","ondisk_log_start":"108'471","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":471,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":69632000,"num_objects":1065,"num_object_clones":0,"num_object_copies":3195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8500,"num_write_kb":68000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208281600,"data_stored":208281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215230,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1491368,"kb_used_data":26516,"kb_used_omap":29,"kb_used_meta":1464802,"kb_avail":732511832,"statfs":{"total":751619276800,"available":750092115968,"internally_reserved":0,"allocated":27152384,"data_stored":26708710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1499957869},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1852728,"kb_used_data":17828,"kb_used_omap":28,"kb_used_meta":1834851,"kb_avail":732150472,"statfs":{"total":751619276800,"available":749722083328,"internally_reserved":0,"allocated":18255872,"data_stored":17812198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29310,"internal_metadata":1878887810},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1482548,"kb_used_data":57056,"kb_used_omap":24,"kb_used_meta":1425447,"kb_avail":732520652,"statfs":{"total":751619276800,"available":750101147648,"internally_reserved":0,"allocated":58425344,"data_stored":57985222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1459658586},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705796,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1829936,"kb_used_data":58332,"kb_used_omap":28,"kb_used_meta":1771555,"kb_avail":732173264,"statfs":{"total":751619276800,"available":749745422336,"internally_reserved":0,"allocated":59731968,"data_stored":59288294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29321,"internal_metadata":1814072695},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58671104,"data_stored":58671104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65232896,"data_stored":65232896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40615936,"data_stored":40615936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43761664,"data_stored":43761664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:05.185 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:57:05.185 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 26 2026-02-24T07:57:05.340 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:05.472 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:05.468+0000 7f57eb55f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:05.472 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:05.468+0000 7f57eb55f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:05.623 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:57:05.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:05.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 36111 35983 70.2743 70.0469 0.00168447 0.0141838 2026-02-24T07:57:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:05 trial016 ceph-mon[39544]: from='client.15319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2957493007' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:06.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/153032530' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:57:06.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 44759 44631 69.7309 67.5625 0.00850537 0.014301 2026-02-24T07:57:07.141 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:07.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:06 trial016 ceph-mon[39544]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:07.166 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:06 trial016 ceph-mon[39544]: pgmap v392: 17 pgs: 17 active+clean; 67 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 9.6 MiB/s wr, 1.22k op/s 2026-02-24T07:57:07.287 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:07.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:07.409+0000 7ff5be1b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:07.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:07.409+0000 7ff5be1b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:07.432 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:07.432 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:07.453 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:07.454 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:07.469 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:07.469 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:07.482 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:07.482 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:07.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 53683 53555 69.728 69.7188 0.00272544 0.0143137 2026-02-24T07:57:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3351131326' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:08.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 127 63159 63032 70.3431 74.0391 0.0309475 0.0141914 2026-02-24T07:57:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:08 trial016 ceph-mon[39544]: pgmap v393: 17 pgs: 17 active+clean; 67 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 8.3 MiB/s wr, 1.06k op/s 2026-02-24T07:57:09.534 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:09.689 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:09.821 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:09.818+0000 7f674551c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:09.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:09.818+0000 7f674551c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:09.842 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:09.842 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:09.856 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:09.856 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:09.869 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:09.869 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:09.882 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:09.882 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:09.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 127 71659 71532 69.8503 66.4062 0.0310811 0.0142878 2026-02-24T07:57:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3857513373' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:10.671 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:10.671 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:10.672 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:57:10.672 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:10.825 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:10.964 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:10.961+0000 7fc8cd774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:10.965 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:10 trial016 ceph-mon[39544]: pgmap v394: 17 pgs: 17 active+clean; 416 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.34k op/s 2026-02-24T07:57:10.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:10.961+0000 7fc8cd774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:10.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 127 81187 81060 70.3594 74.4375 0.00427307 0.0142053 2026-02-24T07:57:11.113 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:11.114 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:11.166 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2026-02-24T07:57:09.826172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":436011552,"num_objects":6646,"num_object_clones":0,"num_object_copies":19938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6646,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":53287,"num_write_kb":427366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8033676,"kb_used_data":1230780,"kb_used_omap":110,"kb_used_meta":6802705,"kb_avail":2927979124,"statfs":{"total":3006477107200,"available":2998250622976,"internally_reserved":0,"allocated":1260318720,"data_stored":1258547576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113472,"internal_metadata":6965970112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,40],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":435421184,"num_objects":6644,"num_object_clones":0,"num_object_copies":19932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53152,"num_write_kb":425216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.948149"},"pg_stats":[{"pgid":"7.f","version":"108'3360","reported_seq":3374,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.916444+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:07.916444+0000","last_peered":"2026-02-24T07:57:07.916444+0000","last_clean":"2026-02-24T07:57:07.916444+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:07.916444+0000","last_undegraded":"2026-02-24T07:57:07.916444+0000","last_fullsized":"2026-02-24T07:57:07.916444+0000","mapping_epoch":106,"log_start":"108'3346","ondisk_log_start":"108'3346","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3360,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'3512","reported_seq":3523,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:08.057030+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:08.057030+0000","last_peered":"2026-02-24T07:57:08.057030+0000","last_clean":"2026-02-24T07:57:08.057030+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:08.057030+0000","last_undegraded":"2026-02-24T07:57:08.057030+0000","last_fullsized":"2026-02-24T07:57:08.057030+0000","mapping_epoch":106,"log_start":"108'3494","ondisk_log_start":"108'3494","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3512,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'3344","reported_seq":3358,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.849580+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:07.849580+0000","last_peered":"2026-02-24T07:57:07.849580+0000","last_clean":"2026-02-24T07:57:07.849580+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:07.849580+0000","last_undegraded":"2026-02-24T07:57:07.849580+0000","last_fullsized":"2026-02-24T07:57:07.849580+0000","mapping_epoch":106,"log_start":"108'3337","ondisk_log_start":"108'3337","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27394048,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3344,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'3120","reported_seq":3134,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.826821+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:07.826821+0000","last_peered":"2026-02-24T07:57:07.826821+0000","last_clean":"2026-02-24T07:57:07.826821+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:07.826821+0000","last_undegraded":"2026-02-24T07:57:07.826821+0000","last_fullsized":"2026-02-24T07:57:07.826821+0000","mapping_epoch":106,"log_start":"108'3113","ondisk_log_start":"108'3113","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3120,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'3480","reported_seq":3494,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:08.057034+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:08.057034+0000","last_peered":"2026-02-24T07:57:08.057034+0000","last_clean":"2026-02-24T07:57:08.057034+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:08.057034+0000","last_undegraded":"2026-02-24T07:57:08.057034+0000","last_fullsized":"2026-02-24T07:57:08.057034+0000","mapping_epoch":106,"log_start":"108'3462","ondisk_log_start":"108'3462","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3480,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'3544","reported_seq":3558,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:08.056102+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:08.056102+0000","last_peered":"2026-02-24T07:57:08.056102+0000","last_clean":"2026-02-24T07:57:08.056102+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:08.056102+0000","last_undegraded":"2026-02-24T07:57:08.056102+0000","last_fullsized":"2026-02-24T07:57:08.056102+0000","mapping_epoch":106,"log_start":"108'3536","ondisk_log_start":"108'3536","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032448,"num_objects":443,"num_object_clones":0,"num_object_copies":1329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3544,"num_write_kb":28352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'3464","reported_seq":3469,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.915752+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:07.915752+0000","last_peered":"2026-02-24T07:57:07.915752+0000","last_clean":"2026-02-24T07:57:07.915752+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:07.915752+0000","last_undegraded":"2026-02-24T07:57:07.915752+0000","last_fullsized":"2026-02-24T07:57:07.915752+0000","mapping_epoch":106,"log_start":"108'3448","ondisk_log_start":"108'3448","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3464,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'3528","reported_seq":3542,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:08.025354+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:08.025354+0000","last_peered":"2026-02-24T07:57:08.025354+0000","last_clean":"2026-02-24T07:57:08.025354+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:08.025354+0000","last_undegraded":"2026-02-24T07:57:08.025354+0000","last_fullsized":"2026-02-24T07:57:08.025354+0000","mapping_epoch":106,"log_start":"108'3524","ondisk_log_start":"108'3524","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3528,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'3104","reported_seq":3118,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.854281+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:07.854281+0000","last_peered":"2026-02-24T07:57:07.854281+0000","last_clean":"2026-02-24T07:57:07.854281+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:07.854281+0000","last_undegraded":"2026-02-24T07:57:07.854281+0000","last_fullsized":"2026-02-24T07:57:07.854281+0000","mapping_epoch":106,"log_start":"108'3096","ondisk_log_start":"108'3096","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":388,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'2752","reported_seq":2766,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.857286+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:07.857286+0000","last_peered":"2026-02-24T07:57:07.857286+0000","last_clean":"2026-02-24T07:57:07.857286+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:07.857286+0000","last_undegraded":"2026-02-24T07:57:07.857286+0000","last_fullsized":"2026-02-24T07:57:07.857286+0000","mapping_epoch":106,"log_start":"108'2746","ondisk_log_start":"108'2746","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":2746,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":22016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'3432","reported_seq":3446,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.913183+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:07.913183+0000","last_peered":"2026-02-24T07:57:07.913183+0000","last_clean":"2026-02-24T07:57:07.913183+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:07.913183+0000","last_undegraded":"2026-02-24T07:57:07.913183+0000","last_fullsized":"2026-02-24T07:57:07.913183+0000","mapping_epoch":106,"log_start":"108'3424","ondisk_log_start":"108'3424","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28114944,"num_objects":429,"num_object_clones":0,"num_object_copies":1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3432,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'3440","reported_seq":3454,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.917321+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:07.917321+0000","last_peered":"2026-02-24T07:57:07.917321+0000","last_clean":"2026-02-24T07:57:07.917321+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:07.917321+0000","last_undegraded":"2026-02-24T07:57:07.917321+0000","last_fullsized":"2026-02-24T07:57:07.917321+0000","mapping_epoch":106,"log_start":"108'3432","ondisk_log_start":"108'3432","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3440,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'3584","reported_seq":3594,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.916557+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:07.916557+0000","last_peered":"2026-02-24T07:57:07.916557+0000","last_clean":"2026-02-24T07:57:07.916557+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:07.916557+0000","last_undegraded":"2026-02-24T07:57:07.916557+0000","last_fullsized":"2026-02-24T07:57:07.916557+0000","mapping_epoch":106,"log_start":"108'3576","ondisk_log_start":"108'3576","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3584,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'3184","reported_seq":3198,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.850216+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:07.850216+0000","last_peered":"2026-02-24T07:57:07.850216+0000","last_clean":"2026-02-24T07:57:07.850216+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:07.850216+0000","last_undegraded":"2026-02-24T07:57:07.850216+0000","last_fullsized":"2026-02-24T07:57:07.850216+0000","mapping_epoch":106,"log_start":"108'3171","ondisk_log_start":"108'3171","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3184,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'3192","reported_seq":3206,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.839576+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:07.839576+0000","last_peered":"2026-02-24T07:57:07.839576+0000","last_clean":"2026-02-24T07:57:07.839576+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:07.839576+0000","last_undegraded":"2026-02-24T07:57:07.839576+0000","last_fullsized":"2026-02-24T07:57:07.839576+0000","mapping_epoch":106,"log_start":"108'3186","ondisk_log_start":"108'3186","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26148864,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3192,"num_write_kb":25536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'3112","reported_seq":3126,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:07.833473+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:07.833473+0000","last_peered":"2026-02-24T07:57:07.833473+0000","last_clean":"2026-02-24T07:57:07.833473+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:07.833473+0000","last_undegraded":"2026-02-24T07:57:07.833473+0000","last_fullsized":"2026-02-24T07:57:07.833473+0000","mapping_epoch":106,"log_start":"108'3104","ondisk_log_start":"108'3104","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3112,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":435421184,"num_objects":6644,"num_object_clones":0,"num_object_copies":19932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53152,"num_write_kb":425216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1304616960,"data_stored":1304616960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215231,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1784912,"kb_used_data":265916,"kb_used_omap":29,"kb_used_meta":1518946,"kb_avail":732218288,"statfs":{"total":751619276800,"available":749791526912,"internally_reserved":0,"allocated":272297984,"data_stored":271854310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1555401325},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444160,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2152976,"kb_used_data":245884,"kb_used_omap":28,"kb_used_meta":1907043,"kb_avail":731850224,"statfs":{"total":751619276800,"available":749414629376,"internally_reserved":0,"allocated":251785216,"data_stored":251341542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29310,"internal_metadata":1952812418},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1883700,"kb_used_data":349920,"kb_used_omap":24,"kb_used_meta":1533735,"kb_avail":732119500,"statfs":{"total":751619276800,"available":749690368000,"internally_reserved":0,"allocated":358318080,"data_stored":357877958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1570545498},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705797,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2212088,"kb_used_data":369060,"kb_used_omap":28,"kb_used_meta":1842979,"kb_avail":731791112,"statfs":{"total":751619276800,"available":749354098688,"internally_reserved":0,"allocated":377917440,"data_stored":377473766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29321,"internal_metadata":1887210871},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,40],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":380387328,"data_stored":380387328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":362479616,"data_stored":362479616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":269418496,"data_stored":269418496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":292331520,"data_stored":292331520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:11.168 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:57:11.168 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 191 2026-02-24T07:57:11.319 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:11.453 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:11.449+0000 7fd435200640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:11.453 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:11.449+0000 7fd435200640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:11.601 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:57:11.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:11.929 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:11.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 127 90232 90105 70.3893 70.6641 0.0214194 0.0141925 2026-02-24T07:57:12.083 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:12.152 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/197649600' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "191"} : dispatch 2026-02-24T07:57:12.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:12.206+0000 7f48fa37a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:12.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:12.206+0000 7f48fa37a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:12.231 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:12.232 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:12.244 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:12.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:12.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:12.263 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:12.279 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:12.279 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:12.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 99180 99052 70.3442 69.8984 0.00501374 0.0142039 2026-02-24T07:57:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:12 trial016 ceph-mon[39544]: from='client.15331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:12 trial016 ceph-mon[39544]: pgmap v395: 17 pgs: 17 active+clean; 416 MiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.86k op/s 2026-02-24T07:57:13.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/152398761' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:13.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 127 109272 109145 71.0526 78.8516 0.00429499 0.014068 2026-02-24T07:57:14.328 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:14.477 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:14.610 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:14.606+0000 7fefa49e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:14.610 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:14.607+0000 7fefa49e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:14.629 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:14.629 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:14.647 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:14.647 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:14.662 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:14.663 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:14.675 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:14.676 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:14.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 119177 119049 71.5385 77.375 0.00206406 0.0139717 2026-02-24T07:57:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:14 trial016 ceph-mon[39544]: pgmap v396: 17 pgs: 17 active+clean; 771 MiB data, 7.5 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.22k op/s 2026-02-24T07:57:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1682830948' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:15.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:15.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 128 128356 128228 71.5504 71.7109 0.0100044 0.0139631 2026-02-24T07:57:16.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:15 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:57:16.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:15 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:57:16.646 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:16.646 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:16.646 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T07:57:16.647 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:16.722 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:16.806 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:16.871 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:16.941 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:16 trial016 ceph-mon[39544]: pgmap v397: 17 pgs: 17 active+clean; 771 MiB data, 7.5 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.51k op/s 2026-02-24T07:57:16.942 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:16 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:57:16.942 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:16 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:57:16.988 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 136976 136848 71.2696 67.3438 0.0856311 0.0139735 2026-02-24T07:57:17.189 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:17.179+0000 7fba3e683640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:17.190 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:17.179+0000 7fba3e683640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:17.320 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:17.320 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:17.736 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:17.694+0000 7ffb92dc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:17.737 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:17.695+0000 7ffb92dc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:17.737 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:17.737 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:17.757 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:17.757 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:17.772 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:17.772 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:17.788 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:17.788 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:17.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 142858 142730 69.6871 45.9531 0.0103833 0.0143417 2026-02-24T07:57:18.157 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:17 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3764789006' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:18.180 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2026-02-24T07:57:15.827064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":808600096,"num_objects":12332,"num_object_clones":0,"num_object_copies":36996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12332,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":98769,"num_write_kb":791222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7836452,"kb_used_data":2319508,"kb_used_omap":91,"kb_used_meta":5516772,"kb_avail":2928176348,"statfs":{"total":3006477107200,"available":2998452580352,"internally_reserved":0,"allocated":2375176192,"data_stored":2373405048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93640,"internal_metadata":5649175096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":738377728,"num_objects":11265,"num_object_clones":0,"num_object_copies":33795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90134,"num_write_kb":721072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001621"},"pg_stats":[{"pgid":"7.f","version":"108'6328","reported_seq":6342,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.920472+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:12.920472+0000","last_peered":"2026-02-24T07:57:12.920472+0000","last_clean":"2026-02-24T07:57:12.920472+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:12.920472+0000","last_undegraded":"2026-02-24T07:57:12.920472+0000","last_fullsized":"2026-02-24T07:57:12.920472+0000","mapping_epoch":106,"log_start":"108'6305","ondisk_log_start":"108'6305","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6328,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'6408","reported_seq":6422,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:13.057858+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:13.057858+0000","last_peered":"2026-02-24T07:57:13.057858+0000","last_clean":"2026-02-24T07:57:13.057858+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:13.057858+0000","last_undegraded":"2026-02-24T07:57:13.057858+0000","last_fullsized":"2026-02-24T07:57:13.057858+0000","mapping_epoch":106,"log_start":"108'6400","ondisk_log_start":"108'6400","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6408,"num_write_kb":51264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'6256","reported_seq":6270,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.849180+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:12.849180+0000","last_peered":"2026-02-24T07:57:12.849180+0000","last_clean":"2026-02-24T07:57:12.849180+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:12.849180+0000","last_undegraded":"2026-02-24T07:57:12.849180+0000","last_fullsized":"2026-02-24T07:57:12.849180+0000","mapping_epoch":106,"log_start":"108'6248","ondisk_log_start":"108'6248","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51249152,"num_objects":782,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6256,"num_write_kb":50048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'6040","reported_seq":6054,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.847583+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:12.847583+0000","last_peered":"2026-02-24T07:57:12.847583+0000","last_clean":"2026-02-24T07:57:12.847583+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:12.847583+0000","last_undegraded":"2026-02-24T07:57:12.847583+0000","last_fullsized":"2026-02-24T07:57:12.847583+0000","mapping_epoch":106,"log_start":"108'6032","ondisk_log_start":"108'6032","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49479680,"num_objects":755,"num_object_clones":0,"num_object_copies":2265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6040,"num_write_kb":48320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'6232","reported_seq":6241,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:13.058387+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:13.058387+0000","last_peered":"2026-02-24T07:57:13.058387+0000","last_clean":"2026-02-24T07:57:13.058387+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:13.058387+0000","last_undegraded":"2026-02-24T07:57:13.058387+0000","last_fullsized":"2026-02-24T07:57:13.058387+0000","mapping_epoch":106,"log_start":"108'6217","ondisk_log_start":"108'6217","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51052544,"num_objects":779,"num_object_clones":0,"num_object_copies":2337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6232,"num_write_kb":49856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'6328","reported_seq":6342,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:13.027083+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:13.027083+0000","last_peered":"2026-02-24T07:57:13.027083+0000","last_clean":"2026-02-24T07:57:13.027083+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:13.027083+0000","last_undegraded":"2026-02-24T07:57:13.027083+0000","last_fullsized":"2026-02-24T07:57:13.027083+0000","mapping_epoch":106,"log_start":"108'6320","ondisk_log_start":"108'6320","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6328,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'6528","reported_seq":6542,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.911848+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:12.911848+0000","last_peered":"2026-02-24T07:57:12.911848+0000","last_clean":"2026-02-24T07:57:12.911848+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:12.911848+0000","last_undegraded":"2026-02-24T07:57:12.911848+0000","last_fullsized":"2026-02-24T07:57:12.911848+0000","mapping_epoch":106,"log_start":"108'6516","ondisk_log_start":"108'6516","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53477376,"num_objects":816,"num_object_clones":0,"num_object_copies":2448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6528,"num_write_kb":52224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'6498","reported_seq":6503,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:13.057735+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:13.057735+0000","last_peered":"2026-02-24T07:57:13.057735+0000","last_clean":"2026-02-24T07:57:13.057735+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:13.057735+0000","last_undegraded":"2026-02-24T07:57:13.057735+0000","last_fullsized":"2026-02-24T07:57:13.057735+0000","mapping_epoch":106,"log_start":"108'6488","ondisk_log_start":"108'6488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53231616,"num_objects":813,"num_object_clones":0,"num_object_copies":2439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6498,"num_write_kb":51984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'5736","reported_seq":5750,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.866035+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:12.866035+0000","last_peered":"2026-02-24T07:57:12.866035+0000","last_clean":"2026-02-24T07:57:12.866035+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:12.866035+0000","last_undegraded":"2026-02-24T07:57:12.866035+0000","last_fullsized":"2026-02-24T07:57:12.866035+0000","mapping_epoch":106,"log_start":"108'5728","ondisk_log_start":"108'5728","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5736,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'5664","reported_seq":5678,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.863719+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:12.863719+0000","last_peered":"2026-02-24T07:57:12.863719+0000","last_clean":"2026-02-24T07:57:12.863719+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:12.863719+0000","last_undegraded":"2026-02-24T07:57:12.863719+0000","last_fullsized":"2026-02-24T07:57:12.863719+0000","mapping_epoch":106,"log_start":"108'5655","ondisk_log_start":"108'5655","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5664,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'6104","reported_seq":6118,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.921151+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:12.921151+0000","last_peered":"2026-02-24T07:57:12.921151+0000","last_clean":"2026-02-24T07:57:12.921151+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:12.921151+0000","last_undegraded":"2026-02-24T07:57:12.921151+0000","last_fullsized":"2026-02-24T07:57:12.921151+0000","mapping_epoch":106,"log_start":"108'6074","ondisk_log_start":"108'6074","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50003968,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6104,"num_write_kb":48832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'6176","reported_seq":6182,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.927153+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:12.927153+0000","last_peered":"2026-02-24T07:57:12.927153+0000","last_clean":"2026-02-24T07:57:12.927153+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:12.927153+0000","last_undegraded":"2026-02-24T07:57:12.927153+0000","last_fullsized":"2026-02-24T07:57:12.927153+0000","mapping_epoch":106,"log_start":"108'6167","ondisk_log_start":"108'6167","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50593792,"num_objects":772,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6176,"num_write_kb":49408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'6504","reported_seq":6518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.921294+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:12.921294+0000","last_peered":"2026-02-24T07:57:12.921294+0000","last_clean":"2026-02-24T07:57:12.921294+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:12.921294+0000","last_undegraded":"2026-02-24T07:57:12.921294+0000","last_fullsized":"2026-02-24T07:57:12.921294+0000","mapping_epoch":106,"log_start":"108'6488","ondisk_log_start":"108'6488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280768,"num_objects":813,"num_object_clones":0,"num_object_copies":2439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6504,"num_write_kb":52032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'5752","reported_seq":5766,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.842827+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:12.842827+0000","last_peered":"2026-02-24T07:57:12.842827+0000","last_clean":"2026-02-24T07:57:12.842827+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:12.842827+0000","last_undegraded":"2026-02-24T07:57:12.842827+0000","last_fullsized":"2026-02-24T07:57:12.842827+0000","mapping_epoch":106,"log_start":"108'5747","ondisk_log_start":"108'5747","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47120384,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5752,"num_write_kb":46016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'5976","reported_seq":5990,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.849387+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:12.849387+0000","last_peered":"2026-02-24T07:57:12.849387+0000","last_clean":"2026-02-24T07:57:12.849387+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:12.849387+0000","last_undegraded":"2026-02-24T07:57:12.849387+0000","last_fullsized":"2026-02-24T07:57:12.849387+0000","mapping_epoch":106,"log_start":"108'5967","ondisk_log_start":"108'5967","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48955392,"num_objects":747,"num_object_clones":0,"num_object_copies":2241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5976,"num_write_kb":47808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'6104","reported_seq":6118,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:12.919264+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:12.919264+0000","last_peered":"2026-02-24T07:57:12.919264+0000","last_clean":"2026-02-24T07:57:12.919264+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:12.919264+0000","last_undegraded":"2026-02-24T07:57:12.919264+0000","last_fullsized":"2026-02-24T07:57:12.919264+0000","mapping_epoch":106,"log_start":"108'6088","ondisk_log_start":"108'6088","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50003968,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6104,"num_write_kb":48832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":808009728,"num_objects":12330,"num_object_clones":0,"num_object_copies":36990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98634,"num_write_kb":789072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2424217600,"data_stored":2424217600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215232,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2123192,"kb_used_data":513956,"kb_used_omap":29,"kb_used_meta":1609186,"kb_avail":731880008,"statfs":{"total":751619276800,"available":749445128192,"internally_reserved":0,"allocated":526290944,"data_stored":525847270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1647807085},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444161,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2456248,"kb_used_data":476964,"kb_used_omap":28,"kb_used_meta":1979235,"kb_avail":731546952,"statfs":{"total":751619276800,"available":749104078848,"internally_reserved":0,"allocated":488411136,"data_stored":487967462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29310,"internal_metadata":2026737026},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2268404,"kb_used_data":644384,"kb_used_omap":24,"kb_used_meta":1623975,"kb_avail":731734796,"statfs":{"total":751619276800,"available":749296431104,"internally_reserved":0,"allocated":659849216,"data_stored":659409094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1662951258},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":988608,"kb_used_data":684204,"kb_used_omap":9,"kb_used_meta":304374,"kb_avail":733014592,"statfs":{"total":751619276800,"available":750606942208,"internally_reserved":0,"allocated":700624896,"data_stored":700181222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":311679727},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":704897024,"data_stored":704897024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":671023104,"data_stored":671023104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":500367360,"data_stored":500367360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":547930112,"data_stored":547930112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:18.182 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:57:18.183 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 36 2026-02-24T07:57:18.751 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:18.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 148838 148710 68.3359 46.7188 0.00641434 0.0146259 2026-02-24T07:57:19.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:18 trial016 ceph-mon[39544]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:19.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:18 trial016 ceph-mon[39544]: pgmap v398: 17 pgs: 17 active+clean; 771 MiB data, 7.5 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.51k op/s 2026-02-24T07:57:19.146 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:19.136+0000 7f20b66f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:19.146 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:19.136+0000 7f20b66f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:19.293 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:57:19.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:19.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 127 156500 156373 67.8651 59.8672 0.00566807 0.0147282 2026-02-24T07:57:20.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1711715437' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:57:20.750 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:20.906 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:20.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 127 165868 165741 68.1449 73.1875 0.00238223 0.0146692 2026-02-24T07:57:21.035 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:20 trial016 ceph-mon[39544]: pgmap v399: 17 pgs: 17 active+clean; 1.1 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.15k op/s 2026-02-24T07:57:21.313 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:21.278+0000 7f5295b3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:21.313 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:21.278+0000 7f5295b3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:21.314 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:21.314 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:21.314 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:21.314 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:21.336 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:21.337 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:21.351 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:21.351 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:21.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:57:21.988191+0000 min lat: 0.000693106 max lat: 0.119549 avg lat: 0.0148661 2026-02-24T07:57:21.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:57:21.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 127 172282 172155 67.2429 50.1094 0.0138456 0.0148661 2026-02-24T07:57:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1483803851' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:22.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 181192 181064 67.355 69.6016 0.00342405 0.0148362 2026-02-24T07:57:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:22 trial016 ceph-mon[39544]: pgmap v400: 17 pgs: 17 active+clean; 1.1 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.43k op/s 2026-02-24T07:57:23.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 128 189871 189743 67.3752 67.8047 0.00485608 0.0148332 2026-02-24T07:57:24.073 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:24.220 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:24.505 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:24.506 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:24.506 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:24.712 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:24.657+0000 7fc561fd6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:24.712 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:24.657+0000 7fc561fd6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:24.713 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:24.713 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:24.713 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:24.713 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:24.729 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:24.731 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:24.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:24.752 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:24.752 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:24.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 127 197632 197505 67.0821 60.6406 0.00392604 0.014903 2026-02-24T07:57:25.029 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:25.026+0000 7fe2ab8e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:25.029 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:25.026+0000 7fe2ab8e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:25.186 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:25.186 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:25.186 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:24 trial016 ceph-mon[39544]: pgmap v401: 17 pgs: 17 active+clean; 1.4 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 83 MiB/s wr, 10.63k op/s 2026-02-24T07:57:25.186 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/866223388' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:25.186 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:25.234 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2026-02-24T07:57:23.828121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1480909344,"num_objects":22591,"num_object_clones":0,"num_object_copies":67773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22591,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":180838,"num_write_kb":1447774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10275828,"kb_used_data":4285916,"kb_used_omap":72,"kb_used_meta":5989751,"kb_avail":2925736972,"statfs":{"total":3006477107200,"available":2995954659328,"internally_reserved":0,"allocated":4388777984,"data_stored":4387006840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74457,"internal_metadata":6133505319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,10,27,9,26,13],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1044897792,"num_objects":15945,"num_object_clones":0,"num_object_copies":47835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127551,"num_write_kb":1020408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001658"},"pg_stats":[{"pgid":"7.f","version":"108'11517","reported_seq":11525,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.935397+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:22.935397+0000","last_peered":"2026-02-24T07:57:22.935397+0000","last_clean":"2026-02-24T07:57:22.935397+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:22.935397+0000","last_undegraded":"2026-02-24T07:57:22.935397+0000","last_fullsized":"2026-02-24T07:57:22.935397+0000","mapping_epoch":106,"log_start":"108'11507","ondisk_log_start":"108'11507","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94347264,"num_objects":1440,"num_object_clones":0,"num_object_copies":4320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11517,"num_write_kb":92136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'11048","reported_seq":11062,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:23.052841+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:23.052841+0000","last_peered":"2026-02-24T07:57:23.052841+0000","last_clean":"2026-02-24T07:57:23.052841+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:23.052841+0000","last_undegraded":"2026-02-24T07:57:23.052841+0000","last_fullsized":"2026-02-24T07:57:23.052841+0000","mapping_epoch":106,"log_start":"108'11040","ondisk_log_start":"108'11040","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90505216,"num_objects":1381,"num_object_clones":0,"num_object_copies":4143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11048,"num_write_kb":88384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'11312","reported_seq":11320,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.854693+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:22.854693+0000","last_peered":"2026-02-24T07:57:22.854693+0000","last_clean":"2026-02-24T07:57:22.854693+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:22.854693+0000","last_undegraded":"2026-02-24T07:57:22.854693+0000","last_fullsized":"2026-02-24T07:57:22.854693+0000","mapping_epoch":106,"log_start":"108'11296","ondisk_log_start":"108'11296","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92667904,"num_objects":1414,"num_object_clones":0,"num_object_copies":4242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11312,"num_write_kb":90496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'11434","reported_seq":11428,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.854964+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:22.854964+0000","last_peered":"2026-02-24T07:57:22.854964+0000","last_clean":"2026-02-24T07:57:22.854964+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:22.854964+0000","last_undegraded":"2026-02-24T07:57:22.854964+0000","last_fullsized":"2026-02-24T07:57:22.854964+0000","mapping_epoch":106,"log_start":"108'11411","ondisk_log_start":"108'11411","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93667328,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11434,"num_write_kb":91472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'11240","reported_seq":11254,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:23.053810+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:23.053810+0000","last_peered":"2026-02-24T07:57:23.053810+0000","last_clean":"2026-02-24T07:57:23.053810+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:23.053810+0000","last_undegraded":"2026-02-24T07:57:23.053810+0000","last_fullsized":"2026-02-24T07:57:23.053810+0000","mapping_epoch":106,"log_start":"108'11232","ondisk_log_start":"108'11232","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92078080,"num_objects":1405,"num_object_clones":0,"num_object_copies":4215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11240,"num_write_kb":89920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'11448","reported_seq":11462,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:23.052279+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:23.052279+0000","last_peered":"2026-02-24T07:57:23.052279+0000","last_clean":"2026-02-24T07:57:23.052279+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:23.052279+0000","last_undegraded":"2026-02-24T07:57:23.052279+0000","last_fullsized":"2026-02-24T07:57:23.052279+0000","mapping_epoch":106,"log_start":"108'11432","ondisk_log_start":"108'11432","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93782016,"num_objects":1431,"num_object_clones":0,"num_object_copies":4293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11448,"num_write_kb":91584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'11440","reported_seq":11454,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.922626+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:22.922626+0000","last_peered":"2026-02-24T07:57:22.922626+0000","last_clean":"2026-02-24T07:57:22.922626+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:22.922626+0000","last_undegraded":"2026-02-24T07:57:22.922626+0000","last_fullsized":"2026-02-24T07:57:22.922626+0000","mapping_epoch":106,"log_start":"108'11432","ondisk_log_start":"108'11432","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11440,"num_write_kb":91520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'11480","reported_seq":11494,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:23.022527+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:23.022527+0000","last_peered":"2026-02-24T07:57:23.022527+0000","last_clean":"2026-02-24T07:57:23.022527+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:23.022527+0000","last_undegraded":"2026-02-24T07:57:23.022527+0000","last_fullsized":"2026-02-24T07:57:23.022527+0000","mapping_epoch":106,"log_start":"108'11472","ondisk_log_start":"108'11472","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94044160,"num_objects":1435,"num_object_clones":0,"num_object_copies":4305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11480,"num_write_kb":91840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'11080","reported_seq":11094,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.863521+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:22.863521+0000","last_peered":"2026-02-24T07:57:22.863521+0000","last_clean":"2026-02-24T07:57:22.863521+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:22.863521+0000","last_undegraded":"2026-02-24T07:57:22.863521+0000","last_fullsized":"2026-02-24T07:57:22.863521+0000","mapping_epoch":106,"log_start":"108'11074","ondisk_log_start":"108'11074","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90767360,"num_objects":1385,"num_object_clones":0,"num_object_copies":4155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11080,"num_write_kb":88640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'10664","reported_seq":10678,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.846894+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:22.846894+0000","last_peered":"2026-02-24T07:57:22.846894+0000","last_clean":"2026-02-24T07:57:22.846894+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:22.846894+0000","last_undegraded":"2026-02-24T07:57:22.846894+0000","last_fullsized":"2026-02-24T07:57:22.846894+0000","mapping_epoch":106,"log_start":"108'10656","ondisk_log_start":"108'10656","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87359488,"num_objects":1333,"num_object_clones":0,"num_object_copies":3999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10664,"num_write_kb":85312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'10968","reported_seq":10982,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.934471+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:22.934471+0000","last_peered":"2026-02-24T07:57:22.934471+0000","last_clean":"2026-02-24T07:57:22.934471+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:22.934471+0000","last_undegraded":"2026-02-24T07:57:22.934471+0000","last_fullsized":"2026-02-24T07:57:22.934471+0000","mapping_epoch":106,"log_start":"108'10952","ondisk_log_start":"108'10952","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89849856,"num_objects":1371,"num_object_clones":0,"num_object_copies":4113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10968,"num_write_kb":87744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'11272","reported_seq":11286,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.927095+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:22.927095+0000","last_peered":"2026-02-24T07:57:22.927095+0000","last_clean":"2026-02-24T07:57:22.927095+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:22.927095+0000","last_undegraded":"2026-02-24T07:57:22.927095+0000","last_fullsized":"2026-02-24T07:57:22.927095+0000","mapping_epoch":106,"log_start":"108'11264","ondisk_log_start":"108'11264","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92340224,"num_objects":1409,"num_object_clones":0,"num_object_copies":4227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11272,"num_write_kb":90176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'12000","reported_seq":12014,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.922655+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:22.922655+0000","last_peered":"2026-02-24T07:57:22.922655+0000","last_clean":"2026-02-24T07:57:22.922655+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:22.922655+0000","last_undegraded":"2026-02-24T07:57:22.922655+0000","last_fullsized":"2026-02-24T07:57:22.922655+0000","mapping_epoch":106,"log_start":"108'11984","ondisk_log_start":"108'11984","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98304000,"num_objects":1500,"num_object_clones":0,"num_object_copies":4500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12000,"num_write_kb":96000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'10680","reported_seq":10694,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.843737+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:22.843737+0000","last_peered":"2026-02-24T07:57:22.843737+0000","last_clean":"2026-02-24T07:57:22.843737+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:22.843737+0000","last_undegraded":"2026-02-24T07:57:22.843737+0000","last_fullsized":"2026-02-24T07:57:22.843737+0000","mapping_epoch":106,"log_start":"108'10659","ondisk_log_start":"108'10659","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87490560,"num_objects":1335,"num_object_clones":0,"num_object_copies":4005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10680,"num_write_kb":85440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'11656","reported_seq":11669,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.854783+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:22.854783+0000","last_peered":"2026-02-24T07:57:22.854783+0000","last_clean":"2026-02-24T07:57:22.854783+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:22.854783+0000","last_undegraded":"2026-02-24T07:57:22.854783+0000","last_fullsized":"2026-02-24T07:57:22.854783+0000","mapping_epoch":106,"log_start":"108'11645","ondisk_log_start":"108'11645","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95485952,"num_objects":1457,"num_object_clones":0,"num_object_copies":4371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11656,"num_write_kb":93248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'11464","reported_seq":11474,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:22.926519+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:22.926519+0000","last_peered":"2026-02-24T07:57:22.926519+0000","last_clean":"2026-02-24T07:57:22.926519+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:22.926519+0000","last_undegraded":"2026-02-24T07:57:22.926519+0000","last_fullsized":"2026-02-24T07:57:22.926519+0000","mapping_epoch":106,"log_start":"108'11459","ondisk_log_start":"108'11459","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93913088,"num_objects":1433,"num_object_clones":0,"num_object_copies":4299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11464,"num_write_kb":91712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1480318976,"num_objects":22589,"num_object_clones":0,"num_object_copies":67767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180703,"num_write_kb":1445624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4440629248,"data_stored":4440629248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":188,"ondisk_log_size":188,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215234,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2716280,"kb_used_data":963172,"kb_used_omap":29,"kb_used_meta":1753058,"kb_avail":731286920,"statfs":{"total":751619276800,"available":748837806080,"internally_reserved":0,"allocated":986288128,"data_stored":985844454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1795132013},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2814208,"kb_used_data":889004,"kb_used_omap":9,"kb_used_meta":1925174,"kb_avail":731188992,"statfs":{"total":751619276800,"available":748737527808,"internally_reserved":0,"allocated":910340096,"data_stored":909896422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9475,"internal_metadata":1971378941},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,8,9,13],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2979468,"kb_used_data":1174968,"kb_used_omap":24,"kb_used_meta":1804455,"kb_avail":731023732,"statfs":{"total":751619276800,"available":748568301568,"internally_reserved":0,"allocated":1203167232,"data_stored":1202727110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1847762778},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705800,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1765872,"kb_used_data":1258772,"kb_used_omap":9,"kb_used_meta":507062,"kb_avail":732237328,"statfs":{"total":751619276800,"available":749811023872,"internally_reserved":0,"allocated":1288982528,"data_stored":1288538854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":519231587},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,10,19,0,5,13],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1292771328,"data_stored":1292771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1216176128,"data_stored":1216176128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":922148864,"data_stored":922148864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1009532928,"data_stored":1009532928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:25.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 127 206976 206849 67.3285 73 0.0312415 0.0148426 2026-02-24T07:57:26.945 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:26.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 128 216806 216678 67.7067 76.7891 0.00453948 0.0147654 2026-02-24T07:57:27.102 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:27.170 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:26 trial016 ceph-mon[39544]: from='client.15349 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:27.170 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:26 trial016 ceph-mon[39544]: pgmap v402: 17 pgs: 17 active+clean; 1.4 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.84k op/s 2026-02-24T07:57:27.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:27.236+0000 7f5b5da52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:27.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:27.236+0000 7f5b5da52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:27.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:27.262 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:27.275 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:27.275 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:27.288 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:27.288 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:27.302 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:27.302 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:27.989 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 225919 225791 67.8407 71.1953 0.00327036 0.0147361 2026-02-24T07:57:28.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1651903673' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:28.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 127 235471 235344 68.092 74.6328 0.0150414 0.014679 2026-02-24T07:57:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:28 trial016 ceph-mon[39544]: pgmap v403: 17 pgs: 17 active+clean; 1.4 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.84k op/s 2026-02-24T07:57:29.355 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:29.510 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:29.635 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:29.632+0000 7f753138a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:29.635 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:29.633+0000 7f753138a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:29.649 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:29.650 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:29.674 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:29.674 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:29.692 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:29.693 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:29.705 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:29.705 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:29.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 244363 244235 68.1407 69.4609 0.00308104 0.0146674 2026-02-24T07:57:30.236 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:30.236 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:30.236 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:57:30.237 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:30.262 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/269227970' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:30.390 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:30.733 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:30.731+0000 7f97f926b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:30.734 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:30.731+0000 7f97f926b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:30.885 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:30.885 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:30.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 252063 251935 67.8652 60.1562 0.0142753 0.0147257 2026-02-24T07:57:31.205 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:30 trial016 ceph-mon[39544]: pgmap v404: 17 pgs: 17 active+clean; 1.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.55k op/s 2026-02-24T07:57:31.361 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2026-02-24T07:57:29.828978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1846075936,"num_objects":28162,"num_object_clones":0,"num_object_copies":84486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28162,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":225414,"num_write_kb":1804382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10526860,"kb_used_data":5364924,"kb_used_omap":72,"kb_used_meta":5161783,"kb_avail":2925485940,"statfs":{"total":3006477107200,"available":2995697602560,"internally_reserved":0,"allocated":5493682176,"data_stored":5491911032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74457,"internal_metadata":5285666087},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,5,8,14,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1037475840,"num_objects":15830,"num_object_clones":0,"num_object_copies":47490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126645,"num_write_kb":1013160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001659"},"pg_stats":[{"pgid":"7.f","version":"108'14616","reported_seq":14626,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.926937+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:27.926937+0000","last_peered":"2026-02-24T07:57:27.926937+0000","last_clean":"2026-02-24T07:57:27.926937+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:27.926937+0000","last_undegraded":"2026-02-24T07:57:27.926937+0000","last_fullsized":"2026-02-24T07:57:27.926937+0000","mapping_epoch":106,"log_start":"108'14594","ondisk_log_start":"108'14594","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119734272,"num_objects":1827,"num_object_clones":0,"num_object_copies":5481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14616,"num_write_kb":116928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'13904","reported_seq":13918,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:28.025296+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:28.025296+0000","last_peered":"2026-02-24T07:57:28.025296+0000","last_clean":"2026-02-24T07:57:28.025296+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:28.025296+0000","last_undegraded":"2026-02-24T07:57:28.025296+0000","last_fullsized":"2026-02-24T07:57:28.025296+0000","mapping_epoch":106,"log_start":"108'13880","ondisk_log_start":"108'13880","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113901568,"num_objects":1738,"num_object_clones":0,"num_object_copies":5214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13904,"num_write_kb":111232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'14160","reported_seq":14174,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.828282+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:27.828282+0000","last_peered":"2026-02-24T07:57:27.828282+0000","last_clean":"2026-02-24T07:57:27.828282+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:27.828282+0000","last_undegraded":"2026-02-24T07:57:27.828282+0000","last_fullsized":"2026-02-24T07:57:27.828282+0000","mapping_epoch":106,"log_start":"108'14152","ondisk_log_start":"108'14152","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":1770,"num_object_clones":0,"num_object_copies":5310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14160,"num_write_kb":113280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'14080","reported_seq":14094,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.842896+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:27.842896+0000","last_peered":"2026-02-24T07:57:27.842896+0000","last_clean":"2026-02-24T07:57:27.842896+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:27.842896+0000","last_undegraded":"2026-02-24T07:57:27.842896+0000","last_fullsized":"2026-02-24T07:57:27.842896+0000","mapping_epoch":106,"log_start":"108'14072","ondisk_log_start":"108'14072","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14080,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'14056","reported_seq":14070,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:28.001039+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:28.001039+0000","last_peered":"2026-02-24T07:57:28.001039+0000","last_clean":"2026-02-24T07:57:28.001039+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:28.001039+0000","last_undegraded":"2026-02-24T07:57:28.001039+0000","last_fullsized":"2026-02-24T07:57:28.001039+0000","mapping_epoch":106,"log_start":"108'14040","ondisk_log_start":"108'14040","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115146752,"num_objects":1757,"num_object_clones":0,"num_object_copies":5271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14056,"num_write_kb":112448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'13984","reported_seq":13998,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:28.044509+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:28.044509+0000","last_peered":"2026-02-24T07:57:28.044509+0000","last_clean":"2026-02-24T07:57:28.044509+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:28.044509+0000","last_undegraded":"2026-02-24T07:57:28.044509+0000","last_fullsized":"2026-02-24T07:57:28.044509+0000","mapping_epoch":106,"log_start":"108'13976","ondisk_log_start":"108'13976","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114556928,"num_objects":1748,"num_object_clones":0,"num_object_copies":5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13984,"num_write_kb":111872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'14408","reported_seq":14422,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.921342+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:27.921342+0000","last_peered":"2026-02-24T07:57:27.921342+0000","last_clean":"2026-02-24T07:57:27.921342+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:27.921342+0000","last_undegraded":"2026-02-24T07:57:27.921342+0000","last_fullsized":"2026-02-24T07:57:27.921342+0000","mapping_epoch":106,"log_start":"108'14392","ondisk_log_start":"108'14392","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118030336,"num_objects":1801,"num_object_clones":0,"num_object_copies":5403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14408,"num_write_kb":115264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'14224","reported_seq":14238,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:28.052368+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:28.052368+0000","last_peered":"2026-02-24T07:57:28.052368+0000","last_clean":"2026-02-24T07:57:28.052368+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:28.052368+0000","last_undegraded":"2026-02-24T07:57:28.052368+0000","last_fullsized":"2026-02-24T07:57:28.052368+0000","mapping_epoch":106,"log_start":"108'14218","ondisk_log_start":"108'14218","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116523008,"num_objects":1778,"num_object_clones":0,"num_object_copies":5334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14224,"num_write_kb":113792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'13736","reported_seq":13750,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.857447+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:27.857447+0000","last_peered":"2026-02-24T07:57:27.857447+0000","last_clean":"2026-02-24T07:57:27.857447+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:27.857447+0000","last_undegraded":"2026-02-24T07:57:27.857447+0000","last_fullsized":"2026-02-24T07:57:27.857447+0000","mapping_epoch":106,"log_start":"108'13731","ondisk_log_start":"108'13731","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112525312,"num_objects":1717,"num_object_clones":0,"num_object_copies":5151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13736,"num_write_kb":109888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'13448","reported_seq":13462,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.859139+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:27.859139+0000","last_peered":"2026-02-24T07:57:27.859139+0000","last_clean":"2026-02-24T07:57:27.859139+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:27.859139+0000","last_undegraded":"2026-02-24T07:57:27.859139+0000","last_fullsized":"2026-02-24T07:57:27.859139+0000","mapping_epoch":106,"log_start":"108'13432","ondisk_log_start":"108'13432","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110166016,"num_objects":1681,"num_object_clones":0,"num_object_copies":5043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13448,"num_write_kb":107584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'13967","reported_seq":13976,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.927018+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:27.927018+0000","last_peered":"2026-02-24T07:57:27.927018+0000","last_clean":"2026-02-24T07:57:27.927018+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:27.927018+0000","last_undegraded":"2026-02-24T07:57:27.927018+0000","last_fullsized":"2026-02-24T07:57:27.927018+0000","mapping_epoch":106,"log_start":"108'13956","ondisk_log_start":"108'13956","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114417664,"num_objects":1746,"num_object_clones":0,"num_object_copies":5238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13967,"num_write_kb":111736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'13864","reported_seq":13878,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.913721+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:27.913721+0000","last_peered":"2026-02-24T07:57:27.913721+0000","last_clean":"2026-02-24T07:57:27.913721+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:27.913721+0000","last_undegraded":"2026-02-24T07:57:27.913721+0000","last_fullsized":"2026-02-24T07:57:27.913721+0000","mapping_epoch":106,"log_start":"108'13853","ondisk_log_start":"108'13853","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113573888,"num_objects":1733,"num_object_clones":0,"num_object_copies":5199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13864,"num_write_kb":110912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'14864","reported_seq":14878,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.924211+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:27.924211+0000","last_peered":"2026-02-24T07:57:27.924211+0000","last_clean":"2026-02-24T07:57:27.924211+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:27.924211+0000","last_undegraded":"2026-02-24T07:57:27.924211+0000","last_fullsized":"2026-02-24T07:57:27.924211+0000","mapping_epoch":106,"log_start":"108'14856","ondisk_log_start":"108'14856","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121765888,"num_objects":1858,"num_object_clones":0,"num_object_copies":5574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14864,"num_write_kb":118912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'13480","reported_seq":13494,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.829309+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:27.829309+0000","last_peered":"2026-02-24T07:57:27.829309+0000","last_clean":"2026-02-24T07:57:27.829309+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:27.829309+0000","last_undegraded":"2026-02-24T07:57:27.829309+0000","last_fullsized":"2026-02-24T07:57:27.829309+0000","mapping_epoch":106,"log_start":"108'13476","ondisk_log_start":"108'13476","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13480,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'14368","reported_seq":14382,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.843471+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:27.843471+0000","last_peered":"2026-02-24T07:57:27.843471+0000","last_clean":"2026-02-24T07:57:27.843471+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:27.843471+0000","last_undegraded":"2026-02-24T07:57:27.843471+0000","last_fullsized":"2026-02-24T07:57:27.843471+0000","mapping_epoch":106,"log_start":"108'14360","ondisk_log_start":"108'14360","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":5388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14368,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'14120","reported_seq":14129,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:27.926869+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:27.926869+0000","last_peered":"2026-02-24T07:57:27.926869+0000","last_clean":"2026-02-24T07:57:27.926869+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:27.926869+0000","last_undegraded":"2026-02-24T07:57:27.926869+0000","last_fullsized":"2026-02-24T07:57:27.926869+0000","mapping_epoch":106,"log_start":"108'14104","ondisk_log_start":"108'14104","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115671040,"num_objects":1765,"num_object_clones":0,"num_object_copies":5295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14120,"num_write_kb":112960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:00.882973+0000","last_change":"2026-02-24T07:56:21.738282+0000","last_active":"2026-02-24T07:57:00.882973+0000","last_peered":"2026-02-24T07:57:00.882973+0000","last_clean":"2026-02-24T07:57:00.882973+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:00.882973+0000","last_undegraded":"2026-02-24T07:57:00.882973+0000","last_fullsized":"2026-02-24T07:57:00.882973+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:56:21.738257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:56:21.738257+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:32.061846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1845485568,"num_objects":28160,"num_object_clones":0,"num_object_copies":84480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225279,"num_write_kb":1802232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5540659200,"data_stored":5540659200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215235,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3068288,"kb_used_data":1208876,"kb_used_omap":29,"kb_used_meta":1859362,"kb_avail":730934912,"statfs":{"total":751619276800,"available":748477349888,"internally_reserved":0,"allocated":1237889024,"data_stored":1237445350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30099,"internal_metadata":1903987309},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1924496,"kb_used_data":1114044,"kb_used_omap":9,"kb_used_meta":810422,"kb_avail":732078704,"statfs":{"total":751619276800,"available":749648592896,"internally_reserved":0,"allocated":1140781056,"data_stored":1140337382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9475,"internal_metadata":829872893},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,8,14,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3360132,"kb_used_data":1465392,"kb_used_omap":24,"kb_used_meta":1894695,"kb_avail":730643068,"statfs":{"total":751619276800,"available":748178501632,"internally_reserved":0,"allocated":1500561408,"data_stored":1500121286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1940168538},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705801,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2173944,"kb_used_data":1576612,"kb_used_omap":9,"kb_used_meta":597302,"kb_avail":731829256,"statfs":{"total":751619276800,"available":749393158144,"internally_reserved":0,"allocated":1614450688,"data_stored":1614007014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":611637347},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,5,0,0,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7402,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1614594048,"data_stored":1614594048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1517264896,"data_stored":1517264896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1147035648,"data_stored":1147035648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1261764608,"data_stored":1261764608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:31.363 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:57:31.363 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 201 2026-02-24T07:57:31.550 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:31.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:31.686+0000 7fd64f490640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:31.689 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:31.686+0000 7fd64f490640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:31.823 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:31.848 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:57:31.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:31.981 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:31.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 259964 259836 67.6604 61.7266 0.00836636 0.0147755 2026-02-24T07:57:32.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:32.110+0000 7fc3a0adf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:32.113 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:31 trial016 ceph-mon[39544]: from='client.15355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:32.113 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3450862411' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "201"} : dispatch 2026-02-24T07:57:32.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:32.110+0000 7fc3a0adf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:32.130 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:32.131 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:32.146 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:32.147 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:32.162 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:32.163 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:32.177 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:32.177 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:32.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 127 269400 269273 67.8559 73.7266 0.00800105 0.014733 2026-02-24T07:57:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:32 trial016 ceph-mon[39544]: pgmap v405: 17 pgs: 17 active+clean; 1.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.91k op/s 2026-02-24T07:57:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4221692462' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:33.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 128 278750 278622 68.0177 73.0391 0.00971082 0.0146976 2026-02-24T07:57:34.226 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:57:34.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:33 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:57:34.373 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:34.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:34.500+0000 7f5425a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:34.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:34.502+0000 7f5425a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:34.524 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:34.524 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:34.540 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:34.541 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:34.557 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:34.557 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:34.569 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:34.569 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:34.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 128 288060 287932 68.1604 72.7344 0.00329828 0.0146683 2026-02-24T07:57:35.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:34 trial016 ceph-mon[39544]: pgmap v406: 17 pgs: 17 active+clean; 2.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.53k op/s 2026-02-24T07:57:35.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3820254669' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:35.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 127 297157 297030 68.2461 71.0781 0.00318746 0.0146503 2026-02-24T07:57:36.615 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:36.767 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:36.900 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:36.900 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:36.900 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_5 2026-02-24T07:57:36.900 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:36.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 305374 305246 68.13 64.1875 0.0126442 0.0146723 2026-02-24T07:57:37.122 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:37.175 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:36 trial016 ceph-mon[39544]: pgmap v407: 17 pgs: 17 active+clean; 2.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.33k op/s 2026-02-24T07:57:37.197 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:37.172+0000 7ff49dd9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:37.197 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:37.173+0000 7ff49dd9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:37.211 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:37.211 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:37.231 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:37.232 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:37.244 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:37.245 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:37.259 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:37.260 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:37.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 311776 311648 67.6267 50.0156 0.00746532 0.0147738 2026-02-24T07:57:38.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/473216461' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:38.517 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:38.471+0000 7f23e199f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:38.517 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:38.471+0000 7f23e199f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:38.624 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:38.625 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:38.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 128 318310 318182 67.1785 51.0469 0.00456933 0.0148817 2026-02-24T07:57:39.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:38 trial016 ceph-mon[39544]: pgmap v408: 17 pgs: 17 active+clean; 2.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.33k op/s 2026-02-24T07:57:39.317 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2026-02-24T07:57:37.830084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2202010144,"num_objects":33593,"num_object_clones":0,"num_object_copies":100779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33593,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":268863,"num_write_kb":2151974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9729684,"kb_used_data":6405308,"kb_used_omap":52,"kb_used_meta":3324235,"kb_avail":2926283116,"statfs":{"total":3006477107200,"available":2996513910784,"internally_reserved":0,"allocated":6559035392,"data_stored":6557264248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53873,"internal_metadata":3404017039},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6,8,10,2,24],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":721100800,"num_objects":11002,"num_object_clones":0,"num_object_copies":33006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88025,"num_write_kb":704200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001657"},"pg_stats":[{"pgid":"7.f","version":"108'17128","reported_seq":17142,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.938075+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:32.938075+0000","last_peered":"2026-02-24T07:57:32.938075+0000","last_clean":"2026-02-24T07:57:32.938075+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:32.938075+0000","last_undegraded":"2026-02-24T07:57:32.938075+0000","last_fullsized":"2026-02-24T07:57:32.938075+0000","mapping_epoch":106,"log_start":"108'17120","ondisk_log_start":"108'17120","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140312576,"num_objects":2141,"num_object_clones":0,"num_object_copies":6423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17128,"num_write_kb":137024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'16792","reported_seq":16802,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:33.060922+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:33.060922+0000","last_peered":"2026-02-24T07:57:33.060922+0000","last_clean":"2026-02-24T07:57:33.060922+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:33.060922+0000","last_undegraded":"2026-02-24T07:57:33.060922+0000","last_fullsized":"2026-02-24T07:57:33.060922+0000","mapping_epoch":106,"log_start":"108'16768","ondisk_log_start":"108'16768","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137560064,"num_objects":2099,"num_object_clones":0,"num_object_copies":6297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16792,"num_write_kb":134336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'17176","reported_seq":17190,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.833651+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:32.833651+0000","last_peered":"2026-02-24T07:57:32.833651+0000","last_clean":"2026-02-24T07:57:32.833651+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:32.833651+0000","last_undegraded":"2026-02-24T07:57:32.833651+0000","last_fullsized":"2026-02-24T07:57:32.833651+0000","mapping_epoch":106,"log_start":"108'17165","ondisk_log_start":"108'17165","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140705792,"num_objects":2147,"num_object_clones":0,"num_object_copies":6441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17176,"num_write_kb":137408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'16760","reported_seq":16774,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.848730+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:32.848730+0000","last_peered":"2026-02-24T07:57:32.848730+0000","last_clean":"2026-02-24T07:57:32.848730+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:32.848730+0000","last_undegraded":"2026-02-24T07:57:32.848730+0000","last_fullsized":"2026-02-24T07:57:32.848730+0000","mapping_epoch":106,"log_start":"108'16753","ondisk_log_start":"108'16753","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137297920,"num_objects":2095,"num_object_clones":0,"num_object_copies":6285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16760,"num_write_kb":134080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'16728","reported_seq":16735,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:33.045755+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:33.045755+0000","last_peered":"2026-02-24T07:57:33.045755+0000","last_clean":"2026-02-24T07:57:33.045755+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:33.045755+0000","last_undegraded":"2026-02-24T07:57:33.045755+0000","last_fullsized":"2026-02-24T07:57:33.045755+0000","mapping_epoch":106,"log_start":"108'16720","ondisk_log_start":"108'16720","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137035776,"num_objects":2091,"num_object_clones":0,"num_object_copies":6273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16728,"num_write_kb":133824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'16696","reported_seq":16710,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:33.040403+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:33.040403+0000","last_peered":"2026-02-24T07:57:33.040403+0000","last_clean":"2026-02-24T07:57:33.040403+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:33.040403+0000","last_undegraded":"2026-02-24T07:57:33.040403+0000","last_fullsized":"2026-02-24T07:57:33.040403+0000","mapping_epoch":106,"log_start":"108'16688","ondisk_log_start":"108'16688","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136773632,"num_objects":2087,"num_object_clones":0,"num_object_copies":6261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2087,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16696,"num_write_kb":133568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'16944","reported_seq":16958,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.929576+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:32.929576+0000","last_peered":"2026-02-24T07:57:32.929576+0000","last_clean":"2026-02-24T07:57:32.929576+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:32.929576+0000","last_undegraded":"2026-02-24T07:57:32.929576+0000","last_fullsized":"2026-02-24T07:57:32.929576+0000","mapping_epoch":106,"log_start":"108'16936","ondisk_log_start":"108'16936","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138805248,"num_objects":2118,"num_object_clones":0,"num_object_copies":6354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16944,"num_write_kb":135552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'16960","reported_seq":16974,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:33.038641+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:33.038641+0000","last_peered":"2026-02-24T07:57:33.038641+0000","last_clean":"2026-02-24T07:57:33.038641+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:33.038641+0000","last_undegraded":"2026-02-24T07:57:33.038641+0000","last_fullsized":"2026-02-24T07:57:33.038641+0000","mapping_epoch":106,"log_start":"108'16954","ondisk_log_start":"108'16954","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138936320,"num_objects":2120,"num_object_clones":0,"num_object_copies":6360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16960,"num_write_kb":135680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'16880","reported_seq":16890,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.867807+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:32.867807+0000","last_peered":"2026-02-24T07:57:32.867807+0000","last_clean":"2026-02-24T07:57:32.867807+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:32.867807+0000","last_undegraded":"2026-02-24T07:57:32.867807+0000","last_fullsized":"2026-02-24T07:57:32.867807+0000","mapping_epoch":106,"log_start":"108'16872","ondisk_log_start":"108'16872","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138280960,"num_objects":2110,"num_object_clones":0,"num_object_copies":6330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16880,"num_write_kb":135040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'16104","reported_seq":16118,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.853987+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:32.853987+0000","last_peered":"2026-02-24T07:57:32.853987+0000","last_clean":"2026-02-24T07:57:32.853987+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:32.853987+0000","last_undegraded":"2026-02-24T07:57:32.853987+0000","last_fullsized":"2026-02-24T07:57:32.853987+0000","mapping_epoch":106,"log_start":"108'16088","ondisk_log_start":"108'16088","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131923968,"num_objects":2013,"num_object_clones":0,"num_object_copies":6039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16104,"num_write_kb":128832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'16664","reported_seq":16678,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.937828+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:32.937828+0000","last_peered":"2026-02-24T07:57:32.937828+0000","last_clean":"2026-02-24T07:57:32.937828+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:32.937828+0000","last_undegraded":"2026-02-24T07:57:32.937828+0000","last_fullsized":"2026-02-24T07:57:32.937828+0000","mapping_epoch":106,"log_start":"108'16656","ondisk_log_start":"108'16656","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136511488,"num_objects":2083,"num_object_clones":0,"num_object_copies":6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16664,"num_write_kb":133312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'16520","reported_seq":16534,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.926802+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:32.926802+0000","last_peered":"2026-02-24T07:57:32.926802+0000","last_clean":"2026-02-24T07:57:32.926802+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:32.926802+0000","last_undegraded":"2026-02-24T07:57:32.926802+0000","last_fullsized":"2026-02-24T07:57:32.926802+0000","mapping_epoch":106,"log_start":"108'16512","ondisk_log_start":"108'16512","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135331840,"num_objects":2065,"num_object_clones":0,"num_object_copies":6195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16520,"num_write_kb":132160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'17592","reported_seq":17606,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.930229+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:32.930229+0000","last_peered":"2026-02-24T07:57:32.930229+0000","last_clean":"2026-02-24T07:57:32.930229+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:32.930229+0000","last_undegraded":"2026-02-24T07:57:32.930229+0000","last_fullsized":"2026-02-24T07:57:32.930229+0000","mapping_epoch":106,"log_start":"108'17584","ondisk_log_start":"108'17584","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144113664,"num_objects":2199,"num_object_clones":0,"num_object_copies":6597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17592,"num_write_kb":140736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'15992","reported_seq":16006,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.850202+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:32.850202+0000","last_peered":"2026-02-24T07:57:32.850202+0000","last_clean":"2026-02-24T07:57:32.850202+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:32.850202+0000","last_undegraded":"2026-02-24T07:57:32.850202+0000","last_fullsized":"2026-02-24T07:57:32.850202+0000","mapping_epoch":106,"log_start":"108'15987","ondisk_log_start":"108'15987","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131006464,"num_objects":1999,"num_object_clones":0,"num_object_copies":5997,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15992,"num_write_kb":127936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'17000","reported_seq":17014,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.839720+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:32.839720+0000","last_peered":"2026-02-24T07:57:32.839720+0000","last_clean":"2026-02-24T07:57:32.839720+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:32.839720+0000","last_undegraded":"2026-02-24T07:57:32.839720+0000","last_fullsized":"2026-02-24T07:57:32.839720+0000","mapping_epoch":106,"log_start":"108'16996","ondisk_log_start":"108'16996","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139264000,"num_objects":2125,"num_object_clones":0,"num_object_copies":6375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17000,"num_write_kb":136000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'16792","reported_seq":16800,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.938037+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:32.938037+0000","last_peered":"2026-02-24T07:57:32.938037+0000","last_clean":"2026-02-24T07:57:32.938037+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:32.938037+0000","last_undegraded":"2026-02-24T07:57:32.938037+0000","last_fullsized":"2026-02-24T07:57:32.938037+0000","mapping_epoch":106,"log_start":"108'16784","ondisk_log_start":"108'16784","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137560064,"num_objects":2099,"num_object_clones":0,"num_object_copies":6297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16792,"num_write_kb":134336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451744+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451744+0000","last_peered":"2026-02-24T07:57:32.451744+0000","last_clean":"2026-02-24T07:57:32.451744+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451744+0000","last_undegraded":"2026-02-24T07:57:32.451744+0000","last_fullsized":"2026-02-24T07:57:32.451744+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2201419776,"num_objects":33591,"num_object_clones":0,"num_object_copies":100773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268728,"num_write_kb":2149824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6606479360,"data_stored":6606479360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215236,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1704576,"kb_used_data":1448164,"kb_used_omap":9,"kb_used_meta":256374,"kb_avail":732298624,"statfs":{"total":751619276800,"available":749873790976,"internally_reserved":0,"allocated":1482919936,"data_stored":1482476262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9515,"internal_metadata":262527701},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2200544,"kb_used_data":1335948,"kb_used_omap":9,"kb_used_meta":864566,"kb_avail":731802656,"statfs":{"total":751619276800,"available":749365919744,"internally_reserved":0,"allocated":1368010752,"data_stored":1367567078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9475,"internal_metadata":885316349},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,20],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3276740,"kb_used_data":1742896,"kb_used_omap":24,"kb_used_meta":1533799,"kb_avail":730726460,"statfs":{"total":751619276800,"available":748263895040,"internally_reserved":0,"allocated":1784725504,"data_stored":1784285382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1570611034},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6,8,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705802,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2547824,"kb_used_data":1878300,"kb_used_omap":9,"kb_used_meta":669494,"kb_avail":731455376,"statfs":{"total":751619276800,"available":749010305024,"internally_reserved":0,"allocated":1923379200,"data_stored":1922935526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":685561955},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1925660672,"data_stored":1925660672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1804992512,"data_stored":1804992512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1370644480,"data_stored":1370644480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1505181696,"data_stored":1505181696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:39.319 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_5 pgp_num 36 2026-02-24T07:57:39.477 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:39.990 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 127 324572 324445 66.6981 48.9297 0.00368984 0.0149788 2026-02-24T07:57:40.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:39.965+0000 7ffa39a20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:40.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:39.965+0000 7ffa39a20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:40.115 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:57:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:39 trial016 ceph-mon[39544]: from='client.15365 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:40.338 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:40.529 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:40.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:40.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 128 330558 330430 66.1868 46.7578 0.0552124 0.0150964 2026-02-24T07:57:41.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:41.022+0000 7fdefdea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:41.078 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:41.022+0000 7fdefdea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:41.078 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:41.078 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:41.078 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:41.078 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:41.084 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:41.084 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:41.101 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:41.101 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:40 trial016 ceph-mon[39544]: pgmap v409: 17 pgs: 17 active+clean; 2.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.89k op/s 2026-02-24T07:57:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/88027582' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pgp_num", "val": "36"} : dispatch 2026-02-24T07:57:41.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:57:41.989775+0000 min lat: 0.000574286 max lat: 0.119549 avg lat: 0.0151385 2026-02-24T07:57:41.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:57:41.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 127 338256 338129 66.0357 60.1484 0.0197175 0.0151385 2026-02-24T07:57:42.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2376435209' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:42.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 127 347138 347011 66.1174 69.3906 0.0264962 0.015118 2026-02-24T07:57:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:42 trial016 ceph-mon[39544]: pgmap v410: 17 pgs: 17 active+clean; 2.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.18k op/s 2026-02-24T07:57:43.625 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:43.779 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:43.904 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:43.901+0000 7f2db83e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:43.905 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:43.901+0000 7f2db83e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:43.920 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:43.921 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:43.932 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:43.932 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:43.945 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:43.945 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:43.957 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:43.957 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:43.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 128 356828 356700 66.3453 75.6953 0.00378594 0.0150693 2026-02-24T07:57:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1487969346' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:44.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 366109 365981 66.4885 72.5078 0.0273743 0.0150349 2026-02-24T07:57:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:44 trial016 ceph-mon[39544]: pgmap v411: 17 pgs: 17 active+clean; 2.6 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.12k op/s 2026-02-24T07:57:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:45.663 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:45.664 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:45.664 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T07:57:45.664 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:45.815 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:45.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 374773 374645 66.5156 67.6875 0.00315712 0.0150312 2026-02-24T07:57:46.004 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:46.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.127+0000 7efe8f3ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.127+0000 7efe8f3ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.140 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:46.276 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:46.277 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:46.652 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2026-02-24T07:57:45.831183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2840863264,"num_objects":43342,"num_object_clones":0,"num_object_copies":130026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43342,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":346848,"num_write_kb":2775854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12178884,"kb_used_data":8222260,"kb_used_omap":53,"kb_used_meta":3956490,"kb_avail":2923833916,"statfs":{"total":3006477107200,"available":2994005929984,"internally_reserved":0,"allocated":8419594240,"data_stored":8417823096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55239,"internal_metadata":4051445817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,4,46,32],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":638853120,"num_objects":9749,"num_object_clones":0,"num_object_copies":29247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77985,"num_write_kb":623880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001649"},"pg_stats":[{"pgid":"7.f","version":"108'21832","reported_seq":21846,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.921216+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:42.921216+0000","last_peered":"2026-02-24T07:57:42.921216+0000","last_clean":"2026-02-24T07:57:42.921216+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:42.921216+0000","last_undegraded":"2026-02-24T07:57:42.921216+0000","last_fullsized":"2026-02-24T07:57:42.921216+0000","mapping_epoch":106,"log_start":"108'21824","ondisk_log_start":"108'21824","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178847744,"num_objects":2729,"num_object_clones":0,"num_object_copies":8187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21832,"num_write_kb":174656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'21504","reported_seq":21512,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:43.059598+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:43.059598+0000","last_peered":"2026-02-24T07:57:43.059598+0000","last_clean":"2026-02-24T07:57:43.059598+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:43.059598+0000","last_undegraded":"2026-02-24T07:57:43.059598+0000","last_fullsized":"2026-02-24T07:57:43.059598+0000","mapping_epoch":106,"log_start":"108'21496","ondisk_log_start":"108'21496","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":2688,"num_object_clones":0,"num_object_copies":8064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21504,"num_write_kb":172032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'22400","reported_seq":22414,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.847749+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:42.847749+0000","last_peered":"2026-02-24T07:57:42.847749+0000","last_clean":"2026-02-24T07:57:42.847749+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:42.847749+0000","last_undegraded":"2026-02-24T07:57:42.847749+0000","last_fullsized":"2026-02-24T07:57:42.847749+0000","mapping_epoch":106,"log_start":"108'22393","ondisk_log_start":"108'22393","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183500800,"num_objects":2800,"num_object_clones":0,"num_object_copies":8400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22400,"num_write_kb":179200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'21679","reported_seq":21690,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.857052+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:42.857052+0000","last_peered":"2026-02-24T07:57:42.857052+0000","last_clean":"2026-02-24T07:57:42.857052+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:42.857052+0000","last_undegraded":"2026-02-24T07:57:42.857052+0000","last_fullsized":"2026-02-24T07:57:42.857052+0000","mapping_epoch":106,"log_start":"108'21675","ondisk_log_start":"108'21675","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177594368,"num_objects":2710,"num_object_clones":0,"num_object_copies":8130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21679,"num_write_kb":173432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'21832","reported_seq":21846,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:43.053465+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:43.053465+0000","last_peered":"2026-02-24T07:57:43.053465+0000","last_clean":"2026-02-24T07:57:43.053465+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:43.053465+0000","last_undegraded":"2026-02-24T07:57:43.053465+0000","last_fullsized":"2026-02-24T07:57:43.053465+0000","mapping_epoch":106,"log_start":"108'21824","ondisk_log_start":"108'21824","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178847744,"num_objects":2729,"num_object_clones":0,"num_object_copies":8187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21832,"num_write_kb":174656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'21234","reported_seq":21237,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:43.064212+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:43.064212+0000","last_peered":"2026-02-24T07:57:43.064212+0000","last_clean":"2026-02-24T07:57:43.064212+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:43.064212+0000","last_undegraded":"2026-02-24T07:57:43.064212+0000","last_fullsized":"2026-02-24T07:57:43.064212+0000","mapping_epoch":106,"log_start":"108'21222","ondisk_log_start":"108'21222","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173948928,"num_objects":2655,"num_object_clones":0,"num_object_copies":7965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21234,"num_write_kb":169872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'22088","reported_seq":22102,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.919211+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:42.919211+0000","last_peered":"2026-02-24T07:57:42.919211+0000","last_clean":"2026-02-24T07:57:42.919211+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:42.919211+0000","last_undegraded":"2026-02-24T07:57:42.919211+0000","last_fullsized":"2026-02-24T07:57:42.919211+0000","mapping_epoch":106,"log_start":"108'22080","ondisk_log_start":"108'22080","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":8283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22088,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'22048","reported_seq":22062,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:43.050627+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:43.050627+0000","last_peered":"2026-02-24T07:57:43.050627+0000","last_clean":"2026-02-24T07:57:43.050627+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:43.050627+0000","last_undegraded":"2026-02-24T07:57:43.050627+0000","last_fullsized":"2026-02-24T07:57:43.050627+0000","mapping_epoch":106,"log_start":"108'22027","ondisk_log_start":"108'22027","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180617216,"num_objects":2756,"num_object_clones":0,"num_object_copies":8268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22048,"num_write_kb":176384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'21656","reported_seq":21667,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.856438+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:42.856438+0000","last_peered":"2026-02-24T07:57:42.856438+0000","last_clean":"2026-02-24T07:57:42.856438+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:42.856438+0000","last_undegraded":"2026-02-24T07:57:42.856438+0000","last_fullsized":"2026-02-24T07:57:42.856438+0000","mapping_epoch":106,"log_start":"108'21648","ondisk_log_start":"108'21648","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177405952,"num_objects":2707,"num_object_clones":0,"num_object_copies":8121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21656,"num_write_kb":173248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'20760","reported_seq":20774,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.856971+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:42.856971+0000","last_peered":"2026-02-24T07:57:42.856971+0000","last_clean":"2026-02-24T07:57:42.856971+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:42.856971+0000","last_undegraded":"2026-02-24T07:57:42.856971+0000","last_fullsized":"2026-02-24T07:57:42.856971+0000","mapping_epoch":106,"log_start":"108'20731","ondisk_log_start":"108'20731","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170065920,"num_objects":2595,"num_object_clones":0,"num_object_copies":7785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20760,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'21632","reported_seq":21646,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.919545+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:42.919545+0000","last_peered":"2026-02-24T07:57:42.919545+0000","last_clean":"2026-02-24T07:57:42.919545+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:42.919545+0000","last_undegraded":"2026-02-24T07:57:42.919545+0000","last_fullsized":"2026-02-24T07:57:42.919545+0000","mapping_epoch":106,"log_start":"108'21616","ondisk_log_start":"108'21616","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177209344,"num_objects":2704,"num_object_clones":0,"num_object_copies":8112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21632,"num_write_kb":173056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'21480","reported_seq":21489,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.937143+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:42.937143+0000","last_peered":"2026-02-24T07:57:42.937143+0000","last_clean":"2026-02-24T07:57:42.937143+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:42.937143+0000","last_undegraded":"2026-02-24T07:57:42.937143+0000","last_fullsized":"2026-02-24T07:57:42.937143+0000","mapping_epoch":106,"log_start":"108'21472","ondisk_log_start":"108'21472","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175964160,"num_objects":2685,"num_object_clones":0,"num_object_copies":8055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21480,"num_write_kb":171840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'22384","reported_seq":22398,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.920623+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:42.920623+0000","last_peered":"2026-02-24T07:57:42.920623+0000","last_clean":"2026-02-24T07:57:42.920623+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:42.920623+0000","last_undegraded":"2026-02-24T07:57:42.920623+0000","last_fullsized":"2026-02-24T07:57:42.920623+0000","mapping_epoch":106,"log_start":"108'22360","ondisk_log_start":"108'22360","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183369728,"num_objects":2798,"num_object_clones":0,"num_object_copies":8394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22384,"num_write_kb":179072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'20664","reported_seq":20677,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.857870+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:42.857870+0000","last_peered":"2026-02-24T07:57:42.857870+0000","last_clean":"2026-02-24T07:57:42.857870+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:42.857870+0000","last_undegraded":"2026-02-24T07:57:42.857870+0000","last_fullsized":"2026-02-24T07:57:42.857870+0000","mapping_epoch":106,"log_start":"108'20661","ondisk_log_start":"108'20661","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169279488,"num_objects":2583,"num_object_clones":0,"num_object_copies":7749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20664,"num_write_kb":165312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'22032","reported_seq":22046,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.811775+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:42.811775+0000","last_peered":"2026-02-24T07:57:42.811775+0000","last_clean":"2026-02-24T07:57:42.811775+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:42.811775+0000","last_undegraded":"2026-02-24T07:57:42.811775+0000","last_fullsized":"2026-02-24T07:57:42.811775+0000","mapping_epoch":106,"log_start":"108'22024","ondisk_log_start":"108'22024","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180486144,"num_objects":2754,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22032,"num_write_kb":176256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'21488","reported_seq":21502,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:42.918600+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:42.918600+0000","last_peered":"2026-02-24T07:57:42.918600+0000","last_clean":"2026-02-24T07:57:42.918600+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:42.918600+0000","last_undegraded":"2026-02-24T07:57:42.918600+0000","last_fullsized":"2026-02-24T07:57:42.918600+0000","mapping_epoch":106,"log_start":"108'21480","ondisk_log_start":"108'21480","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176029696,"num_objects":2686,"num_object_clones":0,"num_object_copies":8058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2686,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21488,"num_write_kb":171904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451744+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451744+0000","last_peered":"2026-02-24T07:57:32.451744+0000","last_clean":"2026-02-24T07:57:32.451744+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451744+0000","last_undegraded":"2026-02-24T07:57:32.451744+0000","last_fullsized":"2026-02-24T07:57:32.451744+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2840272896,"num_objects":43340,"num_object_clones":0,"num_object_copies":130020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346713,"num_write_kb":2773704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8521703424,"data_stored":8521703424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215238,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2277152,"kb_used_data":1876364,"kb_used_omap":9,"kb_used_meta":400758,"kb_avail":731726048,"statfs":{"total":751619276800,"available":749287473152,"internally_reserved":0,"allocated":1921396736,"data_stored":1920953062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":410376203},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2735920,"kb_used_data":1726940,"kb_used_omap":9,"kb_used_meta":1008950,"kb_avail":731267280,"statfs":{"total":751619276800,"available":748817694720,"internally_reserved":0,"allocated":1768386560,"data_stored":1767942886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1033164913},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3947556,"kb_used_data":2250704,"kb_used_omap":24,"kb_used_meta":1696807,"kb_avail":730055644,"statfs":{"total":751619276800,"available":747576979456,"internally_reserved":0,"allocated":2304720896,"data_stored":2304280774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1737531226},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,12],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705804,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3218256,"kb_used_data":2368252,"kb_used_omap":9,"kb_used_meta":849974,"kb_avail":730784944,"statfs":{"total":751619276800,"available":748323782656,"internally_reserved":0,"allocated":2425090048,"data_stored":2424646374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":870373475},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,31,26],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2482216960,"data_stored":2482216960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2326044672,"data_stored":2326044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1774436352,"data_stored":1774436352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1939005440,"data_stored":1939005440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:46.652 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:57:46.652 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 46 2026-02-24T07:57:46.698 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.696+0000 7fe7d829e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.698 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.696+0000 7fe7d829e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.719 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:46.719 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:46.738 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:46.739 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:46.752 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:46.752 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:46.764 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:46.765 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:46.805 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:46.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.942+0000 7f0e07cbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:46.943+0000 7f0e07cbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:46.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 128 381525 381397 66.2096 52.75 0.00842748 0.0150996 2026-02-24T07:57:47.091 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:57:47.091 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:46 trial016 ceph-mon[39544]: pgmap v412: 17 pgs: 17 active+clean; 2.6 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.50k op/s 2026-02-24T07:57:47.091 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2500439644' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:47.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:47.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 127 389260 389133 66.084 60.4375 0.00817703 0.0151277 2026-02-24T07:57:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:47 trial016 ceph-mon[39544]: from='client.15373 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:48.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/251859959' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T07:57:48.818 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:48.972 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:48.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 128 398716 398588 66.2495 73.8672 0.00575234 0.0150914 2026-02-24T07:57:49.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:49.100+0000 7eff058c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:49.103 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:48 trial016 ceph-mon[39544]: pgmap v413: 17 pgs: 17 active+clean; 2.6 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.50k op/s 2026-02-24T07:57:49.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:49.100+0000 7eff058c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:49.126 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:49.126 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:49.145 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:49.145 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:49.160 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:49.160 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:49.175 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:49.175 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:49.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 408215 408087 66.4152 74.2109 0.00314345 0.0150497 2026-02-24T07:57:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4260388593' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:50.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 127 418354 418227 66.6764 79.2188 0.00647752 0.0149955 2026-02-24T07:57:51.225 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:51.250 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:50 trial016 ceph-mon[39544]: pgmap v414: 17 pgs: 17 active+clean; 3.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 10.00k op/s 2026-02-24T07:57:51.380 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:51.519 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:51.516+0000 7fc140adc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:51.519 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:51.517+0000 7fc140adc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:51.537 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:51.538 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:51.555 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:51.555 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:51.574 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:51.574 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:51.586 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:51.586 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:51.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 428062 427934 66.8595 75.8359 0.0168606 0.0149547 2026-02-24T07:57:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1225319243' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:52.496 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:52.496 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:52.496 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:57:52.496 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:52.645 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:52.909 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:52.906+0000 7fd756c30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:52.907+0000 7fd756c30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:52.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 127 437010 436883 66.9192 69.9141 0.00222626 0.0149382 2026-02-24T07:57:53.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:52 trial016 ceph-mon[39544]: pgmap v415: 17 pgs: 17 active+clean; 3.0 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.45k op/s 2026-02-24T07:57:53.068 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:53.068 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:53.117 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2026-02-24T07:57:51.832006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3185517088,"num_objects":48601,"num_object_clones":0,"num_object_copies":145803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48601,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":388920,"num_write_kb":3112430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13632108,"kb_used_data":9281372,"kb_used_omap":53,"kb_used_meta":4350602,"kb_avail":2922380692,"statfs":{"total":3006477107200,"available":2992517828608,"internally_reserved":0,"allocated":9504124928,"data_stored":9502353784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55239,"internal_metadata":4455016505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,8,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":633905152,"num_objects":9672,"num_object_clones":0,"num_object_copies":29016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77381,"num_write_kb":619048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001659"},"pg_stats":[{"pgid":"7.f","version":"108'24544","reported_seq":24558,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.911954+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:47.911954+0000","last_peered":"2026-02-24T07:57:47.911954+0000","last_clean":"2026-02-24T07:57:47.911954+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:47.911954+0000","last_undegraded":"2026-02-24T07:57:47.911954+0000","last_fullsized":"2026-02-24T07:57:47.911954+0000","mapping_epoch":106,"log_start":"108'24522","ondisk_log_start":"108'24522","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201064448,"num_objects":3068,"num_object_clones":0,"num_object_copies":9204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24544,"num_write_kb":196352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'23960","reported_seq":23974,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:48.045754+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:48.045754+0000","last_peered":"2026-02-24T07:57:48.045754+0000","last_clean":"2026-02-24T07:57:48.045754+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:48.045754+0000","last_undegraded":"2026-02-24T07:57:48.045754+0000","last_fullsized":"2026-02-24T07:57:48.045754+0000","mapping_epoch":106,"log_start":"108'23952","ondisk_log_start":"108'23952","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196280320,"num_objects":2995,"num_object_clones":0,"num_object_copies":8985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23960,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'25080","reported_seq":25094,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.839693+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:47.839693+0000","last_peered":"2026-02-24T07:57:47.839693+0000","last_clean":"2026-02-24T07:57:47.839693+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:47.839693+0000","last_undegraded":"2026-02-24T07:57:47.839693+0000","last_fullsized":"2026-02-24T07:57:47.839693+0000","mapping_epoch":106,"log_start":"108'25072","ondisk_log_start":"108'25072","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205455360,"num_objects":3135,"num_object_clones":0,"num_object_copies":9405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25080,"num_write_kb":200640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'24600","reported_seq":24601,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.858740+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:47.858740+0000","last_peered":"2026-02-24T07:57:47.858740+0000","last_clean":"2026-02-24T07:57:47.858740+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:47.858740+0000","last_undegraded":"2026-02-24T07:57:47.858740+0000","last_fullsized":"2026-02-24T07:57:47.858740+0000","mapping_epoch":106,"log_start":"108'24584","ondisk_log_start":"108'24584","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201523200,"num_objects":3075,"num_object_clones":0,"num_object_copies":9225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24600,"num_write_kb":196800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'24408","reported_seq":24422,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:48.067743+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:48.067743+0000","last_peered":"2026-02-24T07:57:48.067743+0000","last_clean":"2026-02-24T07:57:48.067743+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:48.067743+0000","last_undegraded":"2026-02-24T07:57:48.067743+0000","last_fullsized":"2026-02-24T07:57:48.067743+0000","mapping_epoch":106,"log_start":"108'24392","ondisk_log_start":"108'24392","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199950336,"num_objects":3051,"num_object_clones":0,"num_object_copies":9153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24408,"num_write_kb":195264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'23977","reported_seq":23990,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:48.066665+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:48.066665+0000","last_peered":"2026-02-24T07:57:48.066665+0000","last_clean":"2026-02-24T07:57:48.066665+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:48.066665+0000","last_undegraded":"2026-02-24T07:57:48.066665+0000","last_fullsized":"2026-02-24T07:57:48.066665+0000","mapping_epoch":106,"log_start":"108'23972","ondisk_log_start":"108'23972","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196419584,"num_objects":2998,"num_object_clones":0,"num_object_copies":8994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23977,"num_write_kb":191816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'24832","reported_seq":24838,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.940634+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:47.940634+0000","last_peered":"2026-02-24T07:57:47.940634+0000","last_clean":"2026-02-24T07:57:47.940634+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:47.940634+0000","last_undegraded":"2026-02-24T07:57:47.940634+0000","last_fullsized":"2026-02-24T07:57:47.940634+0000","mapping_epoch":106,"log_start":"108'24816","ondisk_log_start":"108'24816","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203423744,"num_objects":3104,"num_object_clones":0,"num_object_copies":9312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24832,"num_write_kb":198656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'24656","reported_seq":24664,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:48.066798+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:48.066798+0000","last_peered":"2026-02-24T07:57:48.066798+0000","last_clean":"2026-02-24T07:57:48.066798+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:48.066798+0000","last_undegraded":"2026-02-24T07:57:48.066798+0000","last_fullsized":"2026-02-24T07:57:48.066798+0000","mapping_epoch":106,"log_start":"108'24648","ondisk_log_start":"108'24648","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201981952,"num_objects":3082,"num_object_clones":0,"num_object_copies":9246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3082,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24656,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'24304","reported_seq":24318,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.861996+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:47.861996+0000","last_peered":"2026-02-24T07:57:47.861996+0000","last_clean":"2026-02-24T07:57:47.861996+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:47.861996+0000","last_undegraded":"2026-02-24T07:57:47.861996+0000","last_fullsized":"2026-02-24T07:57:47.861996+0000","mapping_epoch":106,"log_start":"108'24298","ondisk_log_start":"108'24298","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199098368,"num_objects":3038,"num_object_clones":0,"num_object_copies":9114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24304,"num_write_kb":194432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'23192","reported_seq":23206,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.868243+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:47.868243+0000","last_peered":"2026-02-24T07:57:47.868243+0000","last_clean":"2026-02-24T07:57:47.868243+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:47.868243+0000","last_undegraded":"2026-02-24T07:57:47.868243+0000","last_fullsized":"2026-02-24T07:57:47.868243+0000","mapping_epoch":106,"log_start":"108'23184","ondisk_log_start":"108'23184","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189988864,"num_objects":2899,"num_object_clones":0,"num_object_copies":8697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2899,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23192,"num_write_kb":185536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'24336","reported_seq":24349,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.941345+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:47.941345+0000","last_peered":"2026-02-24T07:57:47.941345+0000","last_clean":"2026-02-24T07:57:47.941345+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:47.941345+0000","last_undegraded":"2026-02-24T07:57:47.941345+0000","last_fullsized":"2026-02-24T07:57:47.941345+0000","mapping_epoch":106,"log_start":"108'24328","ondisk_log_start":"108'24328","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199360512,"num_objects":3042,"num_object_clones":0,"num_object_copies":9126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24336,"num_write_kb":194688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'24016","reported_seq":24026,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.936990+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:47.936990+0000","last_peered":"2026-02-24T07:57:47.936990+0000","last_clean":"2026-02-24T07:57:47.936990+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:47.936990+0000","last_undegraded":"2026-02-24T07:57:47.936990+0000","last_fullsized":"2026-02-24T07:57:47.936990+0000","mapping_epoch":106,"log_start":"108'24011","ondisk_log_start":"108'24011","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196739072,"num_objects":3002,"num_object_clones":0,"num_object_copies":9006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":192128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'24760","reported_seq":24766,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.940859+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:47.940859+0000","last_peered":"2026-02-24T07:57:47.940859+0000","last_clean":"2026-02-24T07:57:47.940859+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:47.940859+0000","last_undegraded":"2026-02-24T07:57:47.940859+0000","last_fullsized":"2026-02-24T07:57:47.940859+0000","mapping_epoch":106,"log_start":"108'24736","ondisk_log_start":"108'24736","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202833920,"num_objects":3095,"num_object_clones":0,"num_object_copies":9285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24760,"num_write_kb":198080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'23336","reported_seq":23347,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.855243+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:47.855243+0000","last_peered":"2026-02-24T07:57:47.855243+0000","last_clean":"2026-02-24T07:57:47.855243+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:47.855243+0000","last_undegraded":"2026-02-24T07:57:47.855243+0000","last_fullsized":"2026-02-24T07:57:47.855243+0000","mapping_epoch":106,"log_start":"108'23315","ondisk_log_start":"108'23315","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191168512,"num_objects":2917,"num_object_clones":0,"num_object_copies":8751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23336,"num_write_kb":186688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'24744","reported_seq":24748,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.858764+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:47.858764+0000","last_peered":"2026-02-24T07:57:47.858764+0000","last_clean":"2026-02-24T07:57:47.858764+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:47.858764+0000","last_undegraded":"2026-02-24T07:57:47.858764+0000","last_fullsized":"2026-02-24T07:57:47.858764+0000","mapping_epoch":106,"log_start":"108'24728","ondisk_log_start":"108'24728","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202702848,"num_objects":3093,"num_object_clones":0,"num_object_copies":9279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24744,"num_write_kb":197952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'24040","reported_seq":24054,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:47.939237+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:47.939237+0000","last_peered":"2026-02-24T07:57:47.939237+0000","last_clean":"2026-02-24T07:57:47.939237+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:47.939237+0000","last_undegraded":"2026-02-24T07:57:47.939237+0000","last_fullsized":"2026-02-24T07:57:47.939237+0000","mapping_epoch":106,"log_start":"108'24032","ondisk_log_start":"108'24032","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196935680,"num_objects":3005,"num_object_clones":0,"num_object_copies":9015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":192320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":3184926720,"num_objects":48599,"num_object_clones":0,"num_object_copies":145797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388785,"num_write_kb":3110280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9555034112,"data_stored":9555034112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215239,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2596048,"kb_used_data":2105020,"kb_used_omap":9,"kb_used_meta":490998,"kb_avail":731407152,"statfs":{"total":751619276800,"available":748960923648,"internally_reserved":0,"allocated":2155540480,"data_stored":2155096806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":502781963},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444168,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3020528,"kb_used_data":1939356,"kb_used_omap":9,"kb_used_meta":1081142,"kb_avail":730982672,"statfs":{"total":751619276800,"available":748526256128,"internally_reserved":0,"allocated":1985900544,"data_stored":1985456870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1107089521},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,8,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4308884,"kb_used_data":2524736,"kb_used_omap":24,"kb_used_meta":1784103,"kb_avail":729694316,"statfs":{"total":751619276800,"available":747206979584,"internally_reserved":0,"allocated":2585329664,"data_stored":2584889542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24742,"internal_metadata":1826922330},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705805,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3706648,"kb_used_data":2712260,"kb_used_omap":9,"kb_used_meta":994358,"kb_avail":730296552,"statfs":{"total":751619276800,"available":747823669248,"internally_reserved":0,"allocated":2777354240,"data_stored":2776910566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1018222691},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2781429760,"data_stored":2781429760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2604826624,"data_stored":2604826624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1994784768,"data_stored":1994784768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2173992960,"data_stored":2173992960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:57:53.119 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 201 2026-02-24T07:57:53.273 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:53.393 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:53.390+0000 7f08fd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:53.393 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:53.390+0000 7f08fd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:53.550 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:57:53.661 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:53.991 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 444740 444612 66.7935 60.3828 0.00106092 0.0149623 2026-02-24T07:57:54.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:54.203 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2150072760' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "201"} : dispatch 2026-02-24T07:57:54.230 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:54.757 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:54.685+0000 7f06d8b82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:54.758 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:54.685+0000 7f06d8b82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:54.758 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:54.758 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:54.758 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:54.758 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:54.763 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:54.763 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:54.775 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:54.776 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:54.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 128 451735 451607 66.5642 54.6484 0.00623516 0.0150137 2026-02-24T07:57:55.048 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:54 trial016 ceph-mon[39544]: from='client.15383 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:57:55.048 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:54 trial016 ceph-mon[39544]: pgmap v416: 17 pgs: 17 active+clean; 3.3 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.43k op/s 2026-02-24T07:57:55.048 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2675300420' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:55.048 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:57:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:57:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:57:55.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 127 459361 459234 66.4349 59.5859 0.000899122 0.0150451 2026-02-24T07:57:56.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 127 468788 468661 66.566 73.6484 0.0251419 0.0150193 2026-02-24T07:57:57.284 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:57:57.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:56 trial016 ceph-mon[39544]: pgmap v417: 17 pgs: 17 active+clean; 3.3 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.49k op/s 2026-02-24T07:57:57.438 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:57.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:57.562+0000 7f468a4b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:57.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:57.563+0000 7f468a4b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:57.582 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:57:57.583 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:57:57.598 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:57:57.599 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:57:57.609 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:57:57.610 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:57:57.623 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:57:57.624 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:57:57.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 477929 477801 66.6523 71.4062 0.00846277 0.0150003 2026-02-24T07:57:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3005808535' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:57:58.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 127 487024 486897 66.7296 71.0625 0.00937474 0.014983 2026-02-24T07:57:59.172 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:57:59.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:57:59.172 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:57:59.172 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:57:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:58 trial016 ceph-mon[39544]: pgmap v418: 17 pgs: 17 active+clean; 3.3 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.49k op/s 2026-02-24T07:57:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:57:58 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:57:59.327 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:59.673 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:57:59.773 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:59.731+0000 7fcbad18b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:59.773 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:57:59.731+0000 7fcbad18b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:57:59.819 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:57:59.887 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:57:59.888 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:57:59.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 494774 494647 66.6229 60.5469 0.0213743 0.0150052 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:58:00.668 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: pgmap v419: 17 pgs: 17 active+clean; 3.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.89k op/s 2026-02-24T07:58:00.669 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:00 trial016 ceph-mon[39544]: from='client.15391 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:00.698 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2026-02-24T07:57:59.833032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3911615008,"num_objects":59680,"num_object_clones":0,"num_object_copies":179040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59680,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":477555,"num_write_kb":3821510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14898540,"kb_used_data":11410764,"kb_used_omap":39,"kb_used_meta":3487640,"kb_avail":2921114260,"statfs":{"total":3006477107200,"available":2991221002240,"internally_reserved":0,"allocated":11684622336,"data_stored":11682851192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39968,"internal_metadata":3571344352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,8,11,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1070751744,"num_objects":16338,"num_object_clones":0,"num_object_copies":49014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130707,"num_write_kb":1045656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001595"},"pg_stats":[{"pgid":"7.f","version":"108'30304","reported_seq":30310,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.942880+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:57:57.942880+0000","last_peered":"2026-02-24T07:57:57.942880+0000","last_clean":"2026-02-24T07:57:57.942880+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:57:57.942880+0000","last_undegraded":"2026-02-24T07:57:57.942880+0000","last_fullsized":"2026-02-24T07:57:57.942880+0000","mapping_epoch":106,"log_start":"108'30288","ondisk_log_start":"108'30288","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248250368,"num_objects":3788,"num_object_clones":0,"num_object_copies":11364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30304,"num_write_kb":242432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'29736","reported_seq":29743,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:58.070266+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:57:58.070266+0000","last_peered":"2026-02-24T07:57:58.070266+0000","last_clean":"2026-02-24T07:57:58.070266+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:57:58.070266+0000","last_undegraded":"2026-02-24T07:57:58.070266+0000","last_fullsized":"2026-02-24T07:57:58.070266+0000","mapping_epoch":106,"log_start":"108'29706","ondisk_log_start":"108'29706","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243597312,"num_objects":3717,"num_object_clones":0,"num_object_copies":11151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29736,"num_write_kb":237888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'30232","reported_seq":30246,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.854689+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:57:57.854689+0000","last_peered":"2026-02-24T07:57:57.854689+0000","last_clean":"2026-02-24T07:57:57.854689+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:57:57.854689+0000","last_undegraded":"2026-02-24T07:57:57.854689+0000","last_fullsized":"2026-02-24T07:57:57.854689+0000","mapping_epoch":106,"log_start":"108'30224","ondisk_log_start":"108'30224","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247660544,"num_objects":3779,"num_object_clones":0,"num_object_copies":11337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30232,"num_write_kb":241856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'30328","reported_seq":30335,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.859765+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:57:57.859765+0000","last_peered":"2026-02-24T07:57:57.859765+0000","last_clean":"2026-02-24T07:57:57.859765+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:57:57.859765+0000","last_undegraded":"2026-02-24T07:57:57.859765+0000","last_fullsized":"2026-02-24T07:57:57.859765+0000","mapping_epoch":106,"log_start":"108'30319","ondisk_log_start":"108'30319","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248446976,"num_objects":3791,"num_object_clones":0,"num_object_copies":11373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30328,"num_write_kb":242624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'30048","reported_seq":30062,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:58.055283+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:57:58.055283+0000","last_peered":"2026-02-24T07:57:58.055283+0000","last_clean":"2026-02-24T07:57:58.055283+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:57:58.055283+0000","last_undegraded":"2026-02-24T07:57:58.055283+0000","last_fullsized":"2026-02-24T07:57:58.055283+0000","mapping_epoch":106,"log_start":"108'30040","ondisk_log_start":"108'30040","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246153216,"num_objects":3756,"num_object_clones":0,"num_object_copies":11268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":240384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'29248","reported_seq":29262,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:58.040628+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:57:58.040628+0000","last_peered":"2026-02-24T07:57:58.040628+0000","last_clean":"2026-02-24T07:57:58.040628+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:57:58.040628+0000","last_undegraded":"2026-02-24T07:57:58.040628+0000","last_fullsized":"2026-02-24T07:57:58.040628+0000","mapping_epoch":106,"log_start":"108'29240","ondisk_log_start":"108'29240","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239599616,"num_objects":3656,"num_object_clones":0,"num_object_copies":10968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29248,"num_write_kb":233984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'30360","reported_seq":30358,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.938315+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:57:57.938315+0000","last_peered":"2026-02-24T07:57:57.938315+0000","last_clean":"2026-02-24T07:57:57.938315+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:57:57.938315+0000","last_undegraded":"2026-02-24T07:57:57.938315+0000","last_fullsized":"2026-02-24T07:57:57.938315+0000","mapping_epoch":106,"log_start":"108'30343","ondisk_log_start":"108'30343","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248709120,"num_objects":3795,"num_object_clones":0,"num_object_copies":11385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30360,"num_write_kb":242880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'30040","reported_seq":30054,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:58.031041+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:57:58.031041+0000","last_peered":"2026-02-24T07:57:58.031041+0000","last_clean":"2026-02-24T07:57:58.031041+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:57:58.031041+0000","last_undegraded":"2026-02-24T07:57:58.031041+0000","last_fullsized":"2026-02-24T07:57:58.031041+0000","mapping_epoch":106,"log_start":"108'30031","ondisk_log_start":"108'30031","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246087680,"num_objects":3755,"num_object_clones":0,"num_object_copies":11265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30040,"num_write_kb":240320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'30020","reported_seq":30030,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.867545+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:57:57.867545+0000","last_peered":"2026-02-24T07:57:57.867545+0000","last_clean":"2026-02-24T07:57:57.867545+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:57:57.867545+0000","last_undegraded":"2026-02-24T07:57:57.867545+0000","last_fullsized":"2026-02-24T07:57:57.867545+0000","mapping_epoch":106,"log_start":"108'30012","ondisk_log_start":"108'30012","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245923840,"num_objects":3753,"num_object_clones":0,"num_object_copies":11259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30020,"num_write_kb":240160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'28864","reported_seq":28878,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.848518+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:57:57.848518+0000","last_peered":"2026-02-24T07:57:57.848518+0000","last_clean":"2026-02-24T07:57:57.848518+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:57:57.848518+0000","last_undegraded":"2026-02-24T07:57:57.848518+0000","last_fullsized":"2026-02-24T07:57:57.848518+0000","mapping_epoch":106,"log_start":"108'28856","ondisk_log_start":"108'28856","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236453888,"num_objects":3608,"num_object_clones":0,"num_object_copies":10824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28864,"num_write_kb":230912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'29800","reported_seq":29814,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.941918+0000","last_change":"2026-02-24T07:56:59.882580+0000","last_active":"2026-02-24T07:57:57.941918+0000","last_peered":"2026-02-24T07:57:57.941918+0000","last_clean":"2026-02-24T07:57:57.941918+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:57:57.941918+0000","last_undegraded":"2026-02-24T07:57:57.941918+0000","last_fullsized":"2026-02-24T07:57:57.941918+0000","mapping_epoch":106,"log_start":"108'29793","ondisk_log_start":"108'29793","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:00.310399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244121600,"num_objects":3725,"num_object_clones":0,"num_object_copies":11175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29800,"num_write_kb":238400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'29632","reported_seq":29646,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.939392+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:57:57.939392+0000","last_peered":"2026-02-24T07:57:57.939392+0000","last_clean":"2026-02-24T07:57:57.939392+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:57:57.939392+0000","last_undegraded":"2026-02-24T07:57:57.939392+0000","last_fullsized":"2026-02-24T07:57:57.939392+0000","mapping_epoch":106,"log_start":"108'29624","ondisk_log_start":"108'29624","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242745344,"num_objects":3704,"num_object_clones":0,"num_object_copies":11112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29632,"num_write_kb":237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'30192","reported_seq":30206,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.923404+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:57:57.923404+0000","last_peered":"2026-02-24T07:57:57.923404+0000","last_clean":"2026-02-24T07:57:57.923404+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:57:57.923404+0000","last_undegraded":"2026-02-24T07:57:57.923404+0000","last_fullsized":"2026-02-24T07:57:57.923404+0000","mapping_epoch":106,"log_start":"108'30168","ondisk_log_start":"108'30168","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247332864,"num_objects":3774,"num_object_clones":0,"num_object_copies":11322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30192,"num_write_kb":241536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'29120","reported_seq":29134,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.854016+0000","last_change":"2026-02-24T07:56:59.882598+0000","last_active":"2026-02-24T07:57:57.854016+0000","last_peered":"2026-02-24T07:57:57.854016+0000","last_clean":"2026-02-24T07:57:57.854016+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:57:57.854016+0000","last_undegraded":"2026-02-24T07:57:57.854016+0000","last_fullsized":"2026-02-24T07:57:57.854016+0000","mapping_epoch":106,"log_start":"108'29117","ondisk_log_start":"108'29117","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:01.372601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238551040,"num_objects":3640,"num_object_clones":0,"num_object_copies":10920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29120,"num_write_kb":232960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'29784","reported_seq":29793,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.860012+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:57:57.860012+0000","last_peered":"2026-02-24T07:57:57.860012+0000","last_clean":"2026-02-24T07:57:57.860012+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:57:57.860012+0000","last_undegraded":"2026-02-24T07:57:57.860012+0000","last_fullsized":"2026-02-24T07:57:57.860012+0000","mapping_epoch":106,"log_start":"108'29776","ondisk_log_start":"108'29776","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243990528,"num_objects":3723,"num_object_clones":0,"num_object_copies":11169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29784,"num_write_kb":238272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'29712","reported_seq":29726,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:57.917118+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:57:57.917118+0000","last_peered":"2026-02-24T07:57:57.917118+0000","last_clean":"2026-02-24T07:57:57.917118+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:57:57.917118+0000","last_undegraded":"2026-02-24T07:57:57.917118+0000","last_fullsized":"2026-02-24T07:57:57.917118+0000","mapping_epoch":106,"log_start":"108'29696","ondisk_log_start":"108'29696","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243400704,"num_objects":3714,"num_object_clones":0,"num_object_copies":11142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29712,"num_write_kb":237696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":3911024640,"num_objects":59678,"num_object_clones":0,"num_object_copies":179034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477420,"num_write_kb":3819360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11733172224,"data_stored":11733172224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215241,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3237512,"kb_used_data":2602100,"kb_used_omap":9,"kb_used_meta":635382,"kb_avail":730765688,"statfs":{"total":751619276800,"available":748304064512,"internally_reserved":0,"allocated":2664550400,"data_stored":2664106726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":650631179},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444170,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3635952,"kb_used_data":2374300,"kb_used_omap":9,"kb_used_meta":1261622,"kb_avail":730367248,"statfs":{"total":751619276800,"available":747896061952,"internally_reserved":0,"allocated":2431283200,"data_stored":2430839526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1291901041},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3522612,"kb_used_data":3106776,"kb_used_omap":9,"kb_used_meta":415798,"kb_avail":730480588,"statfs":{"total":751619276800,"available":748012122112,"internally_reserved":0,"allocated":3181338624,"data_stored":3180898502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9471,"internal_metadata":425777921},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,8,11,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705807,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4502464,"kb_used_data":3327588,"kb_used_omap":9,"kb_used_meta":1174838,"kb_avail":729500736,"statfs":{"total":751619276800,"available":747008753664,"internally_reserved":0,"allocated":3407450112,"data_stored":3407006438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1203034211},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3416498176,"data_stored":3416498176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3190210560,"data_stored":3190210560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2444730368,"data_stored":2444730368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2681733120,"data_stored":2681733120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:00.700 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:00.700 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 211 2026-02-24T07:58:00.931 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:00.886+0000 7fd87652c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:00.931 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:00.886+0000 7fd87652c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:00.931 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:00.931 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:00.932 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:00.932 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:00.937 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:00.937 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:00.953 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:00.954 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:00.954 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:00.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 127 501307 501180 66.3587 51.0391 0.00858373 0.0150653 2026-02-24T07:58:01.888 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:01 trial016 ceph-mon[39544]: 7.4 scrub starts 2026-02-24T07:58:01.888 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4066036673' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:01.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:01.948+0000 7f8960e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:01.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:01.948+0000 7f8960e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:01.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:58:01.991337+0000 min lat: 0.000574286 max lat: 0.119549 avg lat: 0.0151408 2026-02-24T07:58:01.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:58:01.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 507291 507163 66.0317 46.7422 0.0034231 0.0151408 2026-02-24T07:58:02.109 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:02.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:02.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 127 515865 515738 66.0474 66.9922 0.00625952 0.0151381 2026-02-24T07:58:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:02 trial016 ceph-mon[39544]: 7.1 scrub starts 2026-02-24T07:58:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:02 trial016 ceph-mon[39544]: pgmap v420: 17 pgs: 17 active+clean; 3.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.38k op/s 2026-02-24T07:58:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:02 trial016 ceph-mon[39544]: 7.1 scrub ok 2026-02-24T07:58:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/829740683' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "211"} : dispatch 2026-02-24T07:58:03.644 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:03.797 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:03.930 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:03.926+0000 7f3cdb560640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:03.930 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:03 trial016 ceph-mon[39544]: 7.4 scrub ok 2026-02-24T07:58:03.930 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:03.927+0000 7f3cdb560640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:03.943 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:03.943 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:03.956 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:03.957 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:03.972 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:03.972 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:03.983 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:03.983 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:03.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 525719 525591 66.2235 76.9766 0.00984654 0.0150973 2026-02-24T07:58:04.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 127 534546 534419 66.267 68.9688 0.0143059 0.0150869 2026-02-24T07:58:05.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:05.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:04 trial016 ceph-mon[39544]: pgmap v421: 17 pgs: 17 active+clean; 3.9 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.55k op/s 2026-02-24T07:58:05.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1350201303' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:05.992 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 128 543674 543546 66.3457 71.3047 0.00786568 0.0150699 2026-02-24T07:58:06.034 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:06.181 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:06.379 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:06.375+0000 7f1c4b929640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:06.379 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:06.375+0000 7f1c4b929640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:06.394 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:06.394 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:06.412 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:06.412 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:06.425 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:06.426 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:06.441 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:06.441 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:06.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 127 552651 552524 66.4039 70.1406 0.004156 0.0150573 2026-02-24T07:58:07.154 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:07.154 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:07.154 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:58:07.155 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:07.181 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:06 trial016 ceph-mon[39544]: pgmap v422: 17 pgs: 17 active+clean; 3.9 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.56k op/s 2026-02-24T07:58:07.181 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/966884797' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:07.302 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:07.431 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:07.427+0000 7f0b8e7b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:07.432 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:07.428+0000 7f0b8e7b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:07.593 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:07.594 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:07.661 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":422,"stamp":"2026-02-24T07:58:05.833843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4222616096,"num_objects":64425,"num_object_clones":0,"num_object_copies":193275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64425,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":515519,"num_write_kb":4125222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16096900,"kb_used_data":12320356,"kb_used_omap":39,"kb_used_meta":3776408,"kb_avail":2919915900,"statfs":{"total":3006477107200,"available":2989993881600,"internally_reserved":0,"allocated":12616044544,"data_stored":12614273400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39968,"internal_metadata":3867042784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,40,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":645210112,"num_objects":9844,"num_object_clones":0,"num_object_copies":29532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78761,"num_write_kb":630088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001589"},"pg_stats":[{"pgid":"7.f","version":"108'32816","reported_seq":32830,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.917035+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:02.917035+0000","last_peered":"2026-02-24T07:58:02.917035+0000","last_clean":"2026-02-24T07:58:02.917035+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:02.917035+0000","last_undegraded":"2026-02-24T07:58:02.917035+0000","last_fullsized":"2026-02-24T07:58:02.917035+0000","mapping_epoch":106,"log_start":"108'32776","ondisk_log_start":"108'32776","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268828672,"num_objects":4102,"num_object_clones":0,"num_object_copies":12306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32816,"num_write_kb":262528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'31968","reported_seq":31980,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:03.070554+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:58:03.070554+0000","last_peered":"2026-02-24T07:58:03.070554+0000","last_clean":"2026-02-24T07:58:03.070554+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:03.070554+0000","last_undegraded":"2026-02-24T07:58:03.070554+0000","last_fullsized":"2026-02-24T07:58:03.070554+0000","mapping_epoch":106,"log_start":"108'31960","ondisk_log_start":"108'31960","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261881856,"num_objects":3996,"num_object_clones":0,"num_object_copies":11988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31968,"num_write_kb":255744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'32760","reported_seq":32774,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.857261+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:58:02.857261+0000","last_peered":"2026-02-24T07:58:02.857261+0000","last_clean":"2026-02-24T07:58:02.857261+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:02.857261+0000","last_undegraded":"2026-02-24T07:58:02.857261+0000","last_fullsized":"2026-02-24T07:58:02.857261+0000","mapping_epoch":106,"log_start":"108'32752","ondisk_log_start":"108'32752","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268369920,"num_objects":4095,"num_object_clones":0,"num_object_copies":12285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32760,"num_write_kb":262080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'32616","reported_seq":32630,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.856956+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:58:02.856956+0000","last_peered":"2026-02-24T07:58:02.856956+0000","last_clean":"2026-02-24T07:58:02.856956+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:02.856956+0000","last_undegraded":"2026-02-24T07:58:02.856956+0000","last_fullsized":"2026-02-24T07:58:02.856956+0000","mapping_epoch":106,"log_start":"108'32608","ondisk_log_start":"108'32608","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267190272,"num_objects":4077,"num_object_clones":0,"num_object_copies":12231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32616,"num_write_kb":260928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'32488","reported_seq":32502,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:03.061331+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:58:03.061331+0000","last_peered":"2026-02-24T07:58:03.061331+0000","last_clean":"2026-02-24T07:58:03.061331+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:03.061331+0000","last_undegraded":"2026-02-24T07:58:03.061331+0000","last_fullsized":"2026-02-24T07:58:03.061331+0000","mapping_epoch":106,"log_start":"108'32464","ondisk_log_start":"108'32464","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266141696,"num_objects":4061,"num_object_clones":0,"num_object_copies":12183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32488,"num_write_kb":259904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'31592","reported_seq":31606,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:03.070026+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:58:03.070026+0000","last_peered":"2026-02-24T07:58:03.070026+0000","last_clean":"2026-02-24T07:58:03.070026+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:03.070026+0000","last_undegraded":"2026-02-24T07:58:03.070026+0000","last_fullsized":"2026-02-24T07:58:03.070026+0000","mapping_epoch":106,"log_start":"108'31584","ondisk_log_start":"108'31584","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258801664,"num_objects":3949,"num_object_clones":0,"num_object_copies":11847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31592,"num_write_kb":252736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'32640","reported_seq":32654,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.915958+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:58:02.915958+0000","last_peered":"2026-02-24T07:58:02.915958+0000","last_clean":"2026-02-24T07:58:02.915958+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:02.915958+0000","last_undegraded":"2026-02-24T07:58:02.915958+0000","last_fullsized":"2026-02-24T07:58:02.915958+0000","mapping_epoch":106,"log_start":"108'32617","ondisk_log_start":"108'32617","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":4080,"num_object_clones":0,"num_object_copies":12240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32640,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'32296","reported_seq":32310,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:03.065013+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:58:03.065013+0000","last_peered":"2026-02-24T07:58:03.065013+0000","last_clean":"2026-02-24T07:58:03.065013+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:03.065013+0000","last_undegraded":"2026-02-24T07:58:03.065013+0000","last_fullsized":"2026-02-24T07:58:03.065013+0000","mapping_epoch":106,"log_start":"108'32293","ondisk_log_start":"108'32293","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264568832,"num_objects":4037,"num_object_clones":0,"num_object_copies":12111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32296,"num_write_kb":258368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'32344","reported_seq":32358,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.855152+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:58:02.855152+0000","last_peered":"2026-02-24T07:58:02.855152+0000","last_clean":"2026-02-24T07:58:02.855152+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:02.855152+0000","last_undegraded":"2026-02-24T07:58:02.855152+0000","last_fullsized":"2026-02-24T07:58:02.855152+0000","mapping_epoch":106,"log_start":"108'32336","ondisk_log_start":"108'32336","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264962048,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32344,"num_write_kb":258752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'31240","reported_seq":31254,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.871256+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:58:02.871256+0000","last_peered":"2026-02-24T07:58:02.871256+0000","last_clean":"2026-02-24T07:58:02.871256+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:02.871256+0000","last_undegraded":"2026-02-24T07:58:02.871256+0000","last_fullsized":"2026-02-24T07:58:02.871256+0000","mapping_epoch":106,"log_start":"108'31232","ondisk_log_start":"108'31232","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255918080,"num_objects":3905,"num_object_clones":0,"num_object_copies":11715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31240,"num_write_kb":249920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'32104","reported_seq":32166,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.915179+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:02.915179+0000","last_peered":"2026-02-24T07:58:02.915179+0000","last_clean":"2026-02-24T07:58:02.915179+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:02.915179+0000","last_undegraded":"2026-02-24T07:58:02.915179+0000","last_fullsized":"2026-02-24T07:58:02.915179+0000","mapping_epoch":106,"log_start":"108'32096","ondisk_log_start":"108'32096","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262995968,"num_objects":4013,"num_object_clones":0,"num_object_copies":12039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32104,"num_write_kb":256832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'32176","reported_seq":32188,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.944901+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:58:02.944901+0000","last_peered":"2026-02-24T07:58:02.944901+0000","last_clean":"2026-02-24T07:58:02.944901+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:02.944901+0000","last_undegraded":"2026-02-24T07:58:02.944901+0000","last_fullsized":"2026-02-24T07:58:02.944901+0000","mapping_epoch":106,"log_start":"108'32168","ondisk_log_start":"108'32168","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263585792,"num_objects":4022,"num_object_clones":0,"num_object_copies":12066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32176,"num_write_kb":257408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'32824","reported_seq":32834,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.931350+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:58:02.931350+0000","last_peered":"2026-02-24T07:58:02.931350+0000","last_clean":"2026-02-24T07:58:02.931350+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:02.931350+0000","last_undegraded":"2026-02-24T07:58:02.931350+0000","last_fullsized":"2026-02-24T07:58:02.931350+0000","mapping_epoch":106,"log_start":"108'32816","ondisk_log_start":"108'32816","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268894208,"num_objects":4103,"num_object_clones":0,"num_object_copies":12309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32824,"num_write_kb":262592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'31680","reported_seq":31741,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.858534+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:02.858534+0000","last_peered":"2026-02-24T07:58:02.858534+0000","last_clean":"2026-02-24T07:58:02.858534+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:02.858534+0000","last_undegraded":"2026-02-24T07:58:02.858534+0000","last_fullsized":"2026-02-24T07:58:02.858534+0000","mapping_epoch":106,"log_start":"108'31672","ondisk_log_start":"108'31672","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259522560,"num_objects":3960,"num_object_clones":0,"num_object_copies":11880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31680,"num_write_kb":253440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'31944","reported_seq":31958,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.859883+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:58:02.859883+0000","last_peered":"2026-02-24T07:58:02.859883+0000","last_clean":"2026-02-24T07:58:02.859883+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:02.859883+0000","last_undegraded":"2026-02-24T07:58:02.859883+0000","last_fullsized":"2026-02-24T07:58:02.859883+0000","mapping_epoch":106,"log_start":"108'31936","ondisk_log_start":"108'31936","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261685248,"num_objects":3993,"num_object_clones":0,"num_object_copies":11979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31944,"num_write_kb":255552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'31896","reported_seq":31910,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:02.914352+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:58:02.914352+0000","last_peered":"2026-02-24T07:58:02.914352+0000","last_clean":"2026-02-24T07:58:02.914352+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:02.914352+0000","last_undegraded":"2026-02-24T07:58:02.914352+0000","last_fullsized":"2026-02-24T07:58:02.914352+0000","mapping_epoch":106,"log_start":"108'31888","ondisk_log_start":"108'31888","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261292032,"num_objects":3987,"num_object_clones":0,"num_object_copies":11961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31896,"num_write_kb":255168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4222025728,"num_objects":64423,"num_object_clones":0,"num_object_copies":193269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515384,"num_write_kb":4123072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12667019264,"data_stored":12667019264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215242,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3517704,"kb_used_data":2810092,"kb_used_omap":9,"kb_used_meta":707574,"kb_avail":730485496,"statfs":{"total":751619276800,"available":748017147904,"internally_reserved":0,"allocated":2877534208,"data_stored":2877090534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":724555787},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444171,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3866480,"kb_used_data":2568724,"kb_used_omap":9,"kb_used_meta":1297718,"kb_avail":730136720,"statfs":{"total":751619276800,"available":747660001280,"internally_reserved":0,"allocated":2630373376,"data_stored":2629929702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1328863345},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3839812,"kb_used_data":3351792,"kb_used_omap":9,"kb_used_meta":487990,"kb_avail":730163388,"statfs":{"total":751619276800,"available":747687309312,"internally_reserved":0,"allocated":3432235008,"data_stored":3431794886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9471,"internal_metadata":499702529},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705808,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4872904,"kb_used_data":3589748,"kb_used_omap":9,"kb_used_meta":1283126,"kb_avail":729130296,"statfs":{"total":751619276800,"available":746629423104,"internally_reserved":0,"allocated":3675901952,"data_stored":3675458278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1313921123},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,40,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3690921984,"data_stored":3690921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3441336320,"data_stored":3441336320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2638512128,"data_stored":2638512128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2896248832,"data_stored":2896248832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:07.663 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:07.663 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 221 2026-02-24T07:58:07.853 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:07.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:07.988+0000 7f7b8be0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:07.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:07.989+0000 7f7b8be0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:07.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 561701 561573 66.4689 70.6953 0.00182525 0.0150399 2026-02-24T07:58:08.146 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:08.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:08.550 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:08.699 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:08.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:08.819+0000 7fedf855a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:08.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:08.820+0000 7fedf855a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:08.845 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:08.846 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:08.866 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:08.866 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:08.883 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:08.883 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:08.898 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:08.898 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:08.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 128 570735 570607 66.5301 70.5781 0.00438721 0.0150277 2026-02-24T07:58:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:08 trial016 ceph-mon[39544]: from='client.15401 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:08 trial016 ceph-mon[39544]: pgmap v423: 17 pgs: 17 active+clean; 3.9 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.56k op/s 2026-02-24T07:58:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1324907526' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "221"} : dispatch 2026-02-24T07:58:09.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4118743916' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:09.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 128 579738 579610 66.586 70.3359 0.0132633 0.0150141 2026-02-24T07:58:10.945 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:10.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 588813 588685 66.6484 70.8984 0.00522764 0.0150004 2026-02-24T07:58:11.100 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:11.147 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:10 trial016 ceph-mon[39544]: pgmap v424: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.39k op/s 2026-02-24T07:58:11.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:11.214+0000 7f060d83a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:11.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:11.215+0000 7f060d83a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:11.235 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:11.235 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:11.251 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:11.251 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:11.265 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:11.265 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:11.278 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:11.279 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:11.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 128 598629 598501 66.7918 76.6875 0.00288401 0.0149695 2026-02-24T07:58:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:11 trial016 ceph-mon[39544]: 7.c scrub starts 2026-02-24T07:58:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2593683383' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:11 trial016 ceph-mon[39544]: 7.c scrub ok 2026-02-24T07:58:12.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 127 606852 606725 66.7559 64.25 0.02691 0.014975 2026-02-24T07:58:13.191 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:13.191 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:13.191 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:58:13.192 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:13.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:12 trial016 ceph-mon[39544]: pgmap v425: 17 pgs: 17 active+clean; 4.3 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 6.99k op/s 2026-02-24T07:58:13.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:12 trial016 ceph-mon[39544]: 7.9 scrub starts 2026-02-24T07:58:13.327 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:13.345 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:13.484 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:13.485 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:13.482+0000 7fa93ed2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:13.485 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:13.482+0000 7fa93ed2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:13.616 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:13.612+0000 7fa19f9a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:13.616 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:13.612+0000 7fa19f9a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:13.642 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:13.642 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:13.642 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:13.642 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:13.656 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:13.657 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:13.672 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:13.672 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:13.690 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:13.690 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:13.691 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2026-02-24T07:58:11.834636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4598899232,"num_objects":70168,"num_object_clones":0,"num_object_copies":210504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70168,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":561452,"num_write_kb":4492686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":17536980,"kb_used_data":13417540,"kb_used_omap":39,"kb_used_meta":4119320,"kb_avail":2918475820,"statfs":{"total":3006477107200,"available":2988519239680,"internally_reserved":0,"allocated":13739560960,"data_stored":13737789816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39968,"internal_metadata":4218184672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":687284224,"num_objects":10488,"num_object_clones":0,"num_object_copies":31464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83897,"num_write_kb":671176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001603"},"pg_stats":[{"pgid":"7.f","version":"108'35656","reported_seq":35654,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.943297+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:07.943297+0000","last_peered":"2026-02-24T07:58:07.943297+0000","last_clean":"2026-02-24T07:58:07.943297+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:07.943297+0000","last_undegraded":"2026-02-24T07:58:07.943297+0000","last_fullsized":"2026-02-24T07:58:07.943297+0000","mapping_epoch":106,"log_start":"108'35630","ondisk_log_start":"108'35630","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":3000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292093952,"num_objects":4457,"num_object_clones":0,"num_object_copies":13371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35656,"num_write_kb":285248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'35144","reported_seq":35152,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:08.073713+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:58:08.073713+0000","last_peered":"2026-02-24T07:58:08.073713+0000","last_clean":"2026-02-24T07:58:08.073713+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:08.073713+0000","last_undegraded":"2026-02-24T07:58:08.073713+0000","last_fullsized":"2026-02-24T07:58:08.073713+0000","mapping_epoch":106,"log_start":"108'35128","ondisk_log_start":"108'35128","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287899648,"num_objects":4393,"num_object_clones":0,"num_object_copies":13179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35144,"num_write_kb":281152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'35592","reported_seq":35606,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.862559+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:58:07.862559+0000","last_peered":"2026-02-24T07:58:07.862559+0000","last_clean":"2026-02-24T07:58:07.862559+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:07.862559+0000","last_undegraded":"2026-02-24T07:58:07.862559+0000","last_fullsized":"2026-02-24T07:58:07.862559+0000","mapping_epoch":106,"log_start":"108'35584","ondisk_log_start":"108'35584","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291569664,"num_objects":4449,"num_object_clones":0,"num_object_copies":13347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35592,"num_write_kb":284736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'35472","reported_seq":35486,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.849589+0000","last_change":"2026-02-24T07:56:59.882435+0000","last_active":"2026-02-24T07:58:07.849589+0000","last_peered":"2026-02-24T07:58:07.849589+0000","last_clean":"2026-02-24T07:58:07.849589+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:07.849589+0000","last_undegraded":"2026-02-24T07:58:07.849589+0000","last_fullsized":"2026-02-24T07:58:07.849589+0000","mapping_epoch":106,"log_start":"108'35467","ondisk_log_start":"108'35467","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.211256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290586624,"num_objects":4434,"num_object_clones":0,"num_object_copies":13302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35472,"num_write_kb":283776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'35587","reported_seq":35573,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:08.073897+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:58:08.073897+0000","last_peered":"2026-02-24T07:58:08.073897+0000","last_clean":"2026-02-24T07:58:08.073897+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:08.073897+0000","last_undegraded":"2026-02-24T07:58:08.073897+0000","last_fullsized":"2026-02-24T07:58:08.073897+0000","mapping_epoch":106,"log_start":"108'35557","ondisk_log_start":"108'35557","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291528704,"num_objects":4449,"num_object_clones":0,"num_object_copies":13347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35587,"num_write_kb":284696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'34504","reported_seq":34518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:08.050419+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:58:08.050419+0000","last_peered":"2026-02-24T07:58:08.050419+0000","last_clean":"2026-02-24T07:58:08.050419+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:08.050419+0000","last_undegraded":"2026-02-24T07:58:08.050419+0000","last_fullsized":"2026-02-24T07:58:08.050419+0000","mapping_epoch":106,"log_start":"108'34488","ondisk_log_start":"108'34488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282656768,"num_objects":4313,"num_object_clones":0,"num_object_copies":12939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34504,"num_write_kb":276032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'35560","reported_seq":35574,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.898153+0000","last_change":"2026-02-24T07:56:59.883448+0000","last_active":"2026-02-24T07:58:07.898153+0000","last_peered":"2026-02-24T07:58:07.898153+0000","last_clean":"2026-02-24T07:58:07.898153+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:07.898153+0000","last_undegraded":"2026-02-24T07:58:07.898153+0000","last_fullsized":"2026-02-24T07:58:07.898153+0000","mapping_epoch":106,"log_start":"108'35552","ondisk_log_start":"108'35552","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.239127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291307520,"num_objects":4445,"num_object_clones":0,"num_object_copies":13335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35560,"num_write_kb":284480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'35124","reported_seq":35136,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:08.072549+0000","last_change":"2026-02-24T07:56:59.884106+0000","last_active":"2026-02-24T07:58:08.072549+0000","last_peered":"2026-02-24T07:58:08.072549+0000","last_clean":"2026-02-24T07:58:08.072549+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:08.072549+0000","last_undegraded":"2026-02-24T07:58:08.072549+0000","last_fullsized":"2026-02-24T07:58:08.072549+0000","mapping_epoch":106,"log_start":"108'35120","ondisk_log_start":"108'35120","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.331253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287735808,"num_objects":4391,"num_object_clones":0,"num_object_copies":13173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4391,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35124,"num_write_kb":280992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'35208","reported_seq":35222,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.829954+0000","last_change":"2026-02-24T07:56:59.882852+0000","last_active":"2026-02-24T07:58:07.829954+0000","last_peered":"2026-02-24T07:58:07.829954+0000","last_clean":"2026-02-24T07:58:07.829954+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:07.829954+0000","last_undegraded":"2026-02-24T07:58:07.829954+0000","last_fullsized":"2026-02-24T07:58:07.829954+0000","mapping_epoch":106,"log_start":"108'35200","ondisk_log_start":"108'35200","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:14.466241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288423936,"num_objects":4401,"num_object_clones":0,"num_object_copies":13203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35208,"num_write_kb":281664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'33976","reported_seq":33990,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.844814+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:58:07.844814+0000","last_peered":"2026-02-24T07:58:07.844814+0000","last_clean":"2026-02-24T07:58:07.844814+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:07.844814+0000","last_undegraded":"2026-02-24T07:58:07.844814+0000","last_fullsized":"2026-02-24T07:58:07.844814+0000","mapping_epoch":106,"log_start":"108'33968","ondisk_log_start":"108'33968","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278331392,"num_objects":4247,"num_object_clones":0,"num_object_copies":12741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33976,"num_write_kb":271808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'35024","reported_seq":35086,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.897443+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:07.897443+0000","last_peered":"2026-02-24T07:58:07.897443+0000","last_clean":"2026-02-24T07:58:07.897443+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:07.897443+0000","last_undegraded":"2026-02-24T07:58:07.897443+0000","last_fullsized":"2026-02-24T07:58:07.897443+0000","mapping_epoch":106,"log_start":"108'35005","ondisk_log_start":"108'35005","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":19,"log_dups_size":3000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286916608,"num_objects":4378,"num_object_clones":0,"num_object_copies":13134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35024,"num_write_kb":280192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'35048","reported_seq":35061,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.946553+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:58:07.946553+0000","last_peered":"2026-02-24T07:58:07.946553+0000","last_clean":"2026-02-24T07:58:07.946553+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:07.946553+0000","last_undegraded":"2026-02-24T07:58:07.946553+0000","last_fullsized":"2026-02-24T07:58:07.946553+0000","mapping_epoch":106,"log_start":"108'35045","ondisk_log_start":"108'35045","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287113216,"num_objects":4381,"num_object_clones":0,"num_object_copies":13143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35048,"num_write_kb":280384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'35512","reported_seq":35518,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.942293+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:58:07.942293+0000","last_peered":"2026-02-24T07:58:07.942293+0000","last_clean":"2026-02-24T07:58:07.942293+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:07.942293+0000","last_undegraded":"2026-02-24T07:58:07.942293+0000","last_fullsized":"2026-02-24T07:58:07.942293+0000","mapping_epoch":106,"log_start":"108'35502","ondisk_log_start":"108'35502","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:10.423062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290914304,"num_objects":4439,"num_object_clones":0,"num_object_copies":13317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35512,"num_write_kb":284096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'34519","reported_seq":34576,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.863325+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:07.863325+0000","last_peered":"2026-02-24T07:58:07.863325+0000","last_clean":"2026-02-24T07:58:07.863325+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:07.863325+0000","last_undegraded":"2026-02-24T07:58:07.863325+0000","last_fullsized":"2026-02-24T07:58:07.863325+0000","mapping_epoch":106,"log_start":"108'34513","ondisk_log_start":"108'34513","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282779648,"num_objects":4315,"num_object_clones":0,"num_object_copies":12945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34519,"num_write_kb":276152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'34759","reported_seq":34767,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.836863+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:58:07.836863+0000","last_peered":"2026-02-24T07:58:07.836863+0000","last_clean":"2026-02-24T07:58:07.836863+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:07.836863+0000","last_undegraded":"2026-02-24T07:58:07.836863+0000","last_fullsized":"2026-02-24T07:58:07.836863+0000","mapping_epoch":106,"log_start":"108'34752","ondisk_log_start":"108'34752","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284745728,"num_objects":4345,"num_object_clones":0,"num_object_copies":13035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34759,"num_write_kb":278072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'34632","reported_seq":34646,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:07.919762+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:58:07.919762+0000","last_peered":"2026-02-24T07:58:07.919762+0000","last_clean":"2026-02-24T07:58:07.919762+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:07.919762+0000","last_undegraded":"2026-02-24T07:58:07.919762+0000","last_fullsized":"2026-02-24T07:58:07.919762+0000","mapping_epoch":106,"log_start":"108'34615","ondisk_log_start":"108'34615","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283705344,"num_objects":4329,"num_object_clones":0,"num_object_copies":12987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34632,"num_write_kb":277056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4598308864,"num_objects":70166,"num_object_clones":0,"num_object_copies":210498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561317,"num_write_kb":4490536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13793542144,"data_stored":13793542144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215243,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3831352,"kb_used_data":3051556,"kb_used_omap":9,"kb_used_meta":779766,"kb_avail":730171848,"statfs":{"total":751619276800,"available":747695972352,"internally_reserved":0,"allocated":3124793344,"data_stored":3124349670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":798480395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444172,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4207112,"kb_used_data":2801076,"kb_used_omap":9,"kb_used_meta":1406006,"kb_avail":729796088,"statfs":{"total":751619276800,"available":747311194112,"internally_reserved":0,"allocated":2868301824,"data_stored":2867858150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1439750257},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4206020,"kb_used_data":3645808,"kb_used_omap":9,"kb_used_meta":560182,"kb_avail":729797180,"statfs":{"total":751619276800,"available":747312312320,"internally_reserved":0,"allocated":3733307392,"data_stored":3732867270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9471,"internal_metadata":573627137},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705809,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5292496,"kb_used_data":3919100,"kb_used_omap":9,"kb_used_meta":1373366,"kb_avail":728710704,"statfs":{"total":751619276800,"available":746199760896,"internally_reserved":0,"allocated":4013158400,"data_stored":4012714726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1406326883},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4019929088,"data_stored":4019929088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3745570816,"data_stored":3745570816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2875187200,"data_stored":2875187200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3152855040,"data_stored":3152855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:13.693 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 221 2026-02-24T07:58:13.888 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:13.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 128 615946 615818 66.8153 71.0391 0.0118197 0.014961 2026-02-24T07:58:14.007 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3976327586' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:14.028 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:14.024+0000 7f9f9df2b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:14.028 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:14.025+0000 7f9f9df2b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:14.187 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:58:14.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:14.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 625316 625188 66.9027 73.2031 0.00454485 0.014944 2026-02-24T07:58:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:14 trial016 ceph-mon[39544]: 7.9 scrub ok 2026-02-24T07:58:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:14 trial016 ceph-mon[39544]: from='client.15409 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:14 trial016 ceph-mon[39544]: pgmap v426: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 10.77k op/s 2026-02-24T07:58:15.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/975123315' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "221"} : dispatch 2026-02-24T07:58:15.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:15.742 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:15.893 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:15.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 634409 634281 66.9586 71.0391 0.00808912 0.0149302 2026-02-24T07:58:16.018 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:16.014+0000 7f024e36d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:16.019 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:16.015+0000 7f024e36d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:16.019 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:15 trial016 ceph-mon[39544]: 7.8 scrub starts 2026-02-24T07:58:16.019 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:15 trial016 ceph-mon[39544]: 7.8 scrub ok 2026-02-24T07:58:16.037 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:16.038 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:16.057 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:16.057 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:16.072 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:16.072 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:16.088 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:16.089 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:16.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 643387 643259 67.0009 70.1406 0.00144736 0.0149207 2026-02-24T07:58:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:16 trial016 ceph-mon[39544]: 7.7 scrub starts 2026-02-24T07:58:17.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:16 trial016 ceph-mon[39544]: pgmap v427: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.60k op/s 2026-02-24T07:58:17.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1900553240' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:17.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:16 trial016 ceph-mon[39544]: 7.7 scrub ok 2026-02-24T07:58:17.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 652327 652199 67.0383 69.8438 0.00120599 0.0149137 2026-02-24T07:58:18.141 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:18.294 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:18.633 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:18.633 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:18.597+0000 7fe36bf53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:18.633 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:18.598+0000 7fe36bf53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:18.633 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:18.639 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:18.639 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:18.658 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:18.658 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:18.673 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:18.673 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:18.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 127 659325 659198 66.8777 54.6797 0.0260629 0.01495 2026-02-24T07:58:19.156 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:18 trial016 ceph-mon[39544]: pgmap v428: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.60k op/s 2026-02-24T07:58:19.156 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1180398863' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:19.232 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:19.233 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:19.233 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T07:58:19.233 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:19.388 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:19.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:19.868+0000 7f3e0bd5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:19.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:19.869+0000 7f3e0bd5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:19.993 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 128 665966 665838 66.6853 51.875 0.011889 0.0149922 2026-02-24T07:58:20.019 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:20.020 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:20.590 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2026-02-24T07:58:19.835746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5340250656,"num_objects":81480,"num_object_clones":0,"num_object_copies":244440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81480,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":651949,"num_write_kb":5216662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20439356,"kb_used_data":15598764,"kb_used_omap":39,"kb_used_meta":4840472,"kb_avail":2915573444,"statfs":{"total":3006477107200,"available":2985547206656,"internally_reserved":0,"allocated":15973134336,"data_stored":15971363192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39968,"internal_metadata":4956644320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1117634560,"num_objects":17055,"num_object_clones":0,"num_object_copies":51165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136430,"num_write_kb":1091440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001665"},"pg_stats":[{"pgid":"7.f","version":"108'41312","reported_seq":41326,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.920874+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:17.920874+0000","last_peered":"2026-02-24T07:58:17.920874+0000","last_clean":"2026-02-24T07:58:17.920874+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:17.920874+0000","last_undegraded":"2026-02-24T07:58:17.920874+0000","last_fullsized":"2026-02-24T07:58:17.920874+0000","mapping_epoch":106,"log_start":"108'41304","ondisk_log_start":"108'41304","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338427904,"num_objects":5164,"num_object_clones":0,"num_object_copies":15492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41312,"num_write_kb":330496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'40856","reported_seq":40870,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:18.074690+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:58:18.074690+0000","last_peered":"2026-02-24T07:58:18.074690+0000","last_clean":"2026-02-24T07:58:18.074690+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:18.074690+0000","last_undegraded":"2026-02-24T07:58:18.074690+0000","last_fullsized":"2026-02-24T07:58:18.074690+0000","mapping_epoch":106,"log_start":"108'40832","ondisk_log_start":"108'40832","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334692352,"num_objects":5107,"num_object_clones":0,"num_object_copies":15321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40856,"num_write_kb":326848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'41416","reported_seq":41430,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.854545+0000","last_change":"2026-02-24T07:56:59.882561+0000","last_active":"2026-02-24T07:58:17.854545+0000","last_peered":"2026-02-24T07:58:17.854545+0000","last_clean":"2026-02-24T07:58:17.854545+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:17.854545+0000","last_undegraded":"2026-02-24T07:58:17.854545+0000","last_fullsized":"2026-02-24T07:58:17.854545+0000","mapping_epoch":106,"log_start":"108'41411","ondisk_log_start":"108'41411","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339279872,"num_objects":5177,"num_object_clones":0,"num_object_copies":15531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41416,"num_write_kb":331328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'40800","reported_seq":40869,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.855825+0000","last_change":"2026-02-24T07:58:11.395761+0000","last_active":"2026-02-24T07:58:17.855825+0000","last_peered":"2026-02-24T07:58:17.855825+0000","last_clean":"2026-02-24T07:58:17.855825+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:17.855825+0000","last_undegraded":"2026-02-24T07:58:17.855825+0000","last_fullsized":"2026-02-24T07:58:17.855825+0000","mapping_epoch":106,"log_start":"108'40784","ondisk_log_start":"108'40784","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'37416","last_scrub_stamp":"2026-02-24T07:58:11.395697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:11.395697+0000","objects_scrubbed":4658,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:15.437054+0000","scrub_duration":661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334233600,"num_objects":5100,"num_object_clones":0,"num_object_copies":15300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40800,"num_write_kb":326400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'41448","reported_seq":41462,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:18.073683+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:58:18.073683+0000","last_peered":"2026-02-24T07:58:18.073683+0000","last_clean":"2026-02-24T07:58:18.073683+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:18.073683+0000","last_undegraded":"2026-02-24T07:58:18.073683+0000","last_fullsized":"2026-02-24T07:58:18.073683+0000","mapping_epoch":106,"log_start":"108'41440","ondisk_log_start":"108'41440","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339542016,"num_objects":5181,"num_object_clones":0,"num_object_copies":15543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41448,"num_write_kb":331584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'39960","reported_seq":39974,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:18.073941+0000","last_change":"2026-02-24T07:56:59.883083+0000","last_active":"2026-02-24T07:58:18.073941+0000","last_peered":"2026-02-24T07:58:18.073941+0000","last_clean":"2026-02-24T07:58:18.073941+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:18.073941+0000","last_undegraded":"2026-02-24T07:58:18.073941+0000","last_fullsized":"2026-02-24T07:58:18.073941+0000","mapping_epoch":106,"log_start":"108'39952","ondisk_log_start":"108'39952","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.150677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327352320,"num_objects":4995,"num_object_clones":0,"num_object_copies":14985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39960,"num_write_kb":319680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'40952","reported_seq":41014,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.951741+0000","last_change":"2026-02-24T07:58:13.111295+0000","last_active":"2026-02-24T07:58:17.951741+0000","last_peered":"2026-02-24T07:58:17.951741+0000","last_clean":"2026-02-24T07:58:17.951741+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:17.951741+0000","last_undegraded":"2026-02-24T07:58:17.951741+0000","last_fullsized":"2026-02-24T07:58:17.951741+0000","mapping_epoch":106,"log_start":"108'40941","ondisk_log_start":"108'40941","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'38288","last_scrub_stamp":"2026-02-24T07:58:13.111210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:13.111210+0000","objects_scrubbed":4751,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.599977+0000","scrub_duration":1248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335478784,"num_objects":5119,"num_object_clones":0,"num_object_copies":15357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40952,"num_write_kb":327616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'40906","reported_seq":40968,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:18.026767+0000","last_change":"2026-02-24T07:58:15.599666+0000","last_active":"2026-02-24T07:58:18.026767+0000","last_peered":"2026-02-24T07:58:18.026767+0000","last_clean":"2026-02-24T07:58:18.026767+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:18.026767+0000","last_undegraded":"2026-02-24T07:58:18.026767+0000","last_fullsized":"2026-02-24T07:58:18.026767+0000","mapping_epoch":106,"log_start":"108'40896","ondisk_log_start":"108'40896","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39464","last_scrub_stamp":"2026-02-24T07:58:15.599575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:15.599575+0000","objects_scrubbed":4908,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:29.457273+0000","scrub_duration":757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335101952,"num_objects":5114,"num_object_clones":0,"num_object_copies":15342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40906,"num_write_kb":327248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'40880","reported_seq":40951,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.861517+0000","last_change":"2026-02-24T07:58:16.072280+0000","last_active":"2026-02-24T07:58:17.861517+0000","last_peered":"2026-02-24T07:58:17.861517+0000","last_clean":"2026-02-24T07:58:17.861517+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:17.861517+0000","last_undegraded":"2026-02-24T07:58:17.861517+0000","last_fullsized":"2026-02-24T07:58:17.861517+0000","mapping_epoch":106,"log_start":"108'40875","ondisk_log_start":"108'40875","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39992","last_scrub_stamp":"2026-02-24T07:58:16.072141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:16.072141+0000","objects_scrubbed":4980,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:24.885797+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334888960,"num_objects":5110,"num_object_clones":0,"num_object_copies":15330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40880,"num_write_kb":327040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'39512","reported_seq":39526,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.856548+0000","last_change":"2026-02-24T07:56:59.882012+0000","last_active":"2026-02-24T07:58:17.856548+0000","last_peered":"2026-02-24T07:58:17.856548+0000","last_clean":"2026-02-24T07:58:17.856548+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:17.856548+0000","last_undegraded":"2026-02-24T07:58:17.856548+0000","last_fullsized":"2026-02-24T07:58:17.856548+0000","mapping_epoch":106,"log_start":"108'39504","ondisk_log_start":"108'39504","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:20.782125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":323682304,"num_objects":4939,"num_object_clones":0,"num_object_copies":14817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39512,"num_write_kb":316096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'40896","reported_seq":40958,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.933559+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:17.933559+0000","last_peered":"2026-02-24T07:58:17.933559+0000","last_clean":"2026-02-24T07:58:17.933559+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:17.933559+0000","last_undegraded":"2026-02-24T07:58:17.933559+0000","last_fullsized":"2026-02-24T07:58:17.933559+0000","mapping_epoch":106,"log_start":"108'40888","ondisk_log_start":"108'40888","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335020032,"num_objects":5112,"num_object_clones":0,"num_object_copies":15336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40896,"num_write_kb":327168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'40792","reported_seq":40806,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.951930+0000","last_change":"2026-02-24T07:56:59.883147+0000","last_active":"2026-02-24T07:58:17.951930+0000","last_peered":"2026-02-24T07:58:17.951930+0000","last_clean":"2026-02-24T07:58:17.951930+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:17.951930+0000","last_undegraded":"2026-02-24T07:58:17.951930+0000","last_fullsized":"2026-02-24T07:58:17.951930+0000","mapping_epoch":106,"log_start":"108'40787","ondisk_log_start":"108'40787","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:19.007444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334168064,"num_objects":5099,"num_object_clones":0,"num_object_copies":15297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40792,"num_write_kb":326336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'40928","reported_seq":40942,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.952209+0000","last_change":"2026-02-24T07:56:59.882412+0000","last_active":"2026-02-24T07:58:17.952209+0000","last_peered":"2026-02-24T07:58:17.952209+0000","last_clean":"2026-02-24T07:58:17.952209+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:17.952209+0000","last_undegraded":"2026-02-24T07:58:17.952209+0000","last_fullsized":"2026-02-24T07:58:17.952209+0000","mapping_epoch":106,"log_start":"108'40920","ondisk_log_start":"108'40920","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335282176,"num_objects":5116,"num_object_clones":0,"num_object_copies":15348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40928,"num_write_kb":327424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'40144","reported_seq":40205,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.848076+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:17.848076+0000","last_peered":"2026-02-24T07:58:17.848076+0000","last_clean":"2026-02-24T07:58:17.848076+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:17.848076+0000","last_undegraded":"2026-02-24T07:58:17.848076+0000","last_fullsized":"2026-02-24T07:58:17.848076+0000","mapping_epoch":106,"log_start":"108'40132","ondisk_log_start":"108'40132","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328859648,"num_objects":5018,"num_object_clones":0,"num_object_copies":15054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40144,"num_write_kb":321152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'40492","reported_seq":40503,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.855727+0000","last_change":"2026-02-24T07:56:59.882489+0000","last_active":"2026-02-24T07:58:17.855727+0000","last_peered":"2026-02-24T07:58:17.855727+0000","last_clean":"2026-02-24T07:58:17.855727+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:17.855727+0000","last_undegraded":"2026-02-24T07:58:17.855727+0000","last_fullsized":"2026-02-24T07:58:17.855727+0000","mapping_epoch":106,"log_start":"108'40488","ondisk_log_start":"108'40488","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:18.239360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331710464,"num_objects":5062,"num_object_clones":0,"num_object_copies":15186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5062,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40492,"num_write_kb":323936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'40520","reported_seq":40516,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:17.950199+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:58:17.950199+0000","last_peered":"2026-02-24T07:58:17.950199+0000","last_clean":"2026-02-24T07:58:17.950199+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:17.950199+0000","last_undegraded":"2026-02-24T07:58:17.950199+0000","last_fullsized":"2026-02-24T07:58:17.950199+0000","mapping_epoch":106,"log_start":"108'40500","ondisk_log_start":"108'40500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:22.384735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331939840,"num_objects":5065,"num_object_clones":0,"num_object_copies":15195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40520,"num_write_kb":324160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":5339660288,"num_objects":81478,"num_object_clones":0,"num_object_copies":244434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651814,"num_write_kb":5214512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16019931136,"data_stored":16019931136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215245,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4500032,"kb_used_data":3557804,"kb_used_omap":9,"kb_used_meta":942198,"kb_avail":729503168,"statfs":{"total":751619276800,"available":747011244032,"internally_reserved":0,"allocated":3643191296,"data_stored":3642747622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":964810763},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444174,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4806328,"kb_used_data":3256740,"kb_used_omap":9,"kb_used_meta":1549558,"kb_avail":729196872,"statfs":{"total":751619276800,"available":746697596928,"internally_reserved":0,"allocated":3334901760,"data_stored":3334458086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1586747505},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4993508,"kb_used_data":4234768,"kb_used_omap":9,"kb_used_meta":758710,"kb_avail":729009692,"statfs":{"total":751619276800,"available":746505924608,"internally_reserved":0,"allocated":4336402432,"data_stored":4335962310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9471,"internal_metadata":776919809},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705811,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6139488,"kb_used_data":4549452,"kb_used_omap":9,"kb_used_meta":1590006,"kb_avail":727863712,"statfs":{"total":751619276800,"available":745332441088,"internally_reserved":0,"allocated":4658638848,"data_stored":4658195174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1628166243},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4670988288,"data_stored":4670988288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4349009920,"data_stored":4349009920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3337650176,"data_stored":3337650176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3662282752,"data_stored":3662282752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:20.591 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:20.591 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 56 2026-02-24T07:58:20.731 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:20.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 128 671684 671556 66.4066 44.6719 0.00865385 0.0150546 2026-02-24T07:58:21.103 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:20 trial016 ceph-mon[39544]: 7.0 scrub starts 2026-02-24T07:58:21.104 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:20 trial016 ceph-mon[39544]: pgmap v429: 17 pgs: 17 active+clean; 5.0 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 89 MiB/s wr, 11.37k op/s 2026-02-24T07:58:21.104 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:20 trial016 ceph-mon[39544]: 7.2 scrub starts 2026-02-24T07:58:21.104 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:20 trial016 ceph-mon[39544]: from='client.15419 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:21.104 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:20 trial016 ceph-mon[39544]: 7.0 scrub ok 2026-02-24T07:58:21.158 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:21.171 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:21.152+0000 7fd564075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:21.172 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:21.153+0000 7fd564075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:21.308 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:21.316 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:21.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:21.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:58:21.992904+0000 min lat: 0.000574286 max lat: 0.130466 avg lat: 0.0151239 2026-02-24T07:58:21.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:58:21.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 676888 676760 66.0847 40.6562 0.00287727 0.0151239 2026-02-24T07:58:22.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:21 trial016 ceph-mon[39544]: 7.d scrub starts 2026-02-24T07:58:22.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:21 trial016 ceph-mon[39544]: 7.3 scrub starts 2026-02-24T07:58:22.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:21 trial016 ceph-mon[39544]: 7.a scrub starts 2026-02-24T07:58:22.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1616745556' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T07:58:22.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:21 trial016 ceph-mon[39544]: 7.d scrub ok 2026-02-24T07:58:22.342 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:22.339+0000 7fb9ef8b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:22.342 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:22.339+0000 7fb9ef8b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:22.366 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:22.367 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:22.381 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:22.382 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:22.398 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:22.399 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:22.415 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:22.415 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:22.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 128 685619 685491 66.1109 68.2109 0.00135982 0.0151224 2026-02-24T07:58:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:22 trial016 ceph-mon[39544]: 7.5 scrub starts 2026-02-24T07:58:23.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:22 trial016 ceph-mon[39544]: pgmap v430: 17 pgs: 17 active+clean; 5.0 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.54k op/s 2026-02-24T07:58:23.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:22 trial016 ceph-mon[39544]: 7.5 scrub ok 2026-02-24T07:58:23.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1203964000' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:23.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 694759 694631 66.1754 71.4062 0.00501967 0.015109 2026-02-24T07:58:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:23 trial016 ceph-mon[39544]: 7.2 scrub ok 2026-02-24T07:58:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:23 trial016 ceph-mon[39544]: 7.3 scrub ok 2026-02-24T07:58:24.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:23 trial016 ceph-mon[39544]: 7.a scrub ok 2026-02-24T07:58:24.465 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:24.612 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:24.735 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:24.732+0000 7f4211e4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:24.735 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:24.732+0000 7f4211e4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:24.752 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:24.752 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:24.766 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:24.766 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:24.784 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:24.784 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:24.798 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:24.798 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:24.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 127 703126 702999 66.1657 65.375 0.0127078 0.0151112 2026-02-24T07:58:25.066 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:24 trial016 ceph-mon[39544]: pgmap v431: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.33k op/s 2026-02-24T07:58:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:24 trial016 ceph-mon[39544]: 7.b scrub starts 2026-02-24T07:58:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:24 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:58:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:24 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:58:25.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2916307070' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:25.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 128 712337 712209 66.2345 71.9531 0.00801902 0.0150949 2026-02-24T07:58:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:25 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:58:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:25 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:58:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:25 trial016 ceph-mon[39544]: 7.b scrub ok 2026-02-24T07:58:26.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:26.841 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:26.841 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:58:26.841 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:26.849 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:26.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 721871 721743 66.3315 74.4844 0.00211207 0.0150724 2026-02-24T07:58:27.002 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:27.043 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:27.122 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:26 trial016 ceph-mon[39544]: pgmap v432: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.55k op/s 2026-02-24T07:58:27.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.130+0000 7f3ecd033640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.131+0000 7f3ecd033640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.170 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.167+0000 7f321b60e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.170 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.168+0000 7f321b60e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.186 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:27.186 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:27.208 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:27.208 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:27.225 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:27.225 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:27.239 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:27.239 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:27.287 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:27.288 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:27.343 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2026-02-24T07:58:25.836602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5614207520,"num_objects":85661,"num_object_clones":0,"num_object_copies":256983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85661,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":685391,"num_write_kb":5484198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":21532444,"kb_used_data":16403084,"kb_used_omap":39,"kb_used_meta":5129240,"kb_avail":2914480356,"statfs":{"total":3006477107200,"available":2984427884544,"internally_reserved":0,"allocated":16796758016,"data_stored":16794986872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39968,"internal_metadata":5252342752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,10],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":643915776,"num_objects":9825,"num_object_clones":0,"num_object_copies":29475,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9825,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78603,"num_write_kb":628824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001689"},"pg_stats":[{"pgid":"7.f","version":"108'43240","reported_seq":43240,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.952594+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:22.952594+0000","last_peered":"2026-02-24T07:58:22.952594+0000","last_clean":"2026-02-24T07:58:22.952594+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:22.952594+0000","last_undegraded":"2026-02-24T07:58:22.952594+0000","last_fullsized":"2026-02-24T07:58:22.952594+0000","mapping_epoch":106,"log_start":"108'43219","ondisk_log_start":"108'43219","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:26.840502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354222080,"num_objects":5405,"num_object_clones":0,"num_object_copies":16215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":345920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'43049","reported_seq":43054,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:23.076178+0000","last_change":"2026-02-24T07:56:59.884494+0000","last_active":"2026-02-24T07:58:23.076178+0000","last_peered":"2026-02-24T07:58:23.076178+0000","last_clean":"2026-02-24T07:58:23.076178+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:23.076178+0000","last_undegraded":"2026-02-24T07:58:23.076178+0000","last_fullsized":"2026-02-24T07:58:23.076178+0000","mapping_epoch":106,"log_start":"108'43032","ondisk_log_start":"108'43032","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:27.323022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352657408,"num_objects":5382,"num_object_clones":0,"num_object_copies":16146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43049,"num_write_kb":344392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'43344","reported_seq":43419,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.861942+0000","last_change":"2026-02-24T07:58:21.546043+0000","last_active":"2026-02-24T07:58:22.861942+0000","last_peered":"2026-02-24T07:58:22.861942+0000","last_clean":"2026-02-24T07:58:22.861942+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:22.861942+0000","last_undegraded":"2026-02-24T07:58:22.861942+0000","last_fullsized":"2026-02-24T07:58:22.861942+0000","mapping_epoch":106,"log_start":"108'43336","ondisk_log_start":"108'43336","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42720","last_scrub_stamp":"2026-02-24T07:58:21.545943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:21.545943+0000","objects_scrubbed":5327,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.143130+0000","scrub_duration":802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355074048,"num_objects":5418,"num_object_clones":0,"num_object_copies":16254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43344,"num_write_kb":346752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'43009","reported_seq":43077,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.863173+0000","last_change":"2026-02-24T07:58:11.395761+0000","last_active":"2026-02-24T07:58:22.863173+0000","last_peered":"2026-02-24T07:58:22.863173+0000","last_clean":"2026-02-24T07:58:22.863173+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:22.863173+0000","last_undegraded":"2026-02-24T07:58:22.863173+0000","last_fullsized":"2026-02-24T07:58:22.863173+0000","mapping_epoch":106,"log_start":"108'43005","ondisk_log_start":"108'43005","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'37416","last_scrub_stamp":"2026-02-24T07:58:11.395697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:11.395697+0000","objects_scrubbed":4658,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:15.437054+0000","scrub_duration":661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352329728,"num_objects":5377,"num_object_clones":0,"num_object_copies":16131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43009,"num_write_kb":344072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'43672","reported_seq":43677,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:23.076220+0000","last_change":"2026-02-24T07:56:59.883167+0000","last_active":"2026-02-24T07:58:23.076220+0000","last_peered":"2026-02-24T07:58:23.076220+0000","last_clean":"2026-02-24T07:58:23.076220+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:23.076220+0000","last_undegraded":"2026-02-24T07:58:23.076220+0000","last_fullsized":"2026-02-24T07:58:23.076220+0000","mapping_epoch":106,"log_start":"108'43648","ondisk_log_start":"108'43648","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:23.497895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357761024,"num_objects":5459,"num_object_clones":0,"num_object_copies":16377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43672,"num_write_kb":349376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'42000","reported_seq":42075,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:23.037765+0000","last_change":"2026-02-24T07:58:22.735166+0000","last_active":"2026-02-24T07:58:23.037765+0000","last_peered":"2026-02-24T07:58:23.037765+0000","last_clean":"2026-02-24T07:58:23.037765+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:23.037765+0000","last_undegraded":"2026-02-24T07:58:23.037765+0000","last_fullsized":"2026-02-24T07:58:23.037765+0000","mapping_epoch":106,"log_start":"108'41984","ondisk_log_start":"108'41984","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41800","last_scrub_stamp":"2026-02-24T07:58:22.735062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.735062+0000","objects_scrubbed":5181,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:37.608270+0000","scrub_duration":1843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344064000,"num_objects":5250,"num_object_clones":0,"num_object_copies":15750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42000,"num_write_kb":336000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'43224","reported_seq":43294,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.952415+0000","last_change":"2026-02-24T07:58:13.111295+0000","last_active":"2026-02-24T07:58:22.952415+0000","last_peered":"2026-02-24T07:58:22.952415+0000","last_clean":"2026-02-24T07:58:22.952415+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:22.952415+0000","last_undegraded":"2026-02-24T07:58:22.952415+0000","last_fullsized":"2026-02-24T07:58:22.952415+0000","mapping_epoch":106,"log_start":"108'43216","ondisk_log_start":"108'43216","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'38288","last_scrub_stamp":"2026-02-24T07:58:13.111210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:13.111210+0000","objects_scrubbed":4751,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.599977+0000","scrub_duration":1248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354091008,"num_objects":5403,"num_object_clones":0,"num_object_copies":16209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43224,"num_write_kb":345792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'43216","reported_seq":43287,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:23.066919+0000","last_change":"2026-02-24T07:58:15.599666+0000","last_active":"2026-02-24T07:58:23.066919+0000","last_peered":"2026-02-24T07:58:23.066919+0000","last_clean":"2026-02-24T07:58:23.066919+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:23.066919+0000","last_undegraded":"2026-02-24T07:58:23.066919+0000","last_fullsized":"2026-02-24T07:58:23.066919+0000","mapping_epoch":106,"log_start":"108'43211","ondisk_log_start":"108'43211","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39464","last_scrub_stamp":"2026-02-24T07:58:15.599575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:15.599575+0000","objects_scrubbed":4908,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:29.457273+0000","scrub_duration":757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354025472,"num_objects":5402,"num_object_clones":0,"num_object_copies":16206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43216,"num_write_kb":345728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'43008","reported_seq":43079,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.872475+0000","last_change":"2026-02-24T07:58:16.072280+0000","last_active":"2026-02-24T07:58:22.872475+0000","last_peered":"2026-02-24T07:58:22.872475+0000","last_clean":"2026-02-24T07:58:22.872475+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:22.872475+0000","last_undegraded":"2026-02-24T07:58:22.872475+0000","last_fullsized":"2026-02-24T07:58:22.872475+0000","mapping_epoch":106,"log_start":"108'43000","ondisk_log_start":"108'43000","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39992","last_scrub_stamp":"2026-02-24T07:58:16.072141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:16.072141+0000","objects_scrubbed":4980,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:24.885797+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":5376,"num_object_clones":0,"num_object_copies":16128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43008,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'41680","reported_seq":41754,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.866857+0000","last_change":"2026-02-24T07:58:22.175075+0000","last_active":"2026-02-24T07:58:22.866857+0000","last_peered":"2026-02-24T07:58:22.866857+0000","last_clean":"2026-02-24T07:58:22.866857+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:22.866857+0000","last_undegraded":"2026-02-24T07:58:22.866857+0000","last_fullsized":"2026-02-24T07:58:22.866857+0000","mapping_epoch":106,"log_start":"108'41660","ondisk_log_start":"108'41660","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41208","last_scrub_stamp":"2026-02-24T07:58:22.175035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.175035+0000","objects_scrubbed":5136,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.238640+0000","scrub_duration":774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341442560,"num_objects":5210,"num_object_clones":0,"num_object_copies":15630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41680,"num_write_kb":333440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'42752","reported_seq":42806,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.952270+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:22.952270+0000","last_peered":"2026-02-24T07:58:22.952270+0000","last_clean":"2026-02-24T07:58:22.952270+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:22.952270+0000","last_undegraded":"2026-02-24T07:58:22.952270+0000","last_fullsized":"2026-02-24T07:58:22.952270+0000","mapping_epoch":106,"log_start":"108'42739","ondisk_log_start":"108'42739","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350224384,"num_objects":5344,"num_object_clones":0,"num_object_copies":16032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42752,"num_write_kb":342016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'42966","reported_seq":43039,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.945312+0000","last_change":"2026-02-24T07:58:22.283896+0000","last_active":"2026-02-24T07:58:22.945312+0000","last_peered":"2026-02-24T07:58:22.945312+0000","last_clean":"2026-02-24T07:58:22.945312+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:22.945312+0000","last_undegraded":"2026-02-24T07:58:22.945312+0000","last_fullsized":"2026-02-24T07:58:22.945312+0000","mapping_epoch":106,"log_start":"108'42962","ondisk_log_start":"108'42962","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42556","last_scrub_stamp":"2026-02-24T07:58:22.283698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.283698+0000","objects_scrubbed":5295,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:39.839089+0000","scrub_duration":1428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351977472,"num_objects":5371,"num_object_clones":0,"num_object_copies":16113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42966,"num_write_kb":343728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'42968","reported_seq":43043,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.939494+0000","last_change":"2026-02-24T07:58:22.274839+0000","last_active":"2026-02-24T07:58:22.939494+0000","last_peered":"2026-02-24T07:58:22.939494+0000","last_clean":"2026-02-24T07:58:22.939494+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:22.939494+0000","last_undegraded":"2026-02-24T07:58:22.939494+0000","last_fullsized":"2026-02-24T07:58:22.939494+0000","mapping_epoch":106,"log_start":"108'42960","ondisk_log_start":"108'42960","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42625","last_scrub_stamp":"2026-02-24T07:58:22.274728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.274728+0000","objects_scrubbed":5273,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:31.513296+0000","scrub_duration":2448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351993856,"num_objects":5371,"num_object_clones":0,"num_object_copies":16113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42968,"num_write_kb":343744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'42040","reported_seq":42101,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.842491+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:22.842491+0000","last_peered":"2026-02-24T07:58:22.842491+0000","last_clean":"2026-02-24T07:58:22.842491+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:22.842491+0000","last_undegraded":"2026-02-24T07:58:22.842491+0000","last_fullsized":"2026-02-24T07:58:22.842491+0000","mapping_epoch":106,"log_start":"108'42032","ondisk_log_start":"108'42032","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344391680,"num_objects":5255,"num_object_clones":0,"num_object_copies":15765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42040,"num_write_kb":336320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'42376","reported_seq":42444,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.868222+0000","last_change":"2026-02-24T07:58:20.459034+0000","last_active":"2026-02-24T07:58:22.868222+0000","last_peered":"2026-02-24T07:58:22.868222+0000","last_clean":"2026-02-24T07:58:22.868222+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:22.868222+0000","last_undegraded":"2026-02-24T07:58:22.868222+0000","last_fullsized":"2026-02-24T07:58:22.868222+0000","mapping_epoch":106,"log_start":"108'42360","ondisk_log_start":"108'42360","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41432","last_scrub_stamp":"2026-02-24T07:58:20.458991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:20.458991+0000","objects_scrubbed":5170,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.641600+0000","scrub_duration":753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347144192,"num_objects":5297,"num_object_clones":0,"num_object_copies":15891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42376,"num_write_kb":339008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'42712","reported_seq":42726,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:22.939076+0000","last_change":"2026-02-24T07:56:59.884543+0000","last_active":"2026-02-24T07:58:22.939076+0000","last_peered":"2026-02-24T07:58:22.939076+0000","last_clean":"2026-02-24T07:58:22.939076+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:22.939076+0000","last_undegraded":"2026-02-24T07:58:22.939076+0000","last_fullsized":"2026-02-24T07:58:22.939076+0000","mapping_epoch":106,"log_start":"108'42698","ondisk_log_start":"108'42698","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349896704,"num_objects":5339,"num_object_clones":0,"num_object_copies":16017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42712,"num_write_kb":341696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":5613617152,"num_objects":85659,"num_object_clones":0,"num_object_copies":256977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685256,"num_write_kb":5482048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16839688192,"data_stored":16839688192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215246,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4754192,"kb_used_data":3739772,"kb_used_omap":9,"kb_used_meta":1014390,"kb_avail":729249008,"statfs":{"total":751619276800,"available":746750984192,"internally_reserved":0,"allocated":3829526528,"data_stored":3829082854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":1038735371},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,10],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444175,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5026296,"kb_used_data":3422564,"kb_used_omap":9,"kb_used_meta":1603702,"kb_avail":728976904,"statfs":{"total":751619276800,"available":746472349696,"internally_reserved":0,"allocated":3504705536,"data_stored":3504261862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1642190961},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5300260,"kb_used_data":4451280,"kb_used_omap":9,"kb_used_meta":848950,"kb_avail":728702940,"statfs":{"total":751619276800,"available":746191810560,"internally_reserved":0,"allocated":4558110720,"data_stored":4557670598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9471,"internal_metadata":869325569},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705812,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6451696,"kb_used_data":4789468,"kb_used_omap":9,"kb_used_meta":1662198,"kb_avail":727551504,"statfs":{"total":751619276800,"available":745012740096,"internally_reserved":0,"allocated":4904415232,"data_stored":4903971558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10141,"internal_metadata":1702090851},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4907499520,"data_stored":4907499520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4571832320,"data_stored":4571832320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3508748288,"data_stored":3508748288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3851608064,"data_stored":3851608064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:27.344 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:27.344 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 231 2026-02-24T07:58:27.537 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:27.676 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.674+0000 7f950dde8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.676 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:27.675+0000 7f950dde8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:27.831 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:27.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:27.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 128 730894 730766 66.3798 70.4922 0.0121928 0.0150621 2026-02-24T07:58:28.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1446268644' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:28.033 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/736636507' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "231"} : dispatch 2026-02-24T07:58:28.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 740161 740033 66.4489 72.3984 0.00541509 0.0150461 2026-02-24T07:58:29.286 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:29.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:28 trial016 ceph-mon[39544]: from='client.15427 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:29.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:28 trial016 ceph-mon[39544]: pgmap v433: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.55k op/s 2026-02-24T07:58:29.440 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:29.880 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:29.868+0000 7f66d8fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:29.880 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:29.868+0000 7f66d8fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:29.899 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:29.900 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:29.912 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:29.913 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:29.926 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:29.927 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:29.941 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:29.941 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:29.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 747378 747250 66.3345 56.3828 0.00989825 0.0150711 2026-02-24T07:58:30.207 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:29 trial016 ceph-mon[39544]: 7.e scrub starts 2026-02-24T07:58:30.207 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3248256301' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:30.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 754315 754187 66.1981 54.1953 0.00753453 0.0151022 2026-02-24T07:58:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:30 trial016 ceph-mon[39544]: 7.6 scrub starts 2026-02-24T07:58:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:30 trial016 ceph-mon[39544]: pgmap v434: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.32k op/s 2026-02-24T07:58:31.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:30 trial016 ceph-mon[39544]: 7.e scrub ok 2026-02-24T07:58:31.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 108 763140 763032 66.2303 69.1016 0.0046505 0.0150952 2026-02-24T07:58:32.523 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:32.640 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:32.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:32.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:32.878 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:58:32.878 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:32.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0143 2026-02-24T07:58:32.994 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 763140 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 66.2343 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 9.2328 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 79.2188 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 40.6562 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 8477 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 1181.8 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 10140 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 5204 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0150962 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.0113805 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.130466 2026-02-24T07:58:32.995 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000574286 2026-02-24T07:58:32.996 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T07:58:33.064 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:32 trial016 ceph-mon[39544]: 7.6 scrub ok 2026-02-24T07:58:33.064 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:32 trial016 ceph-mon[39544]: pgmap v435: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.56k op/s 2026-02-24T07:58:33.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:33.061+0000 7f73c66cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:33.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:33.062+0000 7f73c66cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:33.107 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:33.108 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:33.116 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:33.116 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:33.128 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:33.130 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:33.131 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:33.145 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:33.145 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:33.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:33.968+0000 7f551a078640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:33.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:33.969+0000 7f551a078640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:34.123 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:34.124 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:34.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2619193436' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:34.617 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2026-02-24T07:58:33.837708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6241944096,"num_objects":95238,"num_object_clones":0,"num_object_copies":285714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95238,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":763432,"num_write_kb":6107270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23896572,"kb_used_data":18319788,"kb_used_omap":40,"kb_used_meta":5576663,"kb_avail":2912116228,"statfs":{"total":3006477107200,"available":2982007017472,"internally_reserved":0,"allocated":18759462912,"data_stored":18757691768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41272,"internal_metadata":5710503624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,2,9,40,31,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":901693440,"num_objects":13758,"num_object_clones":0,"num_object_copies":41274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111483,"num_write_kb":890608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001656"},"pg_stats":[{"pgid":"7.f","version":"108'47960","reported_seq":47974,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.995351+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:31.995351+0000","last_peered":"2026-02-24T07:58:31.995351+0000","last_clean":"2026-02-24T07:58:31.995351+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:31.995351+0000","last_undegraded":"2026-02-24T07:58:31.995351+0000","last_fullsized":"2026-02-24T07:58:31.995351+0000","mapping_epoch":106,"log_start":"108'47936","ondisk_log_start":"108'47936","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392888320,"num_objects":5995,"num_object_clones":0,"num_object_copies":17985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47960,"num_write_kb":383680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'47869","reported_seq":47944,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:33.084495+0000","last_change":"2026-02-24T07:58:30.414885+0000","last_active":"2026-02-24T07:58:33.084495+0000","last_peered":"2026-02-24T07:58:33.084495+0000","last_clean":"2026-02-24T07:58:33.084495+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:33.084495+0000","last_undegraded":"2026-02-24T07:58:33.084495+0000","last_fullsized":"2026-02-24T07:58:33.084495+0000","mapping_epoch":106,"log_start":"108'47863","ondisk_log_start":"108'47863","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'46968","last_scrub_stamp":"2026-02-24T07:58:30.414844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:30.414844+0000","objects_scrubbed":5814,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.683122+0000","scrub_duration":1697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389414912,"num_objects":5942,"num_object_clones":0,"num_object_copies":17826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47869,"num_write_kb":382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'48240","reported_seq":48315,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.970163+0000","last_change":"2026-02-24T07:58:21.546043+0000","last_active":"2026-02-24T07:58:31.970163+0000","last_peered":"2026-02-24T07:58:31.970163+0000","last_clean":"2026-02-24T07:58:31.970163+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:31.970163+0000","last_undegraded":"2026-02-24T07:58:31.970163+0000","last_fullsized":"2026-02-24T07:58:31.970163+0000","mapping_epoch":106,"log_start":"108'48237","ondisk_log_start":"108'48237","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42720","last_scrub_stamp":"2026-02-24T07:58:21.545943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:21.545943+0000","objects_scrubbed":5327,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.143130+0000","scrub_duration":802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395182080,"num_objects":6030,"num_object_clones":0,"num_object_copies":18090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6030,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48240,"num_write_kb":385920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'47584","reported_seq":47653,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.960233+0000","last_change":"2026-02-24T07:58:11.395761+0000","last_active":"2026-02-24T07:58:31.960233+0000","last_peered":"2026-02-24T07:58:31.960233+0000","last_clean":"2026-02-24T07:58:31.960233+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:31.960233+0000","last_undegraded":"2026-02-24T07:58:31.960233+0000","last_fullsized":"2026-02-24T07:58:31.960233+0000","mapping_epoch":106,"log_start":"108'47580","ondisk_log_start":"108'47580","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'37416","last_scrub_stamp":"2026-02-24T07:58:11.395697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:11.395697+0000","objects_scrubbed":4658,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:15.437054+0000","scrub_duration":661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389808128,"num_objects":5948,"num_object_clones":0,"num_object_copies":17844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47584,"num_write_kb":380672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'48437","reported_seq":48514,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:33.083405+0000","last_change":"2026-02-24T07:58:25.304532+0000","last_active":"2026-02-24T07:58:33.083405+0000","last_peered":"2026-02-24T07:58:33.083405+0000","last_clean":"2026-02-24T07:58:33.083405+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:33.083405+0000","last_undegraded":"2026-02-24T07:58:33.083405+0000","last_fullsized":"2026-02-24T07:58:33.083405+0000","mapping_epoch":106,"log_start":"108'48434","ondisk_log_start":"108'48434","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'44952","last_scrub_stamp":"2026-02-24T07:58:25.304496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:25.304496+0000","objects_scrubbed":5581,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:39.099401+0000","scrub_duration":1422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394657792,"num_objects":6022,"num_object_clones":0,"num_object_copies":18066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48437,"num_write_kb":387264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'46514","reported_seq":46585,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:33.086600+0000","last_change":"2026-02-24T07:58:22.735166+0000","last_active":"2026-02-24T07:58:33.086600+0000","last_peered":"2026-02-24T07:58:33.086600+0000","last_clean":"2026-02-24T07:58:33.086600+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:33.086600+0000","last_undegraded":"2026-02-24T07:58:33.086600+0000","last_fullsized":"2026-02-24T07:58:33.086600+0000","mapping_epoch":106,"log_start":"108'46498","ondisk_log_start":"108'46498","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41800","last_scrub_stamp":"2026-02-24T07:58:22.735062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.735062+0000","objects_scrubbed":5181,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:37.608270+0000","scrub_duration":1843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378241024,"num_objects":5772,"num_object_clones":0,"num_object_copies":17316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46514,"num_write_kb":371808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'48064","reported_seq":48134,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.994767+0000","last_change":"2026-02-24T07:58:13.111295+0000","last_active":"2026-02-24T07:58:31.994767+0000","last_peered":"2026-02-24T07:58:31.994767+0000","last_clean":"2026-02-24T07:58:31.994767+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:31.994767+0000","last_undegraded":"2026-02-24T07:58:31.994767+0000","last_fullsized":"2026-02-24T07:58:31.994767+0000","mapping_epoch":106,"log_start":"108'48056","ondisk_log_start":"108'48056","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'38288","last_scrub_stamp":"2026-02-24T07:58:13.111210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:13.111210+0000","objects_scrubbed":4751,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.599977+0000","scrub_duration":1248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393740288,"num_objects":6008,"num_object_clones":0,"num_object_copies":18024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48064,"num_write_kb":384512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'48221","reported_seq":48285,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:33.089379+0000","last_change":"2026-02-24T07:58:15.599666+0000","last_active":"2026-02-24T07:58:33.089379+0000","last_peered":"2026-02-24T07:58:33.089379+0000","last_clean":"2026-02-24T07:58:33.089379+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:33.089379+0000","last_undegraded":"2026-02-24T07:58:33.089379+0000","last_fullsized":"2026-02-24T07:58:33.089379+0000","mapping_epoch":106,"log_start":"108'48212","ondisk_log_start":"108'48212","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39464","last_scrub_stamp":"2026-02-24T07:58:15.599575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:15.599575+0000","objects_scrubbed":4908,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:29.457273+0000","scrub_duration":757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":391118848,"num_objects":5968,"num_object_clones":0,"num_object_copies":17904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48221,"num_write_kb":385344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'48232","reported_seq":48303,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.989341+0000","last_change":"2026-02-24T07:58:16.072280+0000","last_active":"2026-02-24T07:58:31.989341+0000","last_peered":"2026-02-24T07:58:31.989341+0000","last_clean":"2026-02-24T07:58:31.989341+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:31.989341+0000","last_undegraded":"2026-02-24T07:58:31.989341+0000","last_fullsized":"2026-02-24T07:58:31.989341+0000","mapping_epoch":106,"log_start":"108'48216","ondisk_log_start":"108'48216","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39992","last_scrub_stamp":"2026-02-24T07:58:16.072141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:16.072141+0000","objects_scrubbed":4980,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:24.885797+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395116544,"num_objects":6029,"num_object_clones":0,"num_object_copies":18087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48232,"num_write_kb":385856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'46608","reported_seq":46682,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.947877+0000","last_change":"2026-02-24T07:58:22.175075+0000","last_active":"2026-02-24T07:58:31.947877+0000","last_peered":"2026-02-24T07:58:31.947877+0000","last_clean":"2026-02-24T07:58:31.947877+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:31.947877+0000","last_undegraded":"2026-02-24T07:58:31.947877+0000","last_fullsized":"2026-02-24T07:58:31.947877+0000","mapping_epoch":106,"log_start":"108'46600","ondisk_log_start":"108'46600","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41208","last_scrub_stamp":"2026-02-24T07:58:22.175035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.175035+0000","objects_scrubbed":5136,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.238640+0000","scrub_duration":774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381812736,"num_objects":5826,"num_object_clones":0,"num_object_copies":17478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46608,"num_write_kb":372864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'47392","reported_seq":47454,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.995114+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:31.995114+0000","last_peered":"2026-02-24T07:58:31.995114+0000","last_clean":"2026-02-24T07:58:31.995114+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:31.995114+0000","last_undegraded":"2026-02-24T07:58:31.995114+0000","last_fullsized":"2026-02-24T07:58:31.995114+0000","mapping_epoch":106,"log_start":"108'47384","ondisk_log_start":"108'47384","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388235264,"num_objects":5924,"num_object_clones":0,"num_object_copies":17772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":379136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'47856","reported_seq":47931,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.981254+0000","last_change":"2026-02-24T07:58:22.283896+0000","last_active":"2026-02-24T07:58:31.981254+0000","last_peered":"2026-02-24T07:58:31.981254+0000","last_clean":"2026-02-24T07:58:31.981254+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:31.981254+0000","last_undegraded":"2026-02-24T07:58:31.981254+0000","last_fullsized":"2026-02-24T07:58:31.981254+0000","mapping_epoch":106,"log_start":"108'47851","ondisk_log_start":"108'47851","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42556","last_scrub_stamp":"2026-02-24T07:58:22.283698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.283698+0000","objects_scrubbed":5295,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:39.839089+0000","scrub_duration":1428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392036352,"num_objects":5982,"num_object_clones":0,"num_object_copies":17946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47856,"num_write_kb":382848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'48192","reported_seq":48267,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.995584+0000","last_change":"2026-02-24T07:58:22.274839+0000","last_active":"2026-02-24T07:58:31.995584+0000","last_peered":"2026-02-24T07:58:31.995584+0000","last_clean":"2026-02-24T07:58:31.995584+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:31.995584+0000","last_undegraded":"2026-02-24T07:58:31.995584+0000","last_fullsized":"2026-02-24T07:58:31.995584+0000","mapping_epoch":106,"log_start":"108'48160","ondisk_log_start":"108'48160","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42625","last_scrub_stamp":"2026-02-24T07:58:22.274728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.274728+0000","objects_scrubbed":5273,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:31.513296+0000","scrub_duration":2448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394788864,"num_objects":6024,"num_object_clones":0,"num_object_copies":18072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48192,"num_write_kb":385536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'47064","reported_seq":47125,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.983787+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:31.983787+0000","last_peered":"2026-02-24T07:58:31.983787+0000","last_clean":"2026-02-24T07:58:31.983787+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:31.983787+0000","last_undegraded":"2026-02-24T07:58:31.983787+0000","last_fullsized":"2026-02-24T07:58:31.983787+0000","mapping_epoch":106,"log_start":"108'47057","ondisk_log_start":"108'47057","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385548288,"num_objects":5883,"num_object_clones":0,"num_object_copies":17649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47064,"num_write_kb":376512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'47432","reported_seq":47506,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.984471+0000","last_change":"2026-02-24T07:58:20.459034+0000","last_active":"2026-02-24T07:58:31.984471+0000","last_peered":"2026-02-24T07:58:31.984471+0000","last_clean":"2026-02-24T07:58:31.984471+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:31.984471+0000","last_undegraded":"2026-02-24T07:58:31.984471+0000","last_fullsized":"2026-02-24T07:58:31.984471+0000","mapping_epoch":106,"log_start":"108'47427","ondisk_log_start":"108'47427","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41432","last_scrub_stamp":"2026-02-24T07:58:20.458991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:20.458991+0000","objects_scrubbed":5170,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.641600+0000","scrub_duration":753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388562944,"num_objects":5929,"num_object_clones":0,"num_object_copies":17787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47432,"num_write_kb":379456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'47632","reported_seq":47714,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:31.992205+0000","last_change":"2026-02-24T07:58:31.035231+0000","last_active":"2026-02-24T07:58:31.992205+0000","last_peered":"2026-02-24T07:58:31.992205+0000","last_clean":"2026-02-24T07:58:31.992205+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:31.992205+0000","last_undegraded":"2026-02-24T07:58:31.992205+0000","last_fullsized":"2026-02-24T07:58:31.992205+0000","mapping_epoch":106,"log_start":"108'47624","ondisk_log_start":"108'47624","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'47056","last_scrub_stamp":"2026-02-24T07:58:31.035190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:31.035190+0000","objects_scrubbed":5816,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:38.724436+0000","scrub_duration":2071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390201344,"num_objects":5954,"num_object_clones":0,"num_object_copies":17862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47632,"num_write_kb":381056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":6241353728,"num_objects":95236,"num_object_clones":0,"num_object_copies":285708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763297,"num_write_kb":6105120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18722754560,"data_stored":18722750488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215248,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5356216,"kb_used_data":4197412,"kb_used_omap":9,"kb_used_meta":1158774,"kb_avail":728646984,"statfs":{"total":751619276800,"available":746134511616,"internally_reserved":0,"allocated":4298149888,"data_stored":4297706214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":1186584587},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444177,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5352472,"kb_used_data":3821444,"kb_used_omap":9,"kb_used_meta":1530998,"kb_avail":728650728,"statfs":{"total":751619276800,"available":746138345472,"internally_reserved":0,"allocated":3913158656,"data_stored":3912714982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1567742065},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5953940,"kb_used_data":4960576,"kb_used_omap":9,"kb_used_meta":993334,"kb_avail":728049260,"statfs":{"total":751619276800,"available":745522442240,"internally_reserved":0,"allocated":5079629824,"data_stored":5079189702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10123,"internal_metadata":1017174133},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,0,11,21,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7233944,"kb_used_data":5340356,"kb_used_omap":10,"kb_used_meta":1893557,"kb_avail":726769256,"statfs":{"total":751619276800,"available":744211718144,"internally_reserved":0,"allocated":5468524544,"data_stored":5468080870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10793,"internal_metadata":1939002839},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,9,29,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5467242496,"data_stored":5467242496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5046767616,"data_stored":5046763544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3911876608,"data_stored":3911876608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4296867840,"data_stored":4296867840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:34.618 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:34.619 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 241 2026-02-24T07:58:34.777 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:35.191 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:34 trial016 ceph-mon[39544]: pgmap v436: 17 pgs: 17 active+clean; 5.8 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.29k op/s 2026-02-24T07:58:35.191 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:35.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:35.247+0000 7f7acdacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:35.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:35.247+0000 7f7acdacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:35.396 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:35.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:35.593 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:35.748 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:35.883 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:35.880+0000 7f6b3fa11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:35.884 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:35.880+0000 7f6b3fa11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:35.902 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:35.903 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:35.917 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:35.918 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:35.931 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:35.931 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:35.943 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:35.944 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:36.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:35 trial016 ceph-mon[39544]: from='client.15437 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:36.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/517277706' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "241"} : dispatch 2026-02-24T07:58:36.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1084441360' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:36 trial016 ceph-mon[39544]: pgmap v437: 17 pgs: 17 active+clean; 5.8 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.50k op/s 2026-02-24T07:58:37.995 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:38.147 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:38.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:38.282+0000 7f12df1ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:38.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:38.282+0000 7f12df1ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:38.314 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:38.314 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:38.328 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:38.329 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:38.346 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:38.346 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:38.360 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:38.360 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:38 trial016 ceph-mon[39544]: pgmap v438: 17 pgs: 17 active+clean; 5.8 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.50k op/s 2026-02-24T07:58:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:38 trial016 ceph-mon[39544]: 7.f scrub starts 2026-02-24T07:58:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3968682743' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:39 trial016 ceph-mon[39544]: 7.f scrub ok 2026-02-24T07:58:40.410 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:40.543 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:40.543 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:40.543 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:58:40.544 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:40.564 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:40.684 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:40.682+0000 7efef876d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:40.684 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:40.682+0000 7efef876d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:40.701 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:40.706 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:40.707 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:40.722 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:40.722 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:40.741 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:40.741 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:40.756 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:40.756 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:40.920 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:40.905+0000 7f0c43018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:40.920 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:40.905+0000 7f0c43018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:41.052 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:40 trial016 ceph-mon[39544]: pgmap v439: 17 pgs: 17 active+clean; 3.3 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 51 MiB/s wr, 9.93k op/s 2026-02-24T07:58:41.052 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3109983378' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:41.053 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:41.053 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:41.924 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2026-02-24T07:58:39.838529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3550118456,"num_objects":54165,"num_object_clones":0,"num_object_copies":162495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54165,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":804507,"num_write_kb":6107271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":17028488,"kb_used_data":11289016,"kb_used_omap":40,"kb_used_meta":5739095,"kb_avail":2918984312,"statfs":{"total":3006477107200,"available":2989039935488,"internally_reserved":0,"allocated":11559952384,"data_stored":11558169024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41272,"internal_metadata":5876833992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,6,13,16,58,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2064089064,"num_objects":-31496,"num_object_clones":0,"num_object_copies":-94488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31496,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":119116,"num_write_kb":623073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001657"},"pg_stats":[{"pgid":"7.f","version":"108'50561","reported_seq":50557,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.958337+0000","last_change":"2026-02-24T07:56:59.882703+0000","last_active":"2026-02-24T07:58:37.958337+0000","last_peered":"2026-02-24T07:58:37.958337+0000","last_clean":"2026-02-24T07:58:37.958337+0000","last_became_active":"2026-02-24T07:56:59.882450+0000","last_became_peered":"2026-02-24T07:56:59.882450+0000","last_unstale":"2026-02-24T07:58:37.958337+0000","last_undegraded":"2026-02-24T07:58:37.958337+0000","last_fullsized":"2026-02-24T07:58:37.958337+0000","mapping_epoch":106,"log_start":"108'50541","ondisk_log_start":"108'50541","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:56:58.873590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222429184,"num_objects":3394,"num_object_clones":0,"num_object_copies":10182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50561,"num_write_kb":383680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"108'50471","reported_seq":50548,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:38.083347+0000","last_change":"2026-02-24T07:58:30.414885+0000","last_active":"2026-02-24T07:58:38.083347+0000","last_peered":"2026-02-24T07:58:38.083347+0000","last_clean":"2026-02-24T07:58:38.083347+0000","last_became_active":"2026-02-24T07:56:59.884285+0000","last_became_peered":"2026-02-24T07:56:59.884285+0000","last_unstale":"2026-02-24T07:58:38.083347+0000","last_undegraded":"2026-02-24T07:58:38.083347+0000","last_fullsized":"2026-02-24T07:58:38.083347+0000","mapping_epoch":106,"log_start":"108'50467","ondisk_log_start":"108'50467","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'46968","last_scrub_stamp":"2026-02-24T07:58:30.414844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:30.414844+0000","objects_scrubbed":5814,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.683122+0000","scrub_duration":1697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218890240,"num_objects":3340,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50471,"num_write_kb":382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"108'50840","reported_seq":50914,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.864424+0000","last_change":"2026-02-24T07:58:21.546043+0000","last_active":"2026-02-24T07:58:37.864424+0000","last_peered":"2026-02-24T07:58:37.864424+0000","last_clean":"2026-02-24T07:58:37.864424+0000","last_became_active":"2026-02-24T07:56:59.881892+0000","last_became_peered":"2026-02-24T07:56:59.881892+0000","last_unstale":"2026-02-24T07:58:37.864424+0000","last_undegraded":"2026-02-24T07:58:37.864424+0000","last_fullsized":"2026-02-24T07:58:37.864424+0000","mapping_epoch":106,"log_start":"108'50837","ondisk_log_start":"108'50837","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42720","last_scrub_stamp":"2026-02-24T07:58:21.545943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:21.545943+0000","objects_scrubbed":5327,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.143130+0000","scrub_duration":802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224854040,"num_objects":3432,"num_object_clones":0,"num_object_copies":10296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3432,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":50840,"num_write_kb":385921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"108'50128","reported_seq":50196,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.864619+0000","last_change":"2026-02-24T07:58:11.395761+0000","last_active":"2026-02-24T07:58:37.864619+0000","last_peered":"2026-02-24T07:58:37.864619+0000","last_clean":"2026-02-24T07:58:37.864619+0000","last_became_active":"2026-02-24T07:56:59.881923+0000","last_became_peered":"2026-02-24T07:56:59.881923+0000","last_unstale":"2026-02-24T07:58:37.864619+0000","last_undegraded":"2026-02-24T07:58:37.864619+0000","last_fullsized":"2026-02-24T07:58:37.864619+0000","mapping_epoch":106,"log_start":"108'50125","ondisk_log_start":"108'50125","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'37416","last_scrub_stamp":"2026-02-24T07:58:11.395697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:11.395697+0000","objects_scrubbed":4658,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:15.437054+0000","scrub_duration":661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223084544,"num_objects":3404,"num_object_clones":0,"num_object_copies":10212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50128,"num_write_kb":380672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"108'51059","reported_seq":51138,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:38.082572+0000","last_change":"2026-02-24T07:58:25.304532+0000","last_active":"2026-02-24T07:58:38.082572+0000","last_peered":"2026-02-24T07:58:38.082572+0000","last_clean":"2026-02-24T07:58:38.082572+0000","last_became_active":"2026-02-24T07:56:59.882858+0000","last_became_peered":"2026-02-24T07:56:59.882858+0000","last_unstale":"2026-02-24T07:58:38.082572+0000","last_undegraded":"2026-02-24T07:58:38.082572+0000","last_fullsized":"2026-02-24T07:58:38.082572+0000","mapping_epoch":106,"log_start":"108'51055","ondisk_log_start":"108'51055","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'44952","last_scrub_stamp":"2026-02-24T07:58:25.304496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:25.304496+0000","objects_scrubbed":5581,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:39.099401+0000","scrub_duration":1422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222822400,"num_objects":3400,"num_object_clones":0,"num_object_copies":10200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51059,"num_write_kb":387264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"108'49066","reported_seq":49139,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:38.083470+0000","last_change":"2026-02-24T07:58:22.735166+0000","last_active":"2026-02-24T07:58:38.083470+0000","last_peered":"2026-02-24T07:58:38.083470+0000","last_clean":"2026-02-24T07:58:38.083470+0000","last_became_active":"2026-02-24T07:56:59.882786+0000","last_became_peered":"2026-02-24T07:56:59.882786+0000","last_unstale":"2026-02-24T07:58:38.083470+0000","last_undegraded":"2026-02-24T07:58:38.083470+0000","last_fullsized":"2026-02-24T07:58:38.083470+0000","mapping_epoch":106,"log_start":"108'49060","ondisk_log_start":"108'49060","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41800","last_scrub_stamp":"2026-02-24T07:58:22.735062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.735062+0000","objects_scrubbed":5181,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:37.608270+0000","scrub_duration":1843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210993152,"num_objects":3220,"num_object_clones":0,"num_object_copies":9660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49066,"num_write_kb":371808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"108'50699","reported_seq":50760,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.948311+0000","last_change":"2026-02-24T07:58:13.111295+0000","last_active":"2026-02-24T07:58:37.948311+0000","last_peered":"2026-02-24T07:58:37.948311+0000","last_clean":"2026-02-24T07:58:37.948311+0000","last_became_active":"2026-02-24T07:56:59.883205+0000","last_became_peered":"2026-02-24T07:56:59.883205+0000","last_unstale":"2026-02-24T07:58:37.948311+0000","last_undegraded":"2026-02-24T07:58:37.948311+0000","last_fullsized":"2026-02-24T07:58:37.948311+0000","mapping_epoch":106,"log_start":"108'50688","ondisk_log_start":"108'50688","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'38288","last_scrub_stamp":"2026-02-24T07:58:13.111210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:13.111210+0000","objects_scrubbed":4751,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:22.599977+0000","scrub_duration":1248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221052928,"num_objects":3373,"num_object_clones":0,"num_object_copies":10119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3373,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50699,"num_write_kb":384512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"108'50838","reported_seq":50906,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:38.087643+0000","last_change":"2026-02-24T07:58:15.599666+0000","last_active":"2026-02-24T07:58:38.087643+0000","last_peered":"2026-02-24T07:58:38.087643+0000","last_clean":"2026-02-24T07:58:38.087643+0000","last_became_active":"2026-02-24T07:56:59.883888+0000","last_became_peered":"2026-02-24T07:56:59.883888+0000","last_unstale":"2026-02-24T07:58:38.087643+0000","last_undegraded":"2026-02-24T07:58:38.087643+0000","last_fullsized":"2026-02-24T07:58:38.087643+0000","mapping_epoch":106,"log_start":"108'50834","ondisk_log_start":"108'50834","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39464","last_scrub_stamp":"2026-02-24T07:58:15.599575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:15.599575+0000","objects_scrubbed":4908,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:29.457273+0000","scrub_duration":757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219611136,"num_objects":3351,"num_object_clones":0,"num_object_copies":10053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50838,"num_write_kb":385344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"108'50790","reported_seq":50860,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.872728+0000","last_change":"2026-02-24T07:58:16.072280+0000","last_active":"2026-02-24T07:58:37.872728+0000","last_peered":"2026-02-24T07:58:37.872728+0000","last_clean":"2026-02-24T07:58:37.872728+0000","last_became_active":"2026-02-24T07:56:59.882497+0000","last_became_peered":"2026-02-24T07:56:59.882497+0000","last_unstale":"2026-02-24T07:58:37.872728+0000","last_undegraded":"2026-02-24T07:58:37.872728+0000","last_fullsized":"2026-02-24T07:58:37.872728+0000","mapping_epoch":106,"log_start":"108'50787","ondisk_log_start":"108'50787","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'39992","last_scrub_stamp":"2026-02-24T07:58:16.072141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:16.072141+0000","objects_scrubbed":4980,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:24.885797+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227475456,"num_objects":3471,"num_object_clones":0,"num_object_copies":10413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50790,"num_write_kb":385856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"108'49028","reported_seq":49102,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.866074+0000","last_change":"2026-02-24T07:58:22.175075+0000","last_active":"2026-02-24T07:58:37.866074+0000","last_peered":"2026-02-24T07:58:37.866074+0000","last_clean":"2026-02-24T07:58:37.866074+0000","last_became_active":"2026-02-24T07:56:59.881803+0000","last_became_peered":"2026-02-24T07:56:59.881803+0000","last_unstale":"2026-02-24T07:58:37.866074+0000","last_undegraded":"2026-02-24T07:58:37.866074+0000","last_fullsized":"2026-02-24T07:58:37.866074+0000","mapping_epoch":106,"log_start":"108'49025","ondisk_log_start":"108'49025","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41208","last_scrub_stamp":"2026-02-24T07:58:22.175035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.175035+0000","objects_scrubbed":5136,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.238640+0000","scrub_duration":774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223215616,"num_objects":3406,"num_object_clones":0,"num_object_copies":10218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49028,"num_write_kb":372864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"108'49971","reported_seq":50017,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.946902+0000","last_change":"2026-02-24T07:58:02.238924+0000","last_active":"2026-02-24T07:58:37.946902+0000","last_peered":"2026-02-24T07:58:37.946902+0000","last_clean":"2026-02-24T07:58:37.946902+0000","last_became_active":"2026-02-24T07:56:59.882364+0000","last_became_peered":"2026-02-24T07:56:59.882364+0000","last_unstale":"2026-02-24T07:58:37.946902+0000","last_undegraded":"2026-02-24T07:58:37.946902+0000","last_fullsized":"2026-02-24T07:58:37.946902+0000","mapping_epoch":106,"log_start":"108'49954","ondisk_log_start":"108'49954","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31712","last_scrub_stamp":"2026-02-24T07:58:02.238878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.238878+0000","objects_scrubbed":3922,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:23.911648+0000","scrub_duration":1484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219217920,"num_objects":3345,"num_object_clones":0,"num_object_copies":10035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49971,"num_write_kb":379136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"108'50407","reported_seq":50477,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.958631+0000","last_change":"2026-02-24T07:58:22.283896+0000","last_active":"2026-02-24T07:58:37.958631+0000","last_peered":"2026-02-24T07:58:37.958631+0000","last_clean":"2026-02-24T07:58:37.958631+0000","last_became_active":"2026-02-24T07:56:59.882916+0000","last_became_peered":"2026-02-24T07:56:59.882916+0000","last_unstale":"2026-02-24T07:58:37.958631+0000","last_undegraded":"2026-02-24T07:58:37.958631+0000","last_fullsized":"2026-02-24T07:58:37.958631+0000","mapping_epoch":106,"log_start":"108'50399","ondisk_log_start":"108'50399","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42556","last_scrub_stamp":"2026-02-24T07:58:22.283698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.283698+0000","objects_scrubbed":5295,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:39.839089+0000","scrub_duration":1428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224854016,"num_objects":3431,"num_object_clones":0,"num_object_copies":10293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50407,"num_write_kb":382848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"108'50856","reported_seq":50924,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.947259+0000","last_change":"2026-02-24T07:58:22.274839+0000","last_active":"2026-02-24T07:58:37.947259+0000","last_peered":"2026-02-24T07:58:37.947259+0000","last_clean":"2026-02-24T07:58:37.947259+0000","last_became_active":"2026-02-24T07:56:59.882194+0000","last_became_peered":"2026-02-24T07:56:59.882194+0000","last_unstale":"2026-02-24T07:58:37.947259+0000","last_undegraded":"2026-02-24T07:58:37.947259+0000","last_fullsized":"2026-02-24T07:58:37.947259+0000","mapping_epoch":106,"log_start":"108'50847","ondisk_log_start":"108'50847","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'42625","last_scrub_stamp":"2026-02-24T07:58:22.274728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:22.274728+0000","objects_scrubbed":5273,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:31.513296+0000","scrub_duration":2448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220200960,"num_objects":3360,"num_object_clones":0,"num_object_copies":10080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50856,"num_write_kb":385536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"108'49475","reported_seq":49536,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.860664+0000","last_change":"2026-02-24T07:58:02.101027+0000","last_active":"2026-02-24T07:58:37.860664+0000","last_peered":"2026-02-24T07:58:37.860664+0000","last_clean":"2026-02-24T07:58:37.860664+0000","last_became_active":"2026-02-24T07:56:59.882010+0000","last_became_peered":"2026-02-24T07:56:59.882010+0000","last_unstale":"2026-02-24T07:58:37.860664+0000","last_undegraded":"2026-02-24T07:58:37.860664+0000","last_fullsized":"2026-02-24T07:58:37.860664+0000","mapping_epoch":106,"log_start":"108'49472","ondisk_log_start":"108'49472","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'31304","last_scrub_stamp":"2026-02-24T07:58:02.100950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:02.100950+0000","objects_scrubbed":3901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:26.456473+0000","scrub_duration":490,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":3472,"num_object_clones":0,"num_object_copies":10416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49475,"num_write_kb":376512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"108'50003","reported_seq":50077,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.864550+0000","last_change":"2026-02-24T07:58:20.459034+0000","last_active":"2026-02-24T07:58:37.864550+0000","last_peered":"2026-02-24T07:58:37.864550+0000","last_clean":"2026-02-24T07:58:37.864550+0000","last_became_active":"2026-02-24T07:56:59.881942+0000","last_became_peered":"2026-02-24T07:56:59.881942+0000","last_unstale":"2026-02-24T07:58:37.864550+0000","last_undegraded":"2026-02-24T07:58:37.864550+0000","last_fullsized":"2026-02-24T07:58:37.864550+0000","mapping_epoch":106,"log_start":"108'50000","ondisk_log_start":"108'50000","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'41432","last_scrub_stamp":"2026-02-24T07:58:20.458991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:20.458991+0000","objects_scrubbed":5170,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:44.641600+0000","scrub_duration":753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220069888,"num_objects":3358,"num_object_clones":0,"num_object_copies":10074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50003,"num_write_kb":379456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"108'50180","reported_seq":50252,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:58:37.949114+0000","last_change":"2026-02-24T07:58:31.035231+0000","last_active":"2026-02-24T07:58:37.949114+0000","last_peered":"2026-02-24T07:58:37.949114+0000","last_clean":"2026-02-24T07:58:37.949114+0000","last_became_active":"2026-02-24T07:56:59.884363+0000","last_became_peered":"2026-02-24T07:56:59.884363+0000","last_unstale":"2026-02-24T07:58:37.949114+0000","last_undegraded":"2026-02-24T07:58:37.949114+0000","last_fullsized":"2026-02-24T07:58:37.949114+0000","mapping_epoch":106,"log_start":"108'50166","ondisk_log_start":"108'50166","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'47056","last_scrub_stamp":"2026-02-24T07:58:31.035190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:56:58.873590+0000","last_clean_scrub_stamp":"2026-02-24T07:58:31.035190+0000","objects_scrubbed":5816,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:38.724436+0000","scrub_duration":2071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223215616,"num_objects":3406,"num_object_clones":0,"num_object_copies":10218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50180,"num_write_kb":381056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":423,"reported_epoch":108,"state":"active+clean","last_fresh":"2026-02-24T07:57:32.451797+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:57:32.451797+0000","last_peered":"2026-02-24T07:57:32.451797+0000","last_clean":"2026-02-24T07:57:32.451797+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:57:32.451797+0000","last_undegraded":"2026-02-24T07:57:32.451797+0000","last_fullsized":"2026-02-24T07:57:32.451797+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":3549528088,"num_objects":54163,"num_object_clones":0,"num_object_copies":162489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54163,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":804372,"num_write_kb":6105121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10645450752,"data_stored":10645438536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215249,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3809656,"kb_used_data":2614756,"kb_used_omap":9,"kb_used_meta":1194870,"kb_avail":730193544,"statfs":{"total":751619276800,"available":747718189056,"internally_reserved":0,"allocated":2677510144,"data_stored":2677066470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10229,"internal_metadata":1223546891},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3784988,"kb_used_data":2217864,"kb_used_omap":9,"kb_used_meta":1567094,"kb_avail":730218212,"statfs":{"total":751619276800,"available":747743449088,"internally_reserved":0,"allocated":2271092736,"data_stored":2270644990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":1604704369},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3948824,"kb_used_data":2901124,"kb_used_omap":9,"kb_used_meta":1047478,"kb_avail":730054376,"statfs":{"total":751619276800,"available":747575681024,"internally_reserved":0,"allocated":2970750976,"data_stored":2970306782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10123,"internal_metadata":1072617589},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,1,3,7,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5485020,"kb_used_data":3555272,"kb_used_omap":10,"kb_used_meta":1929653,"kb_avail":728518180,"statfs":{"total":751619276800,"available":746002616320,"internally_reserved":0,"allocated":3640598528,"data_stored":3640150782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10793,"internal_metadata":1975965143},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,11,10,51],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7218,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3099824128,"data_stored":3099820056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2810417152,"data_stored":2810413080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2253295616,"data_stored":2253291544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2481913856,"data_stored":2481913856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:41.926 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:41.926 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 251 2026-02-24T07:58:42.083 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:42.439 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:42.437+0000 7f7ccb45e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:42.440 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:42.437+0000 7f7ccb45e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:42.589 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:42.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:42 trial016 ceph-mon[39544]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:42 trial016 ceph-mon[39544]: pgmap v440: 17 pgs: 17 active+clean; 3.3 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 21 MiB/s wr, 6.16k op/s 2026-02-24T07:58:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4167246445' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "251"} : dispatch 2026-02-24T07:58:43.371 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:43.522 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:43.678 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:43.676+0000 7f94ac416640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:43.678 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:43.676+0000 7f94ac416640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:43.704 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:43.705 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:43.717 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:43.718 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:43.735 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:43.735 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:43.747 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:43.747 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:44.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1751705924' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:44.165 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 95393 objects 2026-02-24T07:58:44.165 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :11.1683 2026-02-24T07:58:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:44 trial016 ceph-mon[39544]: pgmap v441: 17 pgs: 17 active+clean; 730 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 21 MiB/s wr, 9.70k op/s 2026-02-24T07:58:45.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:45.653 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_5 2026-02-24T07:58:45.654 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2026-02-24T07:58:45.775 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:45.796 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:45.888 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:45.885+0000 7f63c0d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:45.888 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:45.886+0000 7f63c0d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:45.920 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:46.027 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:46.025+0000 7f121c99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:46.028 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:46.025+0000 7f121c99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:46.039 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:46.040 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:46.050 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:46.050 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:46.062 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:46.062 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:46.074 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:46.074 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:46.933 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_5' removed 2026-02-24T07:58:46.993 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T07:58:46.994 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T07:58:46.995 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_6 2026-02-24T07:58:46.995 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_6 16 2026-02-24T07:58:47.114 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:47.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:47.217+0000 7f2ffa8b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:47.220 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:46 trial016 ceph-mon[39544]: pgmap v442: 17 pgs: 17 active+clean; 730 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 85 B/s wr, 6.96k op/s 2026-02-24T07:58:47.220 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1984147647' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:58:47.220 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1527388626' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:47.220 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:47.217+0000 7f2ffa8b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:47.633 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:47.633 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:47.937 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_6' created 2026-02-24T07:58:47.980 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2026-02-24T07:58:48.097 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:48.110 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:48.202 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:48.200+0000 7f00130d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:48.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1984147647' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:58:48.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:47 trial016 ceph-mon[39544]: osdmap e109: 4 total, 4 up, 4 in 2026-02-24T07:58:48.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2655272636' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16} : dispatch 2026-02-24T07:58:48.202 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:48.200+0000 7f00130d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:48.233 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:48.345 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:48.343+0000 7fb59d7ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:48.345 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:48.343+0000 7fb59d7ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:48.358 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:48.358 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:48.368 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:48.368 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:48.380 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:48.381 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:48.392 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:48.392 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:48.938 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_6' 2026-02-24T07:58:49.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:48 trial016 ceph-mon[39544]: pgmap v444: 1 pgs: 1 active+clean; 577 KiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:58:49.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2655272636' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]': finished 2026-02-24T07:58:49.253 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:48 trial016 ceph-mon[39544]: osdmap e110: 4 total, 4 up, 4 in 2026-02-24T07:58:49.253 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/214185656' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:58:49.253 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2656796153' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/214185656' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:58:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:49 trial016 ceph-mon[39544]: osdmap e111: 4 total, 4 up, 4 in 2026-02-24T07:58:50.432 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:50.492 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2026-02-24T07:58:50.492 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T07:58:50.493 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:50.495 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T07:58:50.496 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T07:58:50.554 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:50.557 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T07:58:50.557 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T07:58:50.557 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_141091 2026-02-24T07:58:50.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:58:50.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T07:58:50.736 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:50.817 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:50.814+0000 7f2904f10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:50.817 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:50.814+0000 7f2904f10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:50.833 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:50.833 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:50.851 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:50.851 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:50.861 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:50.860+0000 7f9e50790640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:50.862 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:50.860+0000 7f9e50790640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:50.934 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:50.934 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:50.949 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:50.949 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:51.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:50 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T07:58:51.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:50 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T07:58:51.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:50 trial016 ceph-mon[39544]: pgmap v447: 17 pgs: 10 creating+peering, 6 unknown, 1 active+clean; 577 KiB data, 5.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:58:51.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:50 trial016 ceph-mon[39544]: osdmap e112: 4 total, 4 up, 4 in 2026-02-24T07:58:51.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1086831503' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:51.014 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:51.015 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:51.063 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2026-02-24T07:58:49.942618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":33,"acting":33,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5653068,"kb_used_data":4476,"kb_used_omap":42,"kb_used_meta":5648469,"kb_avail":2930359732,"statfs":{"total":3006477107200,"available":3000688365568,"internally_reserved":0,"allocated":4583424,"data_stored":2780764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43878,"internal_metadata":5784032410},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,11,14],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-765034520,"num_objects":-11675,"num_object_clones":0,"num_object_copies":-35025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11675,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-846860,"num_write_kb":-6105121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.103172"},"pg_stats":[{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940255+0000","last_change":"2026-02-24T07:58:47.940255+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940255+0000","last_undegraded":"2026-02-24T07:58:47.940255+0000","last_fullsized":"2026-02-24T07:58:47.940255+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940542+0000","last_change":"2026-02-24T07:58:47.940542+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940542+0000","last_undegraded":"2026-02-24T07:58:47.940542+0000","last_fullsized":"2026-02-24T07:58:47.940542+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940234+0000","last_change":"2026-02-24T07:58:47.940234+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940234+0000","last_undegraded":"2026-02-24T07:58:47.940234+0000","last_fullsized":"2026-02-24T07:58:47.940234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940232+0000","last_change":"2026-02-24T07:58:47.940232+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940232+0000","last_undegraded":"2026-02-24T07:58:47.940232+0000","last_fullsized":"2026-02-24T07:58:47.940232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940324+0000","last_change":"2026-02-24T07:58:47.940324+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940324+0000","last_undegraded":"2026-02-24T07:58:47.940324+0000","last_fullsized":"2026-02-24T07:58:47.940324+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940393+0000","last_change":"2026-02-24T07:58:47.940393+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940393+0000","last_undegraded":"2026-02-24T07:58:47.940393+0000","last_fullsized":"2026-02-24T07:58:47.940393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940235+0000","last_change":"2026-02-24T07:58:47.940235+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940235+0000","last_undegraded":"2026-02-24T07:58:47.940235+0000","last_fullsized":"2026-02-24T07:58:47.940235+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940323+0000","last_change":"2026-02-24T07:58:47.940323+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940323+0000","last_undegraded":"2026-02-24T07:58:47.940323+0000","last_fullsized":"2026-02-24T07:58:47.940323+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940398+0000","last_change":"2026-02-24T07:58:47.940398+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940398+0000","last_undegraded":"2026-02-24T07:58:47.940398+0000","last_fullsized":"2026-02-24T07:58:47.940398+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2026-02-24T07:58:47.940253+0000","last_change":"2026-02-24T07:58:47.940253+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.940253+0000","last_undegraded":"2026-02-24T07:58:47.940253+0000","last_fullsized":"2026-02-24T07:58:47.940253+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:58:47.932480+0000","last_change":"2026-02-24T07:58:47.932480+0000","last_active":"2026-02-24T07:58:47.932480+0000","last_peered":"2026-02-24T07:58:47.932480+0000","last_clean":"2026-02-24T07:58:47.932480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:58:47.932480+0000","last_undegraded":"2026-02-24T07:58:47.932480+0000","last_fullsized":"2026-02-24T07:58:47.932480+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":425,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-24T07:58:46.932230+0000","last_change":"2026-02-24T07:57:32.451744+0000","last_active":"2026-02-24T07:58:46.932230+0000","last_peered":"2026-02-24T07:58:46.932230+0000","last_clean":"2026-02-24T07:58:46.932230+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:58:46.932230+0000","last_undegraded":"2026-02-24T07:58:46.932230+0000","last_fullsized":"2026-02-24T07:58:46.932230+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:57:32.451696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:57:32.451696+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:58:46.991346+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7424,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215251,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1250308,"kb_used_data":1264,"kb_used_omap":10,"kb_used_meta":1249013,"kb_avail":732752892,"statfs":{"total":751619276800,"available":750338961408,"internally_reserved":0,"allocated":1294336,"data_stored":842783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10879,"internal_metadata":1278989697},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1604484,"kb_used_data":1264,"kb_used_omap":10,"kb_used_meta":1603189,"kb_avail":732398716,"statfs":{"total":751619276800,"available":749976285184,"internally_reserved":0,"allocated":1294336,"data_stored":842783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10779,"internal_metadata":1641666021},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1120384,"kb_used_data":684,"kb_used_omap":10,"kb_used_meta":1119669,"kb_avail":732882816,"statfs":{"total":751619276800,"available":750472003584,"internally_reserved":0,"allocated":700416,"data_stored":252415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10775,"internal_metadata":1146541545},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,11,14],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705817,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1677892,"kb_used_data":1264,"kb_used_omap":11,"kb_used_meta":1676596,"kb_avail":732325308,"statfs":{"total":751619276800,"available":749901115392,"internally_reserved":0,"allocated":1294336,"data_stored":842783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11445,"internal_metadata":1716835147},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7424,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:51.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 9606 9478 74.0402 74.0469 0.00415677 0.0133809 2026-02-24T07:58:52.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:51 trial016 ceph-mon[39544]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:52.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 128 19339 19211 75.0366 76.0391 0.00483575 0.013265 2026-02-24T07:58:53.005 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:53.159 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:53.214 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:52 trial016 ceph-mon[39544]: pgmap v449: 17 pgs: 10 creating+peering, 6 unknown, 1 active+clean; 577 KiB data, 5.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:58:53.291 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:53.289+0000 7fa747a8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:53.291 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:53.290+0000 7fa747a8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:53.309 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:53.310 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:53.324 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:53.324 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:53.344 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:53.344 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:53.360 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:53.361 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:53.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 29444 29317 76.34 78.9531 0.0247289 0.013051 2026-02-24T07:58:54.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1408676806' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:54.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 127 39901 39774 77.6773 81.6953 0.0128863 0.0128496 2026-02-24T07:58:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:54 trial016 ceph-mon[39544]: pgmap v450: 17 pgs: 17 active+clean; 185 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.93k op/s 2026-02-24T07:58:55.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:58:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:58:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:58:55.408 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:58:55.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 50024 49896 77.9563 79.0781 0.00803628 0.0128122 2026-02-24T07:58:55.561 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:55.685+0000 7f015ee7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:55.685+0000 7f015ee7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:55.706 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:55.706 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:55.719 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:55.719 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:55.753 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:55.753 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:55.768 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:55.768 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:56.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:58:56.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:58:56.065 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T07:58:56.065 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:58:56.224 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:56.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4173512942' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:56.351 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:56.348+0000 7fcdab0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:56.351 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:56.349+0000 7fcdab0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:56.510 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:58:56.511 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:58:56.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 127 60177 60050 78.1839 79.3281 0.0111596 0.0127668 2026-02-24T07:58:56.559 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2026-02-24T07:58:55.840664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":193913376,"num_objects":2953,"num_object_clones":0,"num_object_copies":8859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2953,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":23734,"num_write_kb":190942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6236796,"kb_used_data":462380,"kb_used_omap":50,"kb_used_meta":5774285,"kb_avail":2929776004,"statfs":{"total":3006477107200,"available":3000090628096,"internally_reserved":0,"allocated":473477120,"data_stored":471584136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51390,"internal_metadata":5912868674},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[25,18,32,25,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":193323008,"num_objects":2951,"num_object_clones":0,"num_object_copies":8853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23599,"num_write_kb":188792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.904165"},"pg_stats":[{"pgid":"8.f","version":"112'1424","reported_seq":1438,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.898698+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:58:52.898698+0000","last_peered":"2026-02-24T07:58:52.898698+0000","last_clean":"2026-02-24T07:58:52.898698+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:58:52.898698+0000","last_undegraded":"2026-02-24T07:58:52.898698+0000","last_fullsized":"2026-02-24T07:58:52.898698+0000","mapping_epoch":110,"log_start":"112'1415","ondisk_log_start":"112'1415","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":1415,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1424,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"112'1336","reported_seq":1344,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.951918+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:58:52.951918+0000","last_peered":"2026-02-24T07:58:52.951918+0000","last_clean":"2026-02-24T07:58:52.951918+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:58:52.951918+0000","last_undegraded":"2026-02-24T07:58:52.951918+0000","last_fullsized":"2026-02-24T07:58:52.951918+0000","mapping_epoch":110,"log_start":"112'1328","ondisk_log_start":"112'1328","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1328,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"112'1360","reported_seq":1366,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.866734+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:58:52.866734+0000","last_peered":"2026-02-24T07:58:52.866734+0000","last_clean":"2026-02-24T07:58:52.866734+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:58:52.866734+0000","last_undegraded":"2026-02-24T07:58:52.866734+0000","last_fullsized":"2026-02-24T07:58:52.866734+0000","mapping_epoch":110,"log_start":"112'1352","ondisk_log_start":"112'1352","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1352,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"112'1520","reported_seq":1523,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.952035+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:58:52.952035+0000","last_peered":"2026-02-24T07:58:52.952035+0000","last_clean":"2026-02-24T07:58:52.952035+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:58:52.952035+0000","last_undegraded":"2026-02-24T07:58:52.952035+0000","last_fullsized":"2026-02-24T07:58:52.952035+0000","mapping_epoch":110,"log_start":"112'1506","ondisk_log_start":"112'1506","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1506,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"112'1512","reported_seq":1526,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.932474+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:58:52.932474+0000","last_peered":"2026-02-24T07:58:52.932474+0000","last_clean":"2026-02-24T07:58:52.932474+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:58:52.932474+0000","last_undegraded":"2026-02-24T07:58:52.932474+0000","last_fullsized":"2026-02-24T07:58:52.932474+0000","mapping_epoch":110,"log_start":"112'1488","ondisk_log_start":"112'1488","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1488,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1512,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"112'1578","reported_seq":1571,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:53.092367+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:58:53.092367+0000","last_peered":"2026-02-24T07:58:53.092367+0000","last_clean":"2026-02-24T07:58:53.092367+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:58:53.092367+0000","last_undegraded":"2026-02-24T07:58:53.092367+0000","last_fullsized":"2026-02-24T07:58:53.092367+0000","mapping_epoch":110,"log_start":"112'1556","ondisk_log_start":"112'1556","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1556,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12926976,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1578,"num_write_kb":12624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"112'1328","reported_seq":1342,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.864511+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:58:52.864511+0000","last_peered":"2026-02-24T07:58:52.864511+0000","last_clean":"2026-02-24T07:58:52.864511+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:58:52.864511+0000","last_undegraded":"2026-02-24T07:58:52.864511+0000","last_fullsized":"2026-02-24T07:58:52.864511+0000","mapping_epoch":110,"log_start":"112'1320","ondisk_log_start":"112'1320","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1320,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"112'1549","reported_seq":1555,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:53.093363+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:58:53.093363+0000","last_peered":"2026-02-24T07:58:53.093363+0000","last_clean":"2026-02-24T07:58:53.093363+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:58:53.093363+0000","last_undegraded":"2026-02-24T07:58:53.093363+0000","last_fullsized":"2026-02-24T07:58:53.093363+0000","mapping_epoch":110,"log_start":"112'1540","ondisk_log_start":"112'1540","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":1540,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12689408,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1549,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"112'1576","reported_seq":1590,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.960299+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:58:52.960299+0000","last_peered":"2026-02-24T07:58:52.960299+0000","last_clean":"2026-02-24T07:58:52.960299+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:58:52.960299+0000","last_undegraded":"2026-02-24T07:58:52.960299+0000","last_fullsized":"2026-02-24T07:58:52.960299+0000","mapping_epoch":110,"log_start":"112'1568","ondisk_log_start":"112'1568","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1568,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"112'1448","reported_seq":1462,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.871506+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:58:52.871506+0000","last_peered":"2026-02-24T07:58:52.871506+0000","last_clean":"2026-02-24T07:58:52.871506+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:58:52.871506+0000","last_undegraded":"2026-02-24T07:58:52.871506+0000","last_fullsized":"2026-02-24T07:58:52.871506+0000","mapping_epoch":110,"log_start":"112'1440","ondisk_log_start":"112'1440","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1440,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1448,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"112'1400","reported_seq":1414,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.870706+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:58:52.870706+0000","last_peered":"2026-02-24T07:58:52.870706+0000","last_clean":"2026-02-24T07:58:52.870706+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:58:52.870706+0000","last_undegraded":"2026-02-24T07:58:52.870706+0000","last_fullsized":"2026-02-24T07:58:52.870706+0000","mapping_epoch":110,"log_start":"112'1396","ondisk_log_start":"112'1396","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":1396,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"112'1576","reported_seq":1590,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:53.079422+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:58:53.079422+0000","last_peered":"2026-02-24T07:58:53.079422+0000","last_clean":"2026-02-24T07:58:53.079422+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:58:53.079422+0000","last_undegraded":"2026-02-24T07:58:53.079422+0000","last_fullsized":"2026-02-24T07:58:53.079422+0000","mapping_epoch":110,"log_start":"112'1572","ondisk_log_start":"112'1572","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":1572,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"112'1272","reported_seq":1286,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.865054+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:58:52.865054+0000","last_peered":"2026-02-24T07:58:52.865054+0000","last_clean":"2026-02-24T07:58:52.865054+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:58:52.865054+0000","last_undegraded":"2026-02-24T07:58:52.865054+0000","last_fullsized":"2026-02-24T07:58:52.865054+0000","mapping_epoch":110,"log_start":"112'1264","ondisk_log_start":"112'1264","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1264,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"112'1592","reported_seq":1606,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:53.091751+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:58:53.091751+0000","last_peered":"2026-02-24T07:58:53.091751+0000","last_clean":"2026-02-24T07:58:53.091751+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:58:53.091751+0000","last_undegraded":"2026-02-24T07:58:53.091751+0000","last_fullsized":"2026-02-24T07:58:53.091751+0000","mapping_epoch":110,"log_start":"112'1578","ondisk_log_start":"112'1578","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1578,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"112'1632","reported_seq":1646,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:53.087528+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:58:53.087528+0000","last_peered":"2026-02-24T07:58:53.087528+0000","last_clean":"2026-02-24T07:58:53.087528+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:58:53.087528+0000","last_undegraded":"2026-02-24T07:58:53.087528+0000","last_fullsized":"2026-02-24T07:58:53.087528+0000","mapping_epoch":110,"log_start":"112'1626","ondisk_log_start":"112'1626","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":1626,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"112'1496","reported_seq":1502,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:52.826273+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:58:52.826273+0000","last_peered":"2026-02-24T07:58:52.826273+0000","last_clean":"2026-02-24T07:58:52.826273+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:58:52.826273+0000","last_undegraded":"2026-02-24T07:58:52.826273+0000","last_fullsized":"2026-02-24T07:58:52.826273+0000","mapping_epoch":110,"log_start":"112'1488","ondisk_log_start":"112'1488","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":1488,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":439,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T07:58:50.056647+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:58:50.056647+0000","last_peered":"2026-02-24T07:58:50.056647+0000","last_clean":"2026-02-24T07:58:50.056647+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:58:50.056647+0000","last_undegraded":"2026-02-24T07:58:50.056647+0000","last_fullsized":"2026-02-24T07:58:50.056647+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":193323008,"num_objects":2951,"num_object_clones":0,"num_object_copies":8853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23599,"num_write_kb":188792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":572964864,"data_stored":572964864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8246,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1320640,"kb_used_data":108204,"kb_used_omap":12,"kb_used_meta":1212403,"kb_avail":732682560,"statfs":{"total":751619276800,"available":750266941440,"internally_reserved":0,"allocated":110800896,"data_stored":110326762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12523,"internal_metadata":1241501461},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1754296,"kb_used_data":133028,"kb_used_omap":12,"kb_used_meta":1621235,"kb_avail":732248904,"statfs":{"total":751619276800,"available":749822877696,"internally_reserved":0,"allocated":136220672,"data_stored":135746538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12735,"internal_metadata":1660145217},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,9,15,16,9],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1314444,"kb_used_data":122552,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":732688756,"statfs":{"total":751619276800,"available":750273286144,"internally_reserved":0,"allocated":125493248,"data_stored":125022666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12731,"internal_metadata":1220464197},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,9],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705818,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1847416,"kb_used_data":98596,"kb_used_omap":13,"kb_used_meta":1748786,"kb_avail":732155784,"statfs":{"total":751619276800,"available":749727522816,"internally_reserved":0,"allocated":100962304,"data_stored":100488170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13401,"internal_metadata":1790757799},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,9,17],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8246,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":154763264,"data_stored":154763264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":140664832,"data_stored":140664832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139976704,"data_stored":139976704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":137560064,"data_stored":137560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:58:56.560 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:58:56.560 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 261 2026-02-24T07:58:56.711 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:56.854 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:56.852+0000 7fd7fbe56640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:56.855 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:56.852+0000 7fd7fbe56640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:57.005 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:58:57.028 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:56 trial016 ceph-mon[39544]: pgmap v451: 17 pgs: 17 active+clean; 185 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.98k op/s 2026-02-24T07:58:57.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:58:57.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 128 69928 69800 77.8957 76.1719 0.00448933 0.0128154 2026-02-24T07:58:57.815 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:58:57.963 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:58:58.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:58.086+0000 7f6b3cb13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:58.089 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:58:58.086+0000 7f6b3cb13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:58:58.104 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:58:58.104 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:58:58.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:57 trial016 ceph-mon[39544]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:58:58.105 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/841262414' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "261"} : dispatch 2026-02-24T07:58:58.119 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:58:58.119 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:58:58.132 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:58:58.132 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:58:58.146 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:58:58.147 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:58:58.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 127 79176 79049 77.1902 72.2578 0.00984161 0.0129376 2026-02-24T07:58:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:58 trial016 ceph-mon[39544]: pgmap v452: 17 pgs: 17 active+clean; 185 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.65k op/s 2026-02-24T07:58:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/872095563' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:58:59.558 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 88693 88565 76.8733 74.3438 0.00742749 0.0129981 2026-02-24T07:59:00.299 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:58:59 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:59:00.453 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:00.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 127 98171 98044 76.5909 74.0547 0.0200729 0.0130417 2026-02-24T07:59:00.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:00.576+0000 7f089dc99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:00.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:00.577+0000 7f089dc99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:00.596 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:00.596 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:00.611 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:00.611 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:00.632 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:00.632 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:00.648 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:00.648 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: pgmap v453: 17 pgs: 17 active+clean; 579 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.40k op/s 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:59:01.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/67052424' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:01.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 107532 107404 76.2753 73.125 0.0117688 0.0130989 2026-02-24T07:59:02.050 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:02.050 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:02.051 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:59:02.051 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:59:02.203 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:02.229 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:01 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:59:02.229 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:01 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:59:02.329 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.326+0000 7f00a6ade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:02.329 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.327+0000 7f00a6ade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:02.350 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:02.350 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:02.350 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:02.350 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:02.350 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:02.351 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:02.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:02.387 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:02.387 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:59:02.539 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:02.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 117335 117207 76.3007 76.5859 0.0222561 0.0130946 2026-02-24T07:59:02.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.672+0000 7fb4ab336640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:02.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.673+0000 7fb4ab336640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:02.703 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:02.704 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:02.704 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:02.704 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:02.704 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:02.744 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:02.745 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:02.745 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:59:02.864 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:02.935 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:02.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.993+0000 7f1038010640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:02.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:02.993+0000 7f1038010640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:03.014 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:03.015 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:03.035 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:03.035 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:03.066 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:03.064+0000 7f2fcf973640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:03.066 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:03.064+0000 7f2fcf973640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:03.070 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:03.071 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:03.085 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:03.085 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:03.090 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:03.091 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:03.126 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:03.126 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:03.126 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:59:03.151 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:02 trial016 ceph-mon[39544]: pgmap v454: 17 pgs: 17 active+clean; 579 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.22k op/s 2026-02-24T07:59:03.276 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:03.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 128 126146 126018 75.7261 68.8359 0.00199395 0.0131676 2026-02-24T07:59:03.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:03.639+0000 7f490c22a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:03.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:03.640+0000 7f490c22a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:03.662 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:04.258 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:03 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4238448389' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:04.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:04.285 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:04.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 127 133404 133277 74.3676 56.7109 0.00281066 0.0134376 2026-02-24T07:59:05.132 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:05.286 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:04 trial016 ceph-mon[39544]: pgmap v455: 17 pgs: 17 active+clean; 947 MiB data, 8.4 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.09k op/s 2026-02-24T07:59:05.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:05.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 128 142199 142071 73.9897 68.7031 0.00769622 0.0134791 2026-02-24T07:59:05.716 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:05.656+0000 7f5d81dd6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:05.716 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:05.656+0000 7f5d81dd6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:05.717 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:05.717 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:05.717 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:05.717 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:05.730 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:05.731 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:05.743 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:05.743 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:06.246 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/982322084' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:06.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 149450 149322 72.9056 56.6484 0.00783102 0.01371 2026-02-24T07:59:07.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:06 trial016 ceph-mon[39544]: pgmap v456: 17 pgs: 17 active+clean; 947 MiB data, 8.4 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.12k op/s 2026-02-24T07:59:07.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 159358 159230 73.17 77.4062 0.016987 0.0136582 2026-02-24T07:59:08.280 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:08.438 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:08.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 128 168604 168476 73.1177 72.2344 0.00393294 0.0136629 2026-02-24T07:59:08.740 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:08.717+0000 7f032338c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:08.740 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:08.741 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:08.717+0000 7f032338c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:08.741 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:08.753 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:08.753 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:08.772 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:08.772 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:08.786 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:08.786 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:09.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:09.286 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:59:09.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:08 trial016 ceph-mon[39544]: pgmap v457: 17 pgs: 17 active+clean; 947 MiB data, 8.4 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.12k op/s 2026-02-24T07:59:09.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4246705375' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:09.439 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:09.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 128 175477 175349 72.0952 53.6953 0.00418681 0.0138431 2026-02-24T07:59:09.881 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:09.847+0000 7f352ab0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:09.882 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:09.848+0000 7f352ab0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:10.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:59:10.558624+0000 min lat: 0.000664716 max lat: 0.109183 avg lat: 0.0138822 2026-02-24T07:59:10.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:59:10.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 128 184408 184280 71.9789 69.7734 0.0016903 0.0138822 2026-02-24T07:59:10.971 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:59:11.021 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:59:11.211 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:11.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:10 trial016 ceph-mon[39544]: pgmap v458: 17 pgs: 17 active+clean; 1.2 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s wr, 11.64k op/s 2026-02-24T07:59:11.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2075707978' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:59:11.338 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:11.335+0000 7f5e06b81640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:11.338 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:11.336+0000 7f5e06b81640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:11.400 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:11.551 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:11.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 193775 193647 72.0357 73.1797 0.00344405 0.0138576 2026-02-24T07:59:11.683 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:11.680+0000 7fcecb78c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:11.683 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:11.680+0000 7fcecb78c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:11.699 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:11.700 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:11.715 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:11.716 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:11.732 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:11.733 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:11.746 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:11.746 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:11.972 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:59:12.020 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:59:12.174 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:12.226 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2075707978' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:59:12.226 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:11 trial016 ceph-mon[39544]: osdmap e113: 4 total, 4 up, 4 in 2026-02-24T07:59:12.226 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1522147488' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:59:12.226 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/344860577' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:12.305 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:12.303+0000 7fa55c2a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:12.305 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:12.303+0000 7fa55c2a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:12.559 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 128 203707 203579 72.2881 77.5938 0.00636443 0.0138296 2026-02-24T07:59:12.975 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:59:13.027 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:59:13.182 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:13.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:12 trial016 ceph-mon[39544]: pgmap v460: 17 pgs: 17 active+clean; 1.2 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 8.93k op/s 2026-02-24T07:59:13.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1522147488' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:59:13.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:12 trial016 ceph-mon[39544]: osdmap e114: 4 total, 4 up, 4 in 2026-02-24T07:59:13.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:12 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1758638765' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:59:13.306 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:13.304+0000 7f85a0e92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:13.307 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:13.304+0000 7f85a0e92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:13.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 127 213367 213240 72.4264 75.4766 0.0122691 0.0138027 2026-02-24T07:59:13.796 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:13.947 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:13.980 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:59:14.036 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:59:14.036 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:14.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1758638765' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:59:14.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:13 trial016 ceph-mon[39544]: osdmap e115: 4 total, 4 up, 4 in 2026-02-24T07:59:14.083 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3839672785' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:59:14.083 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.080+0000 7fe644c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.084 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.081+0000 7fe644c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.098 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:14.098 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:14.114 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:14.114 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:14.140 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:14.140 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:14.154 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:14.154 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:14.194 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:14.331 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.328+0000 7f1715ed6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.331 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.329+0000 7f1715ed6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.484 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:14.485 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:14.538 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2026-02-24T07:59:13.978974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1703526944,"num_objects":25988,"num_object_clones":0,"num_object_copies":77964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25988,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":208013,"num_write_kb":1665174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10508340,"kb_used_data":4894628,"kb_used_omap":54,"kb_used_meta":5613577,"kb_avail":2925504460,"statfs":{"total":3006477107200,"available":2995716567040,"internally_reserved":0,"allocated":5012099072,"data_stored":5010143056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56058,"internal_metadata":5748303110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,13,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":364863488,"num_objects":5568,"num_object_clones":0,"num_object_copies":16704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44539,"num_write_kb":356312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136327"},"pg_stats":[{"pgid":"8.f","version":"114'12489","reported_seq":12506,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968682+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:12.968682+0000","last_peered":"2026-02-24T07:59:12.968682+0000","last_clean":"2026-02-24T07:59:12.968682+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:12.968682+0000","last_undegraded":"2026-02-24T07:59:12.968682+0000","last_fullsized":"2026-02-24T07:59:12.968682+0000","mapping_epoch":110,"log_start":"114'12464","ondisk_log_start":"114'12464","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102309888,"num_objects":1562,"num_object_clones":0,"num_object_copies":4686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12489,"num_write_kb":99912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"114'12896","reported_seq":12914,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968699+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:12.968699+0000","last_peered":"2026-02-24T07:59:12.968699+0000","last_clean":"2026-02-24T07:59:12.968699+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:12.968699+0000","last_undegraded":"2026-02-24T07:59:12.968699+0000","last_fullsized":"2026-02-24T07:59:12.968699+0000","mapping_epoch":110,"log_start":"114'12856","ondisk_log_start":"114'12856","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105644032,"num_objects":1612,"num_object_clones":0,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12896,"num_write_kb":103168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"114'12560","reported_seq":12578,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872742+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:12.872742+0000","last_peered":"2026-02-24T07:59:12.872742+0000","last_clean":"2026-02-24T07:59:12.872742+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:12.872742+0000","last_undegraded":"2026-02-24T07:59:12.872742+0000","last_fullsized":"2026-02-24T07:59:12.872742+0000","mapping_epoch":110,"log_start":"114'12552","ondisk_log_start":"114'12552","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102891520,"num_objects":1570,"num_object_clones":0,"num_object_copies":4710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12560,"num_write_kb":100480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"114'12968","reported_seq":12986,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.925722+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:12.925722+0000","last_peered":"2026-02-24T07:59:12.925722+0000","last_clean":"2026-02-24T07:59:12.925722+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:12.925722+0000","last_undegraded":"2026-02-24T07:59:12.925722+0000","last_fullsized":"2026-02-24T07:59:12.925722+0000","mapping_epoch":110,"log_start":"114'12960","ondisk_log_start":"114'12960","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106233856,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12968,"num_write_kb":103744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.945267+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:12.945267+0000","last_peered":"2026-02-24T07:59:12.945267+0000","last_clean":"2026-02-24T07:59:12.945267+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:12.945267+0000","last_undegraded":"2026-02-24T07:59:12.945267+0000","last_fullsized":"2026-02-24T07:59:12.945267+0000","mapping_epoch":110,"log_start":"114'12824","ondisk_log_start":"114'12824","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"115'12984","reported_seq":13004,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.097753+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:13.097753+0000","last_peered":"2026-02-24T07:59:13.097753+0000","last_clean":"2026-02-24T07:59:13.097753+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:13.097753+0000","last_undegraded":"2026-02-24T07:59:13.097753+0000","last_fullsized":"2026-02-24T07:59:13.097753+0000","mapping_epoch":110,"log_start":"115'12976","ondisk_log_start":"115'12976","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106364928,"num_objects":1623,"num_object_clones":0,"num_object_copies":4869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12984,"num_write_kb":103872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"114'12752","reported_seq":12770,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.854328+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:12.854328+0000","last_peered":"2026-02-24T07:59:12.854328+0000","last_clean":"2026-02-24T07:59:12.854328+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:12.854328+0000","last_undegraded":"2026-02-24T07:59:12.854328+0000","last_fullsized":"2026-02-24T07:59:12.854328+0000","mapping_epoch":110,"log_start":"114'12744","ondisk_log_start":"114'12744","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104464384,"num_objects":1594,"num_object_clones":0,"num_object_copies":4782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12752,"num_write_kb":102016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"115'13181","reported_seq":13196,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.098222+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:13.098222+0000","last_peered":"2026-02-24T07:59:13.098222+0000","last_clean":"2026-02-24T07:59:13.098222+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:13.098222+0000","last_undegraded":"2026-02-24T07:59:13.098222+0000","last_fullsized":"2026-02-24T07:59:13.098222+0000","mapping_epoch":110,"log_start":"115'13172","ondisk_log_start":"115'13172","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107978752,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13181,"num_write_kb":105448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"114'13384","reported_seq":13402,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.961367+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:12.961367+0000","last_peered":"2026-02-24T07:59:12.961367+0000","last_clean":"2026-02-24T07:59:12.961367+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:12.961367+0000","last_undegraded":"2026-02-24T07:59:12.961367+0000","last_fullsized":"2026-02-24T07:59:12.961367+0000","mapping_epoch":110,"log_start":"114'13376","ondisk_log_start":"114'13376","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109641728,"num_objects":1673,"num_object_clones":0,"num_object_copies":5019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13384,"num_write_kb":107072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"114'12848","reported_seq":12866,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.874959+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:12.874959+0000","last_peered":"2026-02-24T07:59:12.874959+0000","last_clean":"2026-02-24T07:59:12.874959+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:12.874959+0000","last_undegraded":"2026-02-24T07:59:12.874959+0000","last_fullsized":"2026-02-24T07:59:12.874959+0000","mapping_epoch":110,"log_start":"114'12840","ondisk_log_start":"114'12840","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105250816,"num_objects":1606,"num_object_clones":0,"num_object_copies":4818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12848,"num_write_kb":102784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872595+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:12.872595+0000","last_peered":"2026-02-24T07:59:12.872595+0000","last_clean":"2026-02-24T07:59:12.872595+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:12.872595+0000","last_undegraded":"2026-02-24T07:59:12.872595+0000","last_fullsized":"2026-02-24T07:59:12.872595+0000","mapping_epoch":110,"log_start":"114'12827","ondisk_log_start":"114'12827","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"115'13480","reported_seq":13486,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.101467+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:13.101467+0000","last_peered":"2026-02-24T07:59:13.101467+0000","last_clean":"2026-02-24T07:59:13.101467+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:13.101467+0000","last_undegraded":"2026-02-24T07:59:13.101467+0000","last_fullsized":"2026-02-24T07:59:13.101467+0000","mapping_epoch":110,"log_start":"115'13456","ondisk_log_start":"115'13456","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13480,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"114'13368","reported_seq":13386,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872340+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:12.872340+0000","last_peered":"2026-02-24T07:59:12.872340+0000","last_clean":"2026-02-24T07:59:12.872340+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:12.872340+0000","last_undegraded":"2026-02-24T07:59:12.872340+0000","last_fullsized":"2026-02-24T07:59:12.872340+0000","mapping_epoch":110,"log_start":"114'13360","ondisk_log_start":"114'13360","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109510656,"num_objects":1671,"num_object_clones":0,"num_object_copies":5013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13368,"num_write_kb":106944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"115'12592","reported_seq":12581,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100536+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:13.100536+0000","last_peered":"2026-02-24T07:59:13.100536+0000","last_clean":"2026-02-24T07:59:13.100536+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:13.100536+0000","last_undegraded":"2026-02-24T07:59:13.100536+0000","last_fullsized":"2026-02-24T07:59:13.100536+0000","mapping_epoch":110,"log_start":"115'12556","ondisk_log_start":"115'12556","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":3000,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103153664,"num_objects":1574,"num_object_clones":0,"num_object_copies":4722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12592,"num_write_kb":100736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"115'13176","reported_seq":13195,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100893+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:13.100893+0000","last_peered":"2026-02-24T07:59:13.100893+0000","last_clean":"2026-02-24T07:59:13.100893+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:13.100893+0000","last_undegraded":"2026-02-24T07:59:13.100893+0000","last_fullsized":"2026-02-24T07:59:13.100893+0000","mapping_epoch":110,"log_start":"115'13161","ondisk_log_start":"115'13161","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"114'13536","reported_seq":13554,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.865332+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:12.865332+0000","last_peered":"2026-02-24T07:59:12.865332+0000","last_clean":"2026-02-24T07:59:12.865332+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:12.865332+0000","last_undegraded":"2026-02-24T07:59:12.865332+0000","last_fullsized":"2026-02-24T07:59:12.865332+0000","mapping_epoch":110,"log_start":"114'13529","ondisk_log_start":"114'13529","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110886912,"num_objects":1692,"num_object_clones":0,"num_object_copies":5076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13536,"num_write_kb":108288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":443,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:11.975235+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:11.975235+0000","last_peered":"2026-02-24T07:59:11.975235+0000","last_clean":"2026-02-24T07:59:11.975235+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:11.975235+0000","last_undegraded":"2026-02-24T07:59:11.975235+0000","last_fullsized":"2026-02-24T07:59:11.975235+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1702936576,"num_objects":25986,"num_object_clones":0,"num_object_copies":77958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207878,"num_write_kb":1663024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5100560384,"data_stored":5100560384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215256,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2789504,"kb_used_data":1215788,"kb_used_omap":14,"kb_used_meta":1573681,"kb_avail":731213696,"statfs":{"total":751619276800,"available":748762824704,"internally_reserved":0,"allocated":1244966912,"data_stored":1244477020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14855,"internal_metadata":1611449849},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444185,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2759608,"kb_used_data":1244964,"kb_used_omap":14,"kb_used_meta":1514609,"kb_avail":731243592,"statfs":{"total":751619276800,"available":748793438208,"internally_reserved":0,"allocated":1274843136,"data_stored":1274353244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14691,"internal_metadata":1550960285},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2626396,"kb_used_data":1128008,"kb_used_omap":13,"kb_used_meta":1498354,"kb_avail":731376804,"statfs":{"total":751619276800,"available":748929847296,"internally_reserved":0,"allocated":1155080192,"data_stored":1154593852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14035,"internal_metadata":1534314797},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,5,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705822,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2332832,"kb_used_data":1305868,"kb_used_omap":12,"kb_used_meta":1026931,"kb_avail":731670368,"statfs":{"total":751619276800,"available":749230456832,"internally_reserved":0,"allocated":1337208832,"data_stored":1336718940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12477,"internal_metadata":1051578179},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1378516992,"data_stored":1378516992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1175216128,"data_stored":1175216128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275904000,"data_stored":1275904000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1270923264,"data_stored":1270923264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:14.540 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:14.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 127 223157 223030 72.5952 76.4844 0.0238539 0.0137687 2026-02-24T07:59:14.699 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:14.830 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.827+0000 7f961e95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.830 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:14.828+0000 7f961e95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:14.991 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:14.993 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:15.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:14 trial016 ceph-mon[39544]: pgmap v463: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 113 MiB/s wr, 14.46k op/s 2026-02-24T07:59:15.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3839672785' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:59:15.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:14 trial016 ceph-mon[39544]: osdmap e116: 4 total, 4 up, 4 in 2026-02-24T07:59:15.003 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:14 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4101746433' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:15.003 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:15.047 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2026-02-24T07:59:13.978974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1703526944,"num_objects":25988,"num_object_clones":0,"num_object_copies":77964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25988,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":208013,"num_write_kb":1665174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10508340,"kb_used_data":4894628,"kb_used_omap":54,"kb_used_meta":5613577,"kb_avail":2925504460,"statfs":{"total":3006477107200,"available":2995716567040,"internally_reserved":0,"allocated":5012099072,"data_stored":5010143056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56058,"internal_metadata":5748303110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,13,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":364863488,"num_objects":5568,"num_object_clones":0,"num_object_copies":16704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44539,"num_write_kb":356312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136327"},"pg_stats":[{"pgid":"8.f","version":"114'12489","reported_seq":12506,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968682+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:12.968682+0000","last_peered":"2026-02-24T07:59:12.968682+0000","last_clean":"2026-02-24T07:59:12.968682+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:12.968682+0000","last_undegraded":"2026-02-24T07:59:12.968682+0000","last_fullsized":"2026-02-24T07:59:12.968682+0000","mapping_epoch":110,"log_start":"114'12464","ondisk_log_start":"114'12464","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102309888,"num_objects":1562,"num_object_clones":0,"num_object_copies":4686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12489,"num_write_kb":99912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"114'12896","reported_seq":12914,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968699+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:12.968699+0000","last_peered":"2026-02-24T07:59:12.968699+0000","last_clean":"2026-02-24T07:59:12.968699+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:12.968699+0000","last_undegraded":"2026-02-24T07:59:12.968699+0000","last_fullsized":"2026-02-24T07:59:12.968699+0000","mapping_epoch":110,"log_start":"114'12856","ondisk_log_start":"114'12856","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105644032,"num_objects":1612,"num_object_clones":0,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12896,"num_write_kb":103168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"114'12560","reported_seq":12578,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872742+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:12.872742+0000","last_peered":"2026-02-24T07:59:12.872742+0000","last_clean":"2026-02-24T07:59:12.872742+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:12.872742+0000","last_undegraded":"2026-02-24T07:59:12.872742+0000","last_fullsized":"2026-02-24T07:59:12.872742+0000","mapping_epoch":110,"log_start":"114'12552","ondisk_log_start":"114'12552","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102891520,"num_objects":1570,"num_object_clones":0,"num_object_copies":4710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12560,"num_write_kb":100480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"114'12968","reported_seq":12986,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.925722+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:12.925722+0000","last_peered":"2026-02-24T07:59:12.925722+0000","last_clean":"2026-02-24T07:59:12.925722+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:12.925722+0000","last_undegraded":"2026-02-24T07:59:12.925722+0000","last_fullsized":"2026-02-24T07:59:12.925722+0000","mapping_epoch":110,"log_start":"114'12960","ondisk_log_start":"114'12960","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106233856,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12968,"num_write_kb":103744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.945267+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:12.945267+0000","last_peered":"2026-02-24T07:59:12.945267+0000","last_clean":"2026-02-24T07:59:12.945267+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:12.945267+0000","last_undegraded":"2026-02-24T07:59:12.945267+0000","last_fullsized":"2026-02-24T07:59:12.945267+0000","mapping_epoch":110,"log_start":"114'12824","ondisk_log_start":"114'12824","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"115'12984","reported_seq":13004,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.097753+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:13.097753+0000","last_peered":"2026-02-24T07:59:13.097753+0000","last_clean":"2026-02-24T07:59:13.097753+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:13.097753+0000","last_undegraded":"2026-02-24T07:59:13.097753+0000","last_fullsized":"2026-02-24T07:59:13.097753+0000","mapping_epoch":110,"log_start":"115'12976","ondisk_log_start":"115'12976","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106364928,"num_objects":1623,"num_object_clones":0,"num_object_copies":4869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12984,"num_write_kb":103872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"114'12752","reported_seq":12770,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.854328+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:12.854328+0000","last_peered":"2026-02-24T07:59:12.854328+0000","last_clean":"2026-02-24T07:59:12.854328+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:12.854328+0000","last_undegraded":"2026-02-24T07:59:12.854328+0000","last_fullsized":"2026-02-24T07:59:12.854328+0000","mapping_epoch":110,"log_start":"114'12744","ondisk_log_start":"114'12744","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104464384,"num_objects":1594,"num_object_clones":0,"num_object_copies":4782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12752,"num_write_kb":102016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"115'13181","reported_seq":13196,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.098222+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:13.098222+0000","last_peered":"2026-02-24T07:59:13.098222+0000","last_clean":"2026-02-24T07:59:13.098222+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:13.098222+0000","last_undegraded":"2026-02-24T07:59:13.098222+0000","last_fullsized":"2026-02-24T07:59:13.098222+0000","mapping_epoch":110,"log_start":"115'13172","ondisk_log_start":"115'13172","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107978752,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13181,"num_write_kb":105448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"114'13384","reported_seq":13402,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.961367+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:12.961367+0000","last_peered":"2026-02-24T07:59:12.961367+0000","last_clean":"2026-02-24T07:59:12.961367+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:12.961367+0000","last_undegraded":"2026-02-24T07:59:12.961367+0000","last_fullsized":"2026-02-24T07:59:12.961367+0000","mapping_epoch":110,"log_start":"114'13376","ondisk_log_start":"114'13376","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109641728,"num_objects":1673,"num_object_clones":0,"num_object_copies":5019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13384,"num_write_kb":107072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"114'12848","reported_seq":12866,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.874959+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:12.874959+0000","last_peered":"2026-02-24T07:59:12.874959+0000","last_clean":"2026-02-24T07:59:12.874959+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:12.874959+0000","last_undegraded":"2026-02-24T07:59:12.874959+0000","last_fullsized":"2026-02-24T07:59:12.874959+0000","mapping_epoch":110,"log_start":"114'12840","ondisk_log_start":"114'12840","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105250816,"num_objects":1606,"num_object_clones":0,"num_object_copies":4818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12848,"num_write_kb":102784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872595+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:12.872595+0000","last_peered":"2026-02-24T07:59:12.872595+0000","last_clean":"2026-02-24T07:59:12.872595+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:12.872595+0000","last_undegraded":"2026-02-24T07:59:12.872595+0000","last_fullsized":"2026-02-24T07:59:12.872595+0000","mapping_epoch":110,"log_start":"114'12827","ondisk_log_start":"114'12827","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"115'13480","reported_seq":13486,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.101467+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:13.101467+0000","last_peered":"2026-02-24T07:59:13.101467+0000","last_clean":"2026-02-24T07:59:13.101467+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:13.101467+0000","last_undegraded":"2026-02-24T07:59:13.101467+0000","last_fullsized":"2026-02-24T07:59:13.101467+0000","mapping_epoch":110,"log_start":"115'13456","ondisk_log_start":"115'13456","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13480,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"114'13368","reported_seq":13386,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872340+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:12.872340+0000","last_peered":"2026-02-24T07:59:12.872340+0000","last_clean":"2026-02-24T07:59:12.872340+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:12.872340+0000","last_undegraded":"2026-02-24T07:59:12.872340+0000","last_fullsized":"2026-02-24T07:59:12.872340+0000","mapping_epoch":110,"log_start":"114'13360","ondisk_log_start":"114'13360","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109510656,"num_objects":1671,"num_object_clones":0,"num_object_copies":5013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13368,"num_write_kb":106944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"115'12592","reported_seq":12581,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100536+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:13.100536+0000","last_peered":"2026-02-24T07:59:13.100536+0000","last_clean":"2026-02-24T07:59:13.100536+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:13.100536+0000","last_undegraded":"2026-02-24T07:59:13.100536+0000","last_fullsized":"2026-02-24T07:59:13.100536+0000","mapping_epoch":110,"log_start":"115'12556","ondisk_log_start":"115'12556","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":3000,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103153664,"num_objects":1574,"num_object_clones":0,"num_object_copies":4722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12592,"num_write_kb":100736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"115'13176","reported_seq":13195,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100893+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:13.100893+0000","last_peered":"2026-02-24T07:59:13.100893+0000","last_clean":"2026-02-24T07:59:13.100893+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:13.100893+0000","last_undegraded":"2026-02-24T07:59:13.100893+0000","last_fullsized":"2026-02-24T07:59:13.100893+0000","mapping_epoch":110,"log_start":"115'13161","ondisk_log_start":"115'13161","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"114'13536","reported_seq":13554,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.865332+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:12.865332+0000","last_peered":"2026-02-24T07:59:12.865332+0000","last_clean":"2026-02-24T07:59:12.865332+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:12.865332+0000","last_undegraded":"2026-02-24T07:59:12.865332+0000","last_fullsized":"2026-02-24T07:59:12.865332+0000","mapping_epoch":110,"log_start":"114'13529","ondisk_log_start":"114'13529","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110886912,"num_objects":1692,"num_object_clones":0,"num_object_copies":5076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13536,"num_write_kb":108288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":443,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:11.975235+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:11.975235+0000","last_peered":"2026-02-24T07:59:11.975235+0000","last_clean":"2026-02-24T07:59:11.975235+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:11.975235+0000","last_undegraded":"2026-02-24T07:59:11.975235+0000","last_fullsized":"2026-02-24T07:59:11.975235+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1702936576,"num_objects":25986,"num_object_clones":0,"num_object_copies":77958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207878,"num_write_kb":1663024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5100560384,"data_stored":5100560384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215256,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2789504,"kb_used_data":1215788,"kb_used_omap":14,"kb_used_meta":1573681,"kb_avail":731213696,"statfs":{"total":751619276800,"available":748762824704,"internally_reserved":0,"allocated":1244966912,"data_stored":1244477020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14855,"internal_metadata":1611449849},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444185,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2759608,"kb_used_data":1244964,"kb_used_omap":14,"kb_used_meta":1514609,"kb_avail":731243592,"statfs":{"total":751619276800,"available":748793438208,"internally_reserved":0,"allocated":1274843136,"data_stored":1274353244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14691,"internal_metadata":1550960285},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2626396,"kb_used_data":1128008,"kb_used_omap":13,"kb_used_meta":1498354,"kb_avail":731376804,"statfs":{"total":751619276800,"available":748929847296,"internally_reserved":0,"allocated":1155080192,"data_stored":1154593852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14035,"internal_metadata":1534314797},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,5,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705822,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2332832,"kb_used_data":1305868,"kb_used_omap":12,"kb_used_meta":1026931,"kb_avail":731670368,"statfs":{"total":751619276800,"available":749230456832,"internally_reserved":0,"allocated":1337208832,"data_stored":1336718940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12477,"internal_metadata":1051578179},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1378516992,"data_stored":1378516992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1175216128,"data_stored":1175216128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275904000,"data_stored":1275904000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1270923264,"data_stored":1270923264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:15.049 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:59:15.049 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:15.049 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T07:59:15.049 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:15.238 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:15.366 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:15.363+0000 7f3058307640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:15.366 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:15.364+0000 7f3058307640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:15.520 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:15.521 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:15.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 127 232721 232594 72.6799 74.7188 0.0126356 0.0137525 2026-02-24T07:59:15.586 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2026-02-24T07:59:13.978974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1703526944,"num_objects":25988,"num_object_clones":0,"num_object_copies":77964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25988,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":208013,"num_write_kb":1665174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10508340,"kb_used_data":4894628,"kb_used_omap":54,"kb_used_meta":5613577,"kb_avail":2925504460,"statfs":{"total":3006477107200,"available":2995716567040,"internally_reserved":0,"allocated":5012099072,"data_stored":5010143056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56058,"internal_metadata":5748303110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,13,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":364863488,"num_objects":5568,"num_object_clones":0,"num_object_copies":16704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44539,"num_write_kb":356312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136327"},"pg_stats":[{"pgid":"8.f","version":"114'12489","reported_seq":12506,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968682+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:12.968682+0000","last_peered":"2026-02-24T07:59:12.968682+0000","last_clean":"2026-02-24T07:59:12.968682+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:12.968682+0000","last_undegraded":"2026-02-24T07:59:12.968682+0000","last_fullsized":"2026-02-24T07:59:12.968682+0000","mapping_epoch":110,"log_start":"114'12464","ondisk_log_start":"114'12464","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102309888,"num_objects":1562,"num_object_clones":0,"num_object_copies":4686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12489,"num_write_kb":99912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"114'12896","reported_seq":12914,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.968699+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:12.968699+0000","last_peered":"2026-02-24T07:59:12.968699+0000","last_clean":"2026-02-24T07:59:12.968699+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:12.968699+0000","last_undegraded":"2026-02-24T07:59:12.968699+0000","last_fullsized":"2026-02-24T07:59:12.968699+0000","mapping_epoch":110,"log_start":"114'12856","ondisk_log_start":"114'12856","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105644032,"num_objects":1612,"num_object_clones":0,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12896,"num_write_kb":103168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"114'12560","reported_seq":12578,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872742+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:12.872742+0000","last_peered":"2026-02-24T07:59:12.872742+0000","last_clean":"2026-02-24T07:59:12.872742+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:12.872742+0000","last_undegraded":"2026-02-24T07:59:12.872742+0000","last_fullsized":"2026-02-24T07:59:12.872742+0000","mapping_epoch":110,"log_start":"114'12552","ondisk_log_start":"114'12552","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102891520,"num_objects":1570,"num_object_clones":0,"num_object_copies":4710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12560,"num_write_kb":100480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"114'12968","reported_seq":12986,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.925722+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:12.925722+0000","last_peered":"2026-02-24T07:59:12.925722+0000","last_clean":"2026-02-24T07:59:12.925722+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:12.925722+0000","last_undegraded":"2026-02-24T07:59:12.925722+0000","last_fullsized":"2026-02-24T07:59:12.925722+0000","mapping_epoch":110,"log_start":"114'12960","ondisk_log_start":"114'12960","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106233856,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12968,"num_write_kb":103744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.945267+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:12.945267+0000","last_peered":"2026-02-24T07:59:12.945267+0000","last_clean":"2026-02-24T07:59:12.945267+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:12.945267+0000","last_undegraded":"2026-02-24T07:59:12.945267+0000","last_fullsized":"2026-02-24T07:59:12.945267+0000","mapping_epoch":110,"log_start":"114'12824","ondisk_log_start":"114'12824","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"115'12984","reported_seq":13004,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.097753+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:13.097753+0000","last_peered":"2026-02-24T07:59:13.097753+0000","last_clean":"2026-02-24T07:59:13.097753+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:13.097753+0000","last_undegraded":"2026-02-24T07:59:13.097753+0000","last_fullsized":"2026-02-24T07:59:13.097753+0000","mapping_epoch":110,"log_start":"115'12976","ondisk_log_start":"115'12976","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106364928,"num_objects":1623,"num_object_clones":0,"num_object_copies":4869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12984,"num_write_kb":103872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"114'12752","reported_seq":12770,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.854328+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:12.854328+0000","last_peered":"2026-02-24T07:59:12.854328+0000","last_clean":"2026-02-24T07:59:12.854328+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:12.854328+0000","last_undegraded":"2026-02-24T07:59:12.854328+0000","last_fullsized":"2026-02-24T07:59:12.854328+0000","mapping_epoch":110,"log_start":"114'12744","ondisk_log_start":"114'12744","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104464384,"num_objects":1594,"num_object_clones":0,"num_object_copies":4782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12752,"num_write_kb":102016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"115'13181","reported_seq":13196,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.098222+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:13.098222+0000","last_peered":"2026-02-24T07:59:13.098222+0000","last_clean":"2026-02-24T07:59:13.098222+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:13.098222+0000","last_undegraded":"2026-02-24T07:59:13.098222+0000","last_fullsized":"2026-02-24T07:59:13.098222+0000","mapping_epoch":110,"log_start":"115'13172","ondisk_log_start":"115'13172","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107978752,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13181,"num_write_kb":105448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"114'13384","reported_seq":13402,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.961367+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:12.961367+0000","last_peered":"2026-02-24T07:59:12.961367+0000","last_clean":"2026-02-24T07:59:12.961367+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:12.961367+0000","last_undegraded":"2026-02-24T07:59:12.961367+0000","last_fullsized":"2026-02-24T07:59:12.961367+0000","mapping_epoch":110,"log_start":"114'13376","ondisk_log_start":"114'13376","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109641728,"num_objects":1673,"num_object_clones":0,"num_object_copies":5019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13384,"num_write_kb":107072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"114'12848","reported_seq":12866,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.874959+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:12.874959+0000","last_peered":"2026-02-24T07:59:12.874959+0000","last_clean":"2026-02-24T07:59:12.874959+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:12.874959+0000","last_undegraded":"2026-02-24T07:59:12.874959+0000","last_fullsized":"2026-02-24T07:59:12.874959+0000","mapping_epoch":110,"log_start":"114'12840","ondisk_log_start":"114'12840","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105250816,"num_objects":1606,"num_object_clones":0,"num_object_copies":4818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12848,"num_write_kb":102784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"114'12832","reported_seq":12850,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872595+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:12.872595+0000","last_peered":"2026-02-24T07:59:12.872595+0000","last_clean":"2026-02-24T07:59:12.872595+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:12.872595+0000","last_undegraded":"2026-02-24T07:59:12.872595+0000","last_fullsized":"2026-02-24T07:59:12.872595+0000","mapping_epoch":110,"log_start":"114'12827","ondisk_log_start":"114'12827","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12832,"num_write_kb":102656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"115'13480","reported_seq":13486,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.101467+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:13.101467+0000","last_peered":"2026-02-24T07:59:13.101467+0000","last_clean":"2026-02-24T07:59:13.101467+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:13.101467+0000","last_undegraded":"2026-02-24T07:59:13.101467+0000","last_fullsized":"2026-02-24T07:59:13.101467+0000","mapping_epoch":110,"log_start":"115'13456","ondisk_log_start":"115'13456","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13480,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"114'13368","reported_seq":13386,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.872340+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:12.872340+0000","last_peered":"2026-02-24T07:59:12.872340+0000","last_clean":"2026-02-24T07:59:12.872340+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:12.872340+0000","last_undegraded":"2026-02-24T07:59:12.872340+0000","last_fullsized":"2026-02-24T07:59:12.872340+0000","mapping_epoch":110,"log_start":"114'13360","ondisk_log_start":"114'13360","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109510656,"num_objects":1671,"num_object_clones":0,"num_object_copies":5013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13368,"num_write_kb":106944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"115'12592","reported_seq":12581,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100536+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:13.100536+0000","last_peered":"2026-02-24T07:59:13.100536+0000","last_clean":"2026-02-24T07:59:13.100536+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:13.100536+0000","last_undegraded":"2026-02-24T07:59:13.100536+0000","last_fullsized":"2026-02-24T07:59:13.100536+0000","mapping_epoch":110,"log_start":"115'12556","ondisk_log_start":"115'12556","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":3000,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103153664,"num_objects":1574,"num_object_clones":0,"num_object_copies":4722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12592,"num_write_kb":100736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"115'13176","reported_seq":13195,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.100893+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:13.100893+0000","last_peered":"2026-02-24T07:59:13.100893+0000","last_clean":"2026-02-24T07:59:13.100893+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:13.100893+0000","last_undegraded":"2026-02-24T07:59:13.100893+0000","last_fullsized":"2026-02-24T07:59:13.100893+0000","mapping_epoch":110,"log_start":"115'13161","ondisk_log_start":"115'13161","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"114'13536","reported_seq":13554,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:12.865332+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:12.865332+0000","last_peered":"2026-02-24T07:59:12.865332+0000","last_clean":"2026-02-24T07:59:12.865332+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:12.865332+0000","last_undegraded":"2026-02-24T07:59:12.865332+0000","last_fullsized":"2026-02-24T07:59:12.865332+0000","mapping_epoch":110,"log_start":"114'13529","ondisk_log_start":"114'13529","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110886912,"num_objects":1692,"num_object_clones":0,"num_object_copies":5076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13536,"num_write_kb":108288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":443,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T07:59:11.975235+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:11.975235+0000","last_peered":"2026-02-24T07:59:11.975235+0000","last_clean":"2026-02-24T07:59:11.975235+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:11.975235+0000","last_undegraded":"2026-02-24T07:59:11.975235+0000","last_fullsized":"2026-02-24T07:59:11.975235+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1702936576,"num_objects":25986,"num_object_clones":0,"num_object_copies":77958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207878,"num_write_kb":1663024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5100560384,"data_stored":5100560384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215256,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2789504,"kb_used_data":1215788,"kb_used_omap":14,"kb_used_meta":1573681,"kb_avail":731213696,"statfs":{"total":751619276800,"available":748762824704,"internally_reserved":0,"allocated":1244966912,"data_stored":1244477020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14855,"internal_metadata":1611449849},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444185,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2759608,"kb_used_data":1244964,"kb_used_omap":14,"kb_used_meta":1514609,"kb_avail":731243592,"statfs":{"total":751619276800,"available":748793438208,"internally_reserved":0,"allocated":1274843136,"data_stored":1274353244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14691,"internal_metadata":1550960285},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2626396,"kb_used_data":1128008,"kb_used_omap":13,"kb_used_meta":1498354,"kb_avail":731376804,"statfs":{"total":751619276800,"available":748929847296,"internally_reserved":0,"allocated":1155080192,"data_stored":1154593852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14035,"internal_metadata":1534314797},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,5,11,29,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705822,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2332832,"kb_used_data":1305868,"kb_used_omap":12,"kb_used_meta":1026931,"kb_avail":731670368,"statfs":{"total":751619276800,"available":749230456832,"internally_reserved":0,"allocated":1337208832,"data_stored":1336718940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12477,"internal_metadata":1051578179},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8522,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1378516992,"data_stored":1378516992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1175216128,"data_stored":1175216128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275904000,"data_stored":1275904000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1270923264,"data_stored":1270923264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:15.589 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 261 2026-02-24T07:59:15.744 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:15.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:15.867+0000 7f3e66326640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:15.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:15.868+0000 7f3e66326640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:16.029 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:59:16.045 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:15 trial016 ceph-mon[39544]: from='client.15508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:16.046 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:15 trial016 ceph-mon[39544]: from='client.15510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:16.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:59:16.206 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:16.356 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:16.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 241985 241857 72.6677 72.3672 0.00761269 0.0137556 2026-02-24T07:59:16.704 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:16.701+0000 7f406b714640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:16.704 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:16.702+0000 7f406b714640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:16.721 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:16.721 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:16.739 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:16.739 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:16.760 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:16.760 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:16.773 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:16.773 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:17.014 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:16 trial016 ceph-mon[39544]: from='client.15512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:17.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:16 trial016 ceph-mon[39544]: pgmap v465: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s wr, 9.14k op/s 2026-02-24T07:59:17.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1200486537' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "261"} : dispatch 2026-02-24T07:59:17.015 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1465788752' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:17.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 128 249769 249641 72.2284 60.8125 0.00778301 0.013836 2026-02-24T07:59:18.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 128 259642 259514 72.4034 77.1328 0.0110927 0.0138067 2026-02-24T07:59:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:18 trial016 ceph-mon[39544]: pgmap v466: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.42k op/s 2026-02-24T07:59:19.350 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:19.507 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:19.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 269426 269298 72.5423 76.4375 0.00350198 0.0137812 2026-02-24T07:59:19.631 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:19.628+0000 7ff08dd3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:19.631 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:19.628+0000 7ff08dd3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:19.651 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:19.652 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:19.666 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:19.666 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:19.708 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:19.708 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:19.721 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:19.721 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:20.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:19 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1060053898' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:20.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 279101 278973 72.6435 75.5859 0.0153711 0.0137607 2026-02-24T07:59:21.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:21.080 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:21.080 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T07:59:21.081 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:21.232 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:21.256 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:20 trial016 ceph-mon[39544]: pgmap v467: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 90 MiB/s wr, 11.48k op/s 2026-02-24T07:59:21.362 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:21.358+0000 7fe97aa3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:21.362 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:21.359+0000 7fe97aa3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:21.518 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:21.518 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:21.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 127 288899 288772 72.7695 76.5547 0.00605587 0.0137381 2026-02-24T07:59:21.571 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2026-02-24T07:59:19.844068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2079343136,"num_objects":31722,"num_object_clones":0,"num_object_copies":95166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31722,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":253889,"num_write_kb":2032182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11885092,"kb_used_data":5999892,"kb_used_omap":59,"kb_used_meta":5885060,"kb_avail":2924127708,"statfs":{"total":3006477107200,"available":2994306772992,"internally_reserved":0,"allocated":6143889408,"data_stored":6141870360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61266,"internal_metadata":6026301614},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,10,21,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":740679680,"num_objects":11302,"num_object_clones":0,"num_object_copies":33906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90415,"num_write_kb":723320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.872848"},"pg_stats":[{"pgid":"8.f","version":"116'15632","reported_seq":15654,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.961835+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:17.961835+0000","last_peered":"2026-02-24T07:59:17.961835+0000","last_clean":"2026-02-24T07:59:17.961835+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:17.961835+0000","last_undegraded":"2026-02-24T07:59:17.961835+0000","last_fullsized":"2026-02-24T07:59:17.961835+0000","mapping_epoch":110,"log_start":"116'15616","ondisk_log_start":"116'15616","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128057344,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15632,"num_write_kb":125056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"116'15736","reported_seq":15758,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.962377+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:17.962377+0000","last_peered":"2026-02-24T07:59:17.962377+0000","last_clean":"2026-02-24T07:59:17.962377+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:17.962377+0000","last_undegraded":"2026-02-24T07:59:17.962377+0000","last_fullsized":"2026-02-24T07:59:17.962377+0000","mapping_epoch":110,"log_start":"116'15713","ondisk_log_start":"116'15713","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15736,"num_write_kb":125888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"116'15664","reported_seq":15686,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.864747+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:17.864747+0000","last_peered":"2026-02-24T07:59:17.864747+0000","last_clean":"2026-02-24T07:59:17.864747+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:17.864747+0000","last_undegraded":"2026-02-24T07:59:17.864747+0000","last_fullsized":"2026-02-24T07:59:17.864747+0000","mapping_epoch":110,"log_start":"116'15658","ondisk_log_start":"116'15658","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128319488,"num_objects":1958,"num_object_clones":0,"num_object_copies":5874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1958,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15664,"num_write_kb":125312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"116'15808","reported_seq":15830,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.961005+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:17.961005+0000","last_peered":"2026-02-24T07:59:17.961005+0000","last_clean":"2026-02-24T07:59:17.961005+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:17.961005+0000","last_undegraded":"2026-02-24T07:59:17.961005+0000","last_fullsized":"2026-02-24T07:59:17.961005+0000","mapping_epoch":110,"log_start":"116'15792","ondisk_log_start":"116'15792","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129499136,"num_objects":1976,"num_object_clones":0,"num_object_copies":5928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15808,"num_write_kb":126464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"116'15648","reported_seq":15670,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.962152+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:17.962152+0000","last_peered":"2026-02-24T07:59:17.962152+0000","last_clean":"2026-02-24T07:59:17.962152+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:17.962152+0000","last_undegraded":"2026-02-24T07:59:17.962152+0000","last_fullsized":"2026-02-24T07:59:17.962152+0000","mapping_epoch":110,"log_start":"116'15628","ondisk_log_start":"116'15628","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":3000,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128188416,"num_objects":1956,"num_object_clones":0,"num_object_copies":5868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1956,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15648,"num_write_kb":125184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"116'15912","reported_seq":15934,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:18.102024+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:18.102024+0000","last_peered":"2026-02-24T07:59:18.102024+0000","last_clean":"2026-02-24T07:59:18.102024+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:18.102024+0000","last_undegraded":"2026-02-24T07:59:18.102024+0000","last_fullsized":"2026-02-24T07:59:18.102024+0000","mapping_epoch":110,"log_start":"116'15895","ondisk_log_start":"116'15895","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130351104,"num_objects":1989,"num_object_clones":0,"num_object_copies":5967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15912,"num_write_kb":127296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"116'15696","reported_seq":15718,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.865643+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:17.865643+0000","last_peered":"2026-02-24T07:59:17.865643+0000","last_clean":"2026-02-24T07:59:17.865643+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:17.865643+0000","last_undegraded":"2026-02-24T07:59:17.865643+0000","last_fullsized":"2026-02-24T07:59:17.865643+0000","mapping_epoch":110,"log_start":"116'15680","ondisk_log_start":"116'15680","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128581632,"num_objects":1962,"num_object_clones":0,"num_object_copies":5886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15696,"num_write_kb":125568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'15866","reported_seq":15886,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:18.102644+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:18.102644+0000","last_peered":"2026-02-24T07:59:18.102644+0000","last_clean":"2026-02-24T07:59:18.102644+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:18.102644+0000","last_undegraded":"2026-02-24T07:59:18.102644+0000","last_fullsized":"2026-02-24T07:59:18.102644+0000","mapping_epoch":110,"log_start":"116'15857","ondisk_log_start":"116'15857","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129974272,"num_objects":1984,"num_object_clones":0,"num_object_copies":5952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1984,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15866,"num_write_kb":126928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"116'16328","reported_seq":16350,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.957609+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:17.957609+0000","last_peered":"2026-02-24T07:59:17.957609+0000","last_clean":"2026-02-24T07:59:17.957609+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:17.957609+0000","last_undegraded":"2026-02-24T07:59:17.957609+0000","last_fullsized":"2026-02-24T07:59:17.957609+0000","mapping_epoch":110,"log_start":"116'16321","ondisk_log_start":"116'16321","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133758976,"num_objects":2041,"num_object_clones":0,"num_object_copies":6123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16328,"num_write_kb":130624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"116'15736","reported_seq":15758,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.874515+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:17.874515+0000","last_peered":"2026-02-24T07:59:17.874515+0000","last_clean":"2026-02-24T07:59:17.874515+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:17.874515+0000","last_undegraded":"2026-02-24T07:59:17.874515+0000","last_fullsized":"2026-02-24T07:59:17.874515+0000","mapping_epoch":110,"log_start":"116'15731","ondisk_log_start":"116'15731","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15736,"num_write_kb":125888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"116'15608","reported_seq":15630,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.876934+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:17.876934+0000","last_peered":"2026-02-24T07:59:17.876934+0000","last_clean":"2026-02-24T07:59:17.876934+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:17.876934+0000","last_undegraded":"2026-02-24T07:59:17.876934+0000","last_fullsized":"2026-02-24T07:59:17.876934+0000","mapping_epoch":110,"log_start":"116'15605","ondisk_log_start":"116'15605","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127860736,"num_objects":1951,"num_object_clones":0,"num_object_copies":5853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15608,"num_write_kb":124864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"116'16352","reported_seq":16374,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:18.089115+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:18.089115+0000","last_peered":"2026-02-24T07:59:18.089115+0000","last_clean":"2026-02-24T07:59:18.089115+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:18.089115+0000","last_undegraded":"2026-02-24T07:59:18.089115+0000","last_fullsized":"2026-02-24T07:59:18.089115+0000","mapping_epoch":110,"log_start":"116'16349","ondisk_log_start":"116'16349","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133955584,"num_objects":2044,"num_object_clones":0,"num_object_copies":6132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16352,"num_write_kb":130816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"116'16056","reported_seq":16078,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.875135+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:17.875135+0000","last_peered":"2026-02-24T07:59:17.875135+0000","last_clean":"2026-02-24T07:59:17.875135+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:17.875135+0000","last_undegraded":"2026-02-24T07:59:17.875135+0000","last_fullsized":"2026-02-24T07:59:17.875135+0000","mapping_epoch":110,"log_start":"116'16053","ondisk_log_start":"116'16053","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131530752,"num_objects":2007,"num_object_clones":0,"num_object_copies":6021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16056,"num_write_kb":128448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"116'15448","reported_seq":15470,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:18.092078+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:18.092078+0000","last_peered":"2026-02-24T07:59:18.092078+0000","last_clean":"2026-02-24T07:59:18.092078+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:18.092078+0000","last_undegraded":"2026-02-24T07:59:18.092078+0000","last_fullsized":"2026-02-24T07:59:18.092078+0000","mapping_epoch":110,"log_start":"116'15440","ondisk_log_start":"116'15440","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126550016,"num_objects":1931,"num_object_clones":0,"num_object_copies":5793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15448,"num_write_kb":123584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"116'15704","reported_seq":15726,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:18.076075+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:18.076075+0000","last_peered":"2026-02-24T07:59:18.076075+0000","last_clean":"2026-02-24T07:59:18.076075+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:18.076075+0000","last_undegraded":"2026-02-24T07:59:18.076075+0000","last_fullsized":"2026-02-24T07:59:18.076075+0000","mapping_epoch":110,"log_start":"116'15696","ondisk_log_start":"116'15696","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128647168,"num_objects":1963,"num_object_clones":0,"num_object_copies":5889,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1963,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15704,"num_write_kb":125632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"116'16560","reported_seq":16582,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:17.869580+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:17.869580+0000","last_peered":"2026-02-24T07:59:17.869580+0000","last_clean":"2026-02-24T07:59:17.869580+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:17.869580+0000","last_undegraded":"2026-02-24T07:59:17.869580+0000","last_fullsized":"2026-02-24T07:59:17.869580+0000","mapping_epoch":110,"log_start":"116'16552","ondisk_log_start":"116'16552","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135659520,"num_objects":2070,"num_object_clones":0,"num_object_copies":6210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16560,"num_write_kb":132480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":447,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.979442+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:13.979442+0000","last_peered":"2026-02-24T07:59:13.979442+0000","last_clean":"2026-02-24T07:59:13.979442+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:13.979442+0000","last_undegraded":"2026-02-24T07:59:13.979442+0000","last_fullsized":"2026-02-24T07:59:13.979442+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2078752768,"num_objects":31720,"num_object_clones":0,"num_object_copies":95160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253754,"num_write_kb":2030032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6231334912,"data_stored":6231334912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8638,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215257,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3072104,"kb_used_data":1497620,"kb_used_omap":15,"kb_used_meta":1574448,"kb_avail":730931096,"statfs":{"total":751619276800,"available":748473442304,"internally_reserved":0,"allocated":1533562880,"data_stored":1533057230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16151,"internal_metadata":1612234985},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444186,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3125464,"kb_used_data":1520580,"kb_used_omap":15,"kb_used_meta":1604848,"kb_avail":730877736,"statfs":{"total":751619276800,"available":748418801664,"internally_reserved":0,"allocated":1557073920,"data_stored":1556568270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15995,"internal_metadata":1643364741},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2946348,"kb_used_data":1375768,"kb_used_omap":14,"kb_used_meta":1570545,"kb_avail":731056852,"statfs":{"total":751619276800,"available":748602216448,"internally_reserved":0,"allocated":1408786432,"data_stored":1408284334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15339,"internal_metadata":1608238101},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705823,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2741176,"kb_used_data":1605924,"kb_used_omap":13,"kb_used_meta":1135218,"kb_avail":731262024,"statfs":{"total":751619276800,"available":748812312576,"internally_reserved":0,"allocated":1644466176,"data_stored":1643960526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13781,"internal_metadata":1162463787},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,10,21],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8638,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1689116672,"data_stored":1689116672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1432371200,"data_stored":1432371200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1556652032,"data_stored":1556652032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1553195008,"data_stored":1553195008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:21.573 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:59:21.573 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 26 2026-02-24T07:59:21.717 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:21.769 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:21.848 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:21.844+0000 7f07eb01e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:21.848 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:21.844+0000 7f07eb01e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:21.927 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:22.005 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:59:22.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:59:22.075 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:22.072+0000 7f5074614640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:22.075 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:22.072+0000 7f5074614640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:22.092 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:22.092 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:22.121 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:22.122 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:22.134 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:22.135 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:22.148 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:22.148 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:22.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 127 298535 298408 72.8478 75.2812 0.0046663 0.0137221 2026-02-24T07:59:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:22 trial016 ceph-mon[39544]: from='client.15520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:22 trial016 ceph-mon[39544]: pgmap v468: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.76k op/s 2026-02-24T07:59:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1510716177' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T07:59:23.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2944518742' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:23.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 127 308498 308371 72.9988 77.8359 0.00625718 0.0136934 2026-02-24T07:59:24.197 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:24.345 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:24.560 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 316873 316745 72.7758 65.4219 0.00322733 0.0137368 2026-02-24T07:59:24.849 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:24.810+0000 7f3945f8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:24.849 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:24.810+0000 7f3945f8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:24.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:24.850 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:24.852 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:24.853 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:24.867 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:24.867 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:24.881 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:24.881 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:25.157 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:24 trial016 ceph-mon[39544]: pgmap v469: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.49k op/s 2026-02-24T07:59:25.157 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:24 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1112916486' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:25.157 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:25.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 323937 323809 72.2732 55.1875 0.00240367 0.0138315 2026-02-24T07:59:26.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 128 334095 333967 72.4698 79.3594 0.00295694 0.0137958 2026-02-24T07:59:27.051 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:27.052 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:27.052 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T07:59:27.052 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T07:59:27.213 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:26 trial016 ceph-mon[39544]: pgmap v470: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 8.00k op/s 2026-02-24T07:59:27.414 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:27.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 128 343023 342895 72.3962 69.75 0.00167259 0.0138054 2026-02-24T07:59:27.562 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:27.630 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:27.613+0000 7efd4892e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:27.631 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:27.614+0000 7efd4892e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:27.656 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:27.656 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:27.657 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:27.658 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:27.658 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:27.658 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:27.658 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:28.341 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:28.342 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:28.342 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:28.270+0000 7f4aae53a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:28.342 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:28.270+0000 7f4aae53a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:28.342 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:28.342 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:28.370 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:28.370 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:28.385 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:28.385 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:28.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:28.486 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:28.487 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T07:59:28.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 349133 349005 71.7471 47.7344 0.00168072 0.0139284 2026-02-24T07:59:28.680 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:29.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:28 trial016 ceph-mon[39544]: pgmap v471: 17 pgs: 17 active+clean; 2.3 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.91k op/s 2026-02-24T07:59:29.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1075236239' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:29.446 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:29.443+0000 7ff21be7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:29.447 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:29.443+0000 7ff21be7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:29.470 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:29.471 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:29.471 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:29.471 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:29.471 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:29.471 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:29.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 127 355779 355652 71.2388 51.9297 0.00204997 0.0140315 2026-02-24T07:59:29.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:29.574 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:29.575 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T07:59:29.723 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:29.851 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:29.848+0000 7f693c1c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:29.851 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:29.848+0000 7f693c1c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:29.878 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:29.878 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:29.878 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:29.878 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:29.879 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:29.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:29.922 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:29.922 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T07:59:30.079 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:30.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:30.214+0000 7fde71893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:30.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:30.214+0000 7fde71893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:30.242 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T07:59:30.242 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T07:59:30.242 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T07:59:30.243 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T07:59:30.282 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T07:59:30.282 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T07:59:30.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:59:30.560213+0000 min lat: 0.000633628 max lat: 0.136937 avg lat: 0.0140133 2026-02-24T07:59:30.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:59:30.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 128 365443 365315 71.345 75.4922 0.00721365 0.0140133 2026-02-24T07:59:31.148 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:31.304 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:31.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:30 trial016 ceph-mon[39544]: pgmap v472: 17 pgs: 17 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 90 MiB/s wr, 11.46k op/s 2026-02-24T07:59:31.437 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:31.433+0000 7f3ec9cc9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:31.437 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:31.433+0000 7f3ec9cc9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:31.459 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:31.459 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:31.484 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:31.485 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:31.503 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:31.504 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:31.517 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:31.517 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:31.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 127 375692 375565 71.5579 80.0781 0.0124218 0.0139712 2026-02-24T07:59:32.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1004142717' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:32.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 128 386091 385963 71.7881 81.2344 0.0103733 0.0139261 2026-02-24T07:59:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:32 trial016 ceph-mon[39544]: pgmap v473: 17 pgs: 17 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.64k op/s 2026-02-24T07:59:33.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 396507 396379 72.0109 81.375 0.00584063 0.0138836 2026-02-24T07:59:33.564 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:33.721 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:34.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:34.084+0000 7facc00d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:34.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:34.084+0000 7facc00d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:34.158 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:34.158 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:34.159 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:34.159 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:34.166 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:34.166 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:34.181 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:34.181 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:34.561 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 128 403893 403765 71.6856 57.7031 0.00315399 0.0139448 2026-02-24T07:59:35.283 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:35.283 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:35.284 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_6 2026-02-24T07:59:35.284 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:35.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:34 trial016 ceph-mon[39544]: pgmap v474: 17 pgs: 17 active+clean; 3.0 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 89 MiB/s wr, 11.39k op/s 2026-02-24T07:59:35.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2691922559' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:35.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:34 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:59:35.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:34 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:59:35.308 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:35.434 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:35.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 128 411888 411760 71.4805 62.4609 0.00446764 0.0139819 2026-02-24T07:59:35.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:35.563+0000 7fe9f5049640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:35.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:35.563+0000 7fe9f5049640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:35.724 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:35.724 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:35.772 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2026-02-24T07:59:33.846006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3199738400,"num_objects":48818,"num_object_clones":0,"num_object_copies":146454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48818,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":390656,"num_write_kb":3126318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15722116,"kb_used_data":9266740,"kb_used_omap":59,"kb_used_meta":6455236,"kb_avail":2920290684,"statfs":{"total":3006477107200,"available":2990377660416,"internally_reserved":0,"allocated":9489141760,"data_stored":9487122712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61266,"internal_metadata":6610161838},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,19,8,35],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1120395264,"num_objects":17096,"num_object_clones":0,"num_object_copies":51288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136767,"num_write_kb":1094136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001639"},"pg_stats":[{"pgid":"8.f","version":"116'23920","reported_seq":23941,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.983491+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:32.983491+0000","last_peered":"2026-02-24T07:59:32.983491+0000","last_clean":"2026-02-24T07:59:32.983491+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:32.983491+0000","last_undegraded":"2026-02-24T07:59:32.983491+0000","last_fullsized":"2026-02-24T07:59:32.983491+0000","mapping_epoch":110,"log_start":"116'23904","ondisk_log_start":"116'23904","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195952640,"num_objects":2990,"num_object_clones":0,"num_object_copies":8970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2990,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23920,"num_write_kb":191360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"116'24152","reported_seq":24174,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.981928+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:32.981928+0000","last_peered":"2026-02-24T07:59:32.981928+0000","last_clean":"2026-02-24T07:59:32.981928+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:32.981928+0000","last_undegraded":"2026-02-24T07:59:32.981928+0000","last_fullsized":"2026-02-24T07:59:32.981928+0000","mapping_epoch":110,"log_start":"116'24144","ondisk_log_start":"116'24144","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197853184,"num_objects":3019,"num_object_clones":0,"num_object_copies":9057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24152,"num_write_kb":193216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"116'24072","reported_seq":24094,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.876213+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:32.876213+0000","last_peered":"2026-02-24T07:59:32.876213+0000","last_clean":"2026-02-24T07:59:32.876213+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:32.876213+0000","last_undegraded":"2026-02-24T07:59:32.876213+0000","last_fullsized":"2026-02-24T07:59:32.876213+0000","mapping_epoch":110,"log_start":"116'24060","ondisk_log_start":"116'24060","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197197824,"num_objects":3009,"num_object_clones":0,"num_object_copies":9027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24072,"num_write_kb":192576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"116'24208","reported_seq":24230,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.982304+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:32.982304+0000","last_peered":"2026-02-24T07:59:32.982304+0000","last_clean":"2026-02-24T07:59:32.982304+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:32.982304+0000","last_undegraded":"2026-02-24T07:59:32.982304+0000","last_fullsized":"2026-02-24T07:59:32.982304+0000","mapping_epoch":110,"log_start":"116'24181","ondisk_log_start":"116'24181","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":3000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198311936,"num_objects":3026,"num_object_clones":0,"num_object_copies":9078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24208,"num_write_kb":193664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"116'24200","reported_seq":24222,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.968832+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:32.968832+0000","last_peered":"2026-02-24T07:59:32.968832+0000","last_clean":"2026-02-24T07:59:32.968832+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:32.968832+0000","last_undegraded":"2026-02-24T07:59:32.968832+0000","last_fullsized":"2026-02-24T07:59:32.968832+0000","mapping_epoch":110,"log_start":"116'24192","ondisk_log_start":"116'24192","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198246400,"num_objects":3025,"num_object_clones":0,"num_object_copies":9075,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3025,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24200,"num_write_kb":193600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"116'24865","reported_seq":24884,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:33.092203+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:33.092203+0000","last_peered":"2026-02-24T07:59:33.092203+0000","last_clean":"2026-02-24T07:59:33.092203+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:33.092203+0000","last_undegraded":"2026-02-24T07:59:33.092203+0000","last_fullsized":"2026-02-24T07:59:33.092203+0000","mapping_epoch":110,"log_start":"116'24833","ondisk_log_start":"116'24833","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203694080,"num_objects":3109,"num_object_clones":0,"num_object_copies":9327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24865,"num_write_kb":198920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"116'24112","reported_seq":24134,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.844588+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:32.844588+0000","last_peered":"2026-02-24T07:59:32.844588+0000","last_clean":"2026-02-24T07:59:32.844588+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:32.844588+0000","last_undegraded":"2026-02-24T07:59:32.844588+0000","last_fullsized":"2026-02-24T07:59:32.844588+0000","mapping_epoch":110,"log_start":"116'24108","ondisk_log_start":"116'24108","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197525504,"num_objects":3014,"num_object_clones":0,"num_object_copies":9042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24112,"num_write_kb":192896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'24344","reported_seq":24366,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:33.069954+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:33.069954+0000","last_peered":"2026-02-24T07:59:33.069954+0000","last_clean":"2026-02-24T07:59:33.069954+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:33.069954+0000","last_undegraded":"2026-02-24T07:59:33.069954+0000","last_fullsized":"2026-02-24T07:59:33.069954+0000","mapping_epoch":110,"log_start":"116'24336","ondisk_log_start":"116'24336","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199426048,"num_objects":3043,"num_object_clones":0,"num_object_copies":9129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24344,"num_write_kb":194752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"116'24880","reported_seq":24902,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.981306+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:32.981306+0000","last_peered":"2026-02-24T07:59:32.981306+0000","last_clean":"2026-02-24T07:59:32.981306+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:32.981306+0000","last_undegraded":"2026-02-24T07:59:32.981306+0000","last_fullsized":"2026-02-24T07:59:32.981306+0000","mapping_epoch":110,"log_start":"116'24872","ondisk_log_start":"116'24872","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203816960,"num_objects":3110,"num_object_clones":0,"num_object_copies":9330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24880,"num_write_kb":199040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"116'24432","reported_seq":24454,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.870837+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:32.870837+0000","last_peered":"2026-02-24T07:59:32.870837+0000","last_clean":"2026-02-24T07:59:32.870837+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:32.870837+0000","last_undegraded":"2026-02-24T07:59:32.870837+0000","last_fullsized":"2026-02-24T07:59:32.870837+0000","mapping_epoch":110,"log_start":"116'24424","ondisk_log_start":"116'24424","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200146944,"num_objects":3054,"num_object_clones":0,"num_object_copies":9162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24432,"num_write_kb":195456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"116'23640","reported_seq":23662,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.876912+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:32.876912+0000","last_peered":"2026-02-24T07:59:32.876912+0000","last_clean":"2026-02-24T07:59:32.876912+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:32.876912+0000","last_undegraded":"2026-02-24T07:59:32.876912+0000","last_fullsized":"2026-02-24T07:59:32.876912+0000","mapping_epoch":110,"log_start":"116'23625","ondisk_log_start":"116'23625","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193658880,"num_objects":2955,"num_object_clones":0,"num_object_copies":8865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2955,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23640,"num_write_kb":189120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"116'24984","reported_seq":25006,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:33.104475+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:33.104475+0000","last_peered":"2026-02-24T07:59:33.104475+0000","last_clean":"2026-02-24T07:59:33.104475+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:33.104475+0000","last_undegraded":"2026-02-24T07:59:33.104475+0000","last_fullsized":"2026-02-24T07:59:33.104475+0000","mapping_epoch":110,"log_start":"116'24977","ondisk_log_start":"116'24977","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204668928,"num_objects":3123,"num_object_clones":0,"num_object_copies":9369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24984,"num_write_kb":199872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"116'24664","reported_seq":24686,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.877588+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:32.877588+0000","last_peered":"2026-02-24T07:59:32.877588+0000","last_clean":"2026-02-24T07:59:32.877588+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:32.877588+0000","last_undegraded":"2026-02-24T07:59:32.877588+0000","last_fullsized":"2026-02-24T07:59:32.877588+0000","mapping_epoch":110,"log_start":"116'24656","ondisk_log_start":"116'24656","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202047488,"num_objects":3083,"num_object_clones":0,"num_object_copies":9249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24664,"num_write_kb":197312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"116'24184","reported_seq":24204,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:33.091203+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:33.091203+0000","last_peered":"2026-02-24T07:59:33.091203+0000","last_clean":"2026-02-24T07:59:33.091203+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:33.091203+0000","last_undegraded":"2026-02-24T07:59:33.091203+0000","last_fullsized":"2026-02-24T07:59:33.091203+0000","mapping_epoch":110,"log_start":"116'24168","ondisk_log_start":"116'24168","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198115328,"num_objects":3023,"num_object_clones":0,"num_object_copies":9069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24184,"num_write_kb":193472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"116'24824","reported_seq":24846,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:33.107551+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:33.107551+0000","last_peered":"2026-02-24T07:59:33.107551+0000","last_clean":"2026-02-24T07:59:33.107551+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:33.107551+0000","last_undegraded":"2026-02-24T07:59:33.107551+0000","last_fullsized":"2026-02-24T07:59:33.107551+0000","mapping_epoch":110,"log_start":"116'24817","ondisk_log_start":"116'24817","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203358208,"num_objects":3103,"num_object_clones":0,"num_object_copies":9309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24824,"num_write_kb":198592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"116'25040","reported_seq":25062,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:32.868627+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:32.868627+0000","last_peered":"2026-02-24T07:59:32.868627+0000","last_clean":"2026-02-24T07:59:32.868627+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:32.868627+0000","last_undegraded":"2026-02-24T07:59:32.868627+0000","last_fullsized":"2026-02-24T07:59:32.868627+0000","mapping_epoch":110,"log_start":"116'25037","ondisk_log_start":"116'25037","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205127680,"num_objects":3130,"num_object_clones":0,"num_object_copies":9390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25040,"num_write_kb":200320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":447,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.979442+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:13.979442+0000","last_peered":"2026-02-24T07:59:13.979442+0000","last_clean":"2026-02-24T07:59:13.979442+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:13.979442+0000","last_undegraded":"2026-02-24T07:59:13.979442+0000","last_fullsized":"2026-02-24T07:59:13.979442+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":3199148032,"num_objects":48816,"num_object_clones":0,"num_object_copies":146448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390521,"num_write_kb":3124168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9590300672,"data_stored":9590300672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8638,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215260,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4150088,"kb_used_data":2304884,"kb_used_omap":15,"kb_used_meta":1845168,"kb_avail":729853112,"statfs":{"total":751619276800,"available":747369586688,"internally_reserved":0,"allocated":2360201216,"data_stored":2359695566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16151,"internal_metadata":1889452265},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4190432,"kb_used_data":2332812,"kb_used_omap":15,"kb_used_meta":1857584,"kb_avail":729812768,"statfs":{"total":751619276800,"available":747328274432,"internally_reserved":0,"allocated":2388799488,"data_stored":2388293838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15995,"internal_metadata":1902166405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3644820,"kb_used_data":2136512,"kb_used_omap":14,"kb_used_meta":1508273,"kb_avail":730358380,"statfs":{"total":751619276800,"available":747886981120,"internally_reserved":0,"allocated":2187788288,"data_stored":2187286190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15339,"internal_metadata":1544471573},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705826,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3736776,"kb_used_data":2492532,"kb_used_omap":13,"kb_used_meta":1244210,"kb_avail":730266424,"statfs":{"total":751619276800,"available":747792818176,"internally_reserved":0,"allocated":2552352768,"data_stored":2551847118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13781,"internal_metadata":1274071595},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,19,8,35],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8638,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2598043648,"data_stored":2598043648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2203451392,"data_stored":2203451392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2396454912,"data_stored":2396454912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2392350720,"data_stored":2392350720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:35.774 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_6 pgp_num 26 2026-02-24T07:59:35.964 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:36.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:36.099+0000 7f07c6a86640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:36.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:36.099+0000 7f07c6a86640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:36.255 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:59:36.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:59:36.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 128 421768 421640 71.6039 77.1875 0.0118977 0.0139607 2026-02-24T07:59:36.962 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:37.114 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:37.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:37.253+0000 7fd597de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:37.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:37.254+0000 7fd597de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:37.257 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:36 trial016 ceph-mon[39544]: from='client.15542 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:37.257 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:36 trial016 ceph-mon[39544]: pgmap v475: 17 pgs: 17 active+clean; 3.0 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.31k op/s 2026-02-24T07:59:37.257 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1232462036' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T07:59:37.273 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:37.273 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:37.287 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:37.288 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:37.310 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:37.310 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:37.326 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:37.327 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:37.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 127 431948 431821 71.7726 79.5391 0.00515225 0.0139301 2026-02-24T07:59:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3908891309' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:38.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 127 441789 441662 71.879 76.8828 0.00400839 0.0139081 2026-02-24T07:59:39.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:38 trial016 ceph-mon[39544]: pgmap v476: 17 pgs: 17 active+clean; 3.0 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.31k op/s 2026-02-24T07:59:39.374 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:39.518 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:39.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 127 451336 451209 71.9341 74.5859 0.00408154 0.013898 2026-02-24T07:59:39.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:39.644+0000 7fe4fa65d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:39.646 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:39.644+0000 7fe4fa65d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:39.665 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:39.665 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:39.680 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:39.680 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:39.695 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:39.696 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:39.710 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:39.710 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2952267733' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:40.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 461224 461096 72.0401 77.2422 0.00662355 0.0138773 2026-02-24T07:59:41.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:41.306 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:41.306 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_6 2026-02-24T07:59:41.306 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:41 trial016 ceph-mon[39544]: pgmap v477: 17 pgs: 17 active+clean; 3.3 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.11k op/s 2026-02-24T07:59:41.445 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:41.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 128 470368 470240 72.0282 71.4375 0.00447631 0.0138741 2026-02-24T07:59:41.758 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:41.939 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:41.916+0000 7f3c7989e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:41.940 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:41.916+0000 7f3c7989e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:41.956 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:42.067 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:42.068 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:42.116 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2026-02-24T07:59:41.847134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3572974112,"num_objects":54513,"num_object_clones":0,"num_object_copies":163539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54513,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":436217,"num_write_kb":3490806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15456804,"kb_used_data":10319572,"kb_used_omap":50,"kb_used_meta":5137101,"kb_avail":2920555996,"statfs":{"total":3006477107200,"available":2990649339904,"internally_reserved":0,"allocated":10567241728,"data_stored":10565222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52127,"internal_metadata":5260391521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,9,4,18,14,18,13],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742227968,"num_objects":11325,"num_object_clones":0,"num_object_copies":33975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90604,"num_write_kb":724832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001684"},"pg_stats":[{"pgid":"8.f","version":"116'26856","reported_seq":26878,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.980804+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:37.980804+0000","last_peered":"2026-02-24T07:59:37.980804+0000","last_clean":"2026-02-24T07:59:37.980804+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:37.980804+0000","last_undegraded":"2026-02-24T07:59:37.980804+0000","last_fullsized":"2026-02-24T07:59:37.980804+0000","mapping_epoch":110,"log_start":"116'26848","ondisk_log_start":"116'26848","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220004352,"num_objects":3357,"num_object_clones":0,"num_object_copies":10071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":214848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"116'27200","reported_seq":27222,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.965755+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:37.965755+0000","last_peered":"2026-02-24T07:59:37.965755+0000","last_clean":"2026-02-24T07:59:37.965755+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:37.965755+0000","last_undegraded":"2026-02-24T07:59:37.965755+0000","last_fullsized":"2026-02-24T07:59:37.965755+0000","mapping_epoch":110,"log_start":"116'27194","ondisk_log_start":"116'27194","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222822400,"num_objects":3400,"num_object_clones":0,"num_object_copies":10200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27200,"num_write_kb":217600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"116'26918","reported_seq":26934,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.879429+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:37.879429+0000","last_peered":"2026-02-24T07:59:37.879429+0000","last_clean":"2026-02-24T07:59:37.879429+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:37.879429+0000","last_undegraded":"2026-02-24T07:59:37.879429+0000","last_fullsized":"2026-02-24T07:59:37.879429+0000","mapping_epoch":110,"log_start":"116'26909","ondisk_log_start":"116'26909","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220512256,"num_objects":3365,"num_object_clones":0,"num_object_copies":10095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26918,"num_write_kb":215344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"116'26797","reported_seq":26808,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.986888+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:37.986888+0000","last_peered":"2026-02-24T07:59:37.986888+0000","last_clean":"2026-02-24T07:59:37.986888+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:37.986888+0000","last_undegraded":"2026-02-24T07:59:37.986888+0000","last_fullsized":"2026-02-24T07:59:37.986888+0000","mapping_epoch":110,"log_start":"116'26785","ondisk_log_start":"116'26785","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219521024,"num_objects":3350,"num_object_clones":0,"num_object_copies":10050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26797,"num_write_kb":214376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"116'27224","reported_seq":27246,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.985984+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:37.985984+0000","last_peered":"2026-02-24T07:59:37.985984+0000","last_clean":"2026-02-24T07:59:37.985984+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:37.985984+0000","last_undegraded":"2026-02-24T07:59:37.985984+0000","last_fullsized":"2026-02-24T07:59:37.985984+0000","mapping_epoch":110,"log_start":"116'27211","ondisk_log_start":"116'27211","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:50.472188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223019008,"num_objects":3403,"num_object_clones":0,"num_object_copies":10209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27224,"num_write_kb":217792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"116'27832","reported_seq":27854,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:38.090601+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:38.090601+0000","last_peered":"2026-02-24T07:59:38.090601+0000","last_clean":"2026-02-24T07:59:38.090601+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:38.090601+0000","last_undegraded":"2026-02-24T07:59:38.090601+0000","last_fullsized":"2026-02-24T07:59:38.090601+0000","mapping_epoch":110,"log_start":"116'27824","ondisk_log_start":"116'27824","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227999744,"num_objects":3479,"num_object_clones":0,"num_object_copies":10437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27832,"num_write_kb":222656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"116'27048","reported_seq":27062,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.878028+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:37.878028+0000","last_peered":"2026-02-24T07:59:37.878028+0000","last_clean":"2026-02-24T07:59:37.878028+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:37.878028+0000","last_undegraded":"2026-02-24T07:59:37.878028+0000","last_fullsized":"2026-02-24T07:59:37.878028+0000","mapping_epoch":110,"log_start":"116'27024","ondisk_log_start":"116'27024","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221577216,"num_objects":3381,"num_object_clones":0,"num_object_copies":10143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27048,"num_write_kb":216384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'26936","reported_seq":26958,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:38.091507+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:38.091507+0000","last_peered":"2026-02-24T07:59:38.091507+0000","last_clean":"2026-02-24T07:59:38.091507+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:38.091507+0000","last_undegraded":"2026-02-24T07:59:38.091507+0000","last_fullsized":"2026-02-24T07:59:38.091507+0000","mapping_epoch":110,"log_start":"116'26926","ondisk_log_start":"116'26926","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220659712,"num_objects":3367,"num_object_clones":0,"num_object_copies":10101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26936,"num_write_kb":215488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"116'27984","reported_seq":28000,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.987827+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:37.987827+0000","last_peered":"2026-02-24T07:59:37.987827+0000","last_clean":"2026-02-24T07:59:37.987827+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:37.987827+0000","last_undegraded":"2026-02-24T07:59:37.987827+0000","last_fullsized":"2026-02-24T07:59:37.987827+0000","mapping_epoch":110,"log_start":"116'27977","ondisk_log_start":"116'27977","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229244928,"num_objects":3498,"num_object_clones":0,"num_object_copies":10494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27984,"num_write_kb":223872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"116'27240","reported_seq":27262,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.868993+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:37.868993+0000","last_peered":"2026-02-24T07:59:37.868993+0000","last_clean":"2026-02-24T07:59:37.868993+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:37.868993+0000","last_undegraded":"2026-02-24T07:59:37.868993+0000","last_fullsized":"2026-02-24T07:59:37.868993+0000","mapping_epoch":110,"log_start":"116'27224","ondisk_log_start":"116'27224","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223150080,"num_objects":3405,"num_object_clones":0,"num_object_copies":10215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27240,"num_write_kb":217920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"116'26472","reported_seq":26494,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.873653+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:37.873653+0000","last_peered":"2026-02-24T07:59:37.873653+0000","last_clean":"2026-02-24T07:59:37.873653+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:37.873653+0000","last_undegraded":"2026-02-24T07:59:37.873653+0000","last_fullsized":"2026-02-24T07:59:37.873653+0000","mapping_epoch":110,"log_start":"116'26464","ondisk_log_start":"116'26464","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216858624,"num_objects":3309,"num_object_clones":0,"num_object_copies":9927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26472,"num_write_kb":211776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"116'27719","reported_seq":27739,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:38.106614+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:38.106614+0000","last_peered":"2026-02-24T07:59:38.106614+0000","last_clean":"2026-02-24T07:59:38.106614+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:38.106614+0000","last_undegraded":"2026-02-24T07:59:38.106614+0000","last_fullsized":"2026-02-24T07:59:38.106614+0000","mapping_epoch":110,"log_start":"116'27716","ondisk_log_start":"116'27716","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227074048,"num_objects":3465,"num_object_clones":0,"num_object_copies":10395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27719,"num_write_kb":221752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"116'27280","reported_seq":27302,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.878842+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:37.878842+0000","last_peered":"2026-02-24T07:59:37.878842+0000","last_clean":"2026-02-24T07:59:37.878842+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:37.878842+0000","last_undegraded":"2026-02-24T07:59:37.878842+0000","last_fullsized":"2026-02-24T07:59:37.878842+0000","mapping_epoch":110,"log_start":"116'27256","ondisk_log_start":"116'27256","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223477760,"num_objects":3410,"num_object_clones":0,"num_object_copies":10230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27280,"num_write_kb":218240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"116'27272","reported_seq":27294,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:38.108012+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:38.108012+0000","last_peered":"2026-02-24T07:59:38.108012+0000","last_clean":"2026-02-24T07:59:38.108012+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:38.108012+0000","last_undegraded":"2026-02-24T07:59:38.108012+0000","last_fullsized":"2026-02-24T07:59:38.108012+0000","mapping_epoch":110,"log_start":"116'27251","ondisk_log_start":"116'27251","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223412224,"num_objects":3409,"num_object_clones":0,"num_object_copies":10227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27272,"num_write_kb":218176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"116'27560","reported_seq":27582,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:38.094358+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:38.094358+0000","last_peered":"2026-02-24T07:59:38.094358+0000","last_clean":"2026-02-24T07:59:38.094358+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:38.094358+0000","last_undegraded":"2026-02-24T07:59:38.094358+0000","last_fullsized":"2026-02-24T07:59:38.094358+0000","mapping_epoch":110,"log_start":"116'27557","ondisk_log_start":"116'27557","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:51.492186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225771520,"num_objects":3445,"num_object_clones":0,"num_object_copies":10335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27560,"num_write_kb":220480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"116'27744","reported_seq":27758,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:37.880298+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:37.880298+0000","last_peered":"2026-02-24T07:59:37.880298+0000","last_clean":"2026-02-24T07:59:37.880298+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:37.880298+0000","last_undegraded":"2026-02-24T07:59:37.880298+0000","last_fullsized":"2026-02-24T07:59:37.880298+0000","mapping_epoch":110,"log_start":"116'27728","ondisk_log_start":"116'27728","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227278848,"num_objects":3468,"num_object_clones":0,"num_object_copies":10404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":221952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":447,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T07:59:13.979442+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:13.979442+0000","last_peered":"2026-02-24T07:59:13.979442+0000","last_clean":"2026-02-24T07:59:13.979442+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:13.979442+0000","last_undegraded":"2026-02-24T07:59:13.979442+0000","last_fullsized":"2026-02-24T07:59:13.979442+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":3572383744,"num_objects":54511,"num_object_clones":0,"num_object_copies":163533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54511,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436082,"num_write_kb":3488656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10711351296,"data_stored":10711351296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":188,"ondisk_log_size":188,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215261,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3477352,"kb_used_data":2589012,"kb_used_omap":10,"kb_used_meta":888309,"kb_avail":730525848,"statfs":{"total":751619276800,"available":748058468352,"internally_reserved":0,"allocated":2651148288,"data_stored":2650642638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11199,"internal_metadata":909628481},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444190,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3851440,"kb_used_data":2553628,"kb_used_omap":10,"kb_used_meta":1297781,"kb_avail":730151760,"statfs":{"total":751619276800,"available":747675402240,"internally_reserved":0,"allocated":2614915072,"data_stored":2614409422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11156,"internal_metadata":1328927852},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,9,4,18,12,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4005876,"kb_used_data":2389280,"kb_used_omap":14,"kb_used_meta":1616561,"kb_avail":729997324,"statfs":{"total":751619276800,"available":747517259776,"internally_reserved":0,"allocated":2446622720,"data_stored":2446120622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15339,"internal_metadata":1655358485},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705827,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4122136,"kb_used_data":2787652,"kb_used_omap":14,"kb_used_meta":1334449,"kb_avail":729881064,"statfs":{"total":751619276800,"available":747398209536,"internally_reserved":0,"allocated":2854555648,"data_stored":2854049998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14433,"internal_metadata":1366476703},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,0,13],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2903056384,"data_stored":2903056384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2459787264,"data_stored":2459787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2675154944,"data_stored":2675154944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2673352704,"data_stored":2673352704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:42.117 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_6 pgp_num 26 2026-02-24T07:59:42.178 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:42.176+0000 7f983fbfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:42.179 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:42.177+0000 7f983fbfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:42.200 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:42.200 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:42.214 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:42.215 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:42.235 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:42.235 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:42.253 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:42.253 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:42.276 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:42.422 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:42.419+0000 7f9841f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:42.422 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:42.420+0000 7f9841f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:42.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 478814 478686 71.9119 65.9844 0.00955952 0.0139028 2026-02-24T07:59:42.574 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T07:59:42.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:59:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:43 trial016 ceph-mon[39544]: pgmap v478: 17 pgs: 17 active+clean; 3.3 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.55k op/s 2026-02-24T07:59:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2699346174' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2923071172' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T07:59:43.562 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 128 488877 488749 72.0383 78.6172 0.0270923 0.0138768 2026-02-24T07:59:44.307 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:44 trial016 ceph-mon[39544]: from='client.15550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:44.463 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:44.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 127 499074 498947 72.1795 79.6719 0.00833153 0.0138517 2026-02-24T07:59:44.589 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:44.587+0000 7f47daf24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:44.589 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:44.587+0000 7f47daf24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:44.607 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:44.608 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:44.624 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:44.625 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:44.647 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:44.648 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:44.663 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:44.663 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:45 trial016 ceph-mon[39544]: pgmap v479: 17 pgs: 17 active+clean; 3.7 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 90 MiB/s wr, 11.46k op/s 2026-02-24T07:59:45.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1087540351' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:45.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:45.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 509369 509241 72.3288 80.4219 0.014868 0.0138228 2026-02-24T07:59:46.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 128 519147 519019 72.4012 76.3906 0.00472458 0.0138093 2026-02-24T07:59:46.720 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:46.878 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:47.001 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:46.999+0000 7f7442163640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:47.001 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:46.999+0000 7f7442163640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:47.021 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:47.021 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:47.034 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:47.035 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:47.056 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:47.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:47.069 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:47.070 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:47.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:47 trial016 ceph-mon[39544]: pgmap v480: 17 pgs: 17 active+clean; 3.7 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.71k op/s 2026-02-24T07:59:47.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3201757359' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:47.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 128 528580 528452 72.4238 73.6953 0.0132252 0.0138039 2026-02-24T07:59:47.623 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T07:59:47.623 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T07:59:47.769 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:48.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:48.100+0000 7fc0f2707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:48.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:48.100+0000 7fc0f2707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:48.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 537180 537053 72.3336 67.1953 0.0103918 0.0138222 2026-02-24T07:59:49.010 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T07:59:49.059 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T07:59:49.121 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:49.209 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:49.263 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:49 trial016 ceph-mon[39544]: pgmap v481: 17 pgs: 17 active+clean; 3.7 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.71k op/s 2026-02-24T07:59:49.264 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2140139261' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T07:59:49.273 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:49.355 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:49.353+0000 7f3f87db2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:49.355 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:49.353+0000 7f3f87db2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:49.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:49.381+0000 7f9ffd759640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:49.384 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:49.382+0000 7f9ffd759640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:49.401 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:49.401 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:49.417 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:49.418 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:49.451 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:49.452 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:49.467 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:49.467 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:49.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 128 546665 546537 72.3633 74.0938 0.00985143 0.0138167 2026-02-24T07:59:50.016 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T07:59:50.067 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T07:59:50.217 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:50.274 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2140139261' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T07:59:50.274 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:50 trial016 ceph-mon[39544]: osdmap e117: 4 total, 4 up, 4 in 2026-02-24T07:59:50.274 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4196960472' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:50.274 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:50 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1343759617' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T07:59:50.352 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:50.350+0000 7f5ee0b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:50.352 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:50.350+0000 7f5ee0b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:50.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T07:59:50.562494+0000 min lat: 0.000630903 max lat: 0.136937 avg lat: 0.0138053 2026-02-24T07:59:50.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T07:59:50.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 556371 556243 72.421 75.8281 0.0168909 0.0138053 2026-02-24T07:59:51.016 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T07:59:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:51 trial016 ceph-mon[39544]: pgmap v483: 17 pgs: 17 active+clean; 4.1 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 75 MiB/s wr, 9.61k op/s 2026-02-24T07:59:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1343759617' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T07:59:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:51 trial016 ceph-mon[39544]: osdmap e118: 4 total, 4 up, 4 in 2026-02-24T07:59:51.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2791551883' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T07:59:51.513 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:51.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 564452 564324 72.2686 63.1328 0.00486043 0.013833 2026-02-24T07:59:51.589 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T07:59:51.665 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:51.925 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:52.092 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2791551883' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T07:59:52.092 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:52 trial016 ceph-mon[39544]: osdmap e119: 4 total, 4 up, 4 in 2026-02-24T07:59:52.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:52.089+0000 7f3718260640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:52.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:52.090+0000 7f3718260640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:52.122 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:52.122 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:52.140 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:52.141 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:52.152 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:52.152 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:52.166 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:52.166 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:52.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 571194 571066 71.9525 52.6719 0.0073879 0.0138892 2026-02-24T07:59:52.572 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:52.453+0000 7f8d01ff2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:52.573 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:52.453+0000 7f8d01ff2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:53.022 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T07:59:53.245 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:53 trial016 ceph-mon[39544]: pgmap v486: 17 pgs: 17 active+clean; 4.1 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.19k op/s 2026-02-24T07:59:53.246 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2896003610' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:53.246 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1568808693' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T07:59:53.409 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T07:59:53.410 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:53.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 577680 577552 71.6146 50.6719 0.012883 0.0139602 2026-02-24T07:59:53.610 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:54.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:53.991+0000 7f7eeb7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:54.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:53.991+0000 7f7eeb7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:54.137 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:54.138 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:54 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T07:59:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:54 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T07:59:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:54 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1568808693' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T07:59:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:54 trial016 ceph-mon[39544]: osdmap e120: 4 total, 4 up, 4 in 2026-02-24T07:59:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:54 trial016 ceph-mon[39544]: 8.b scrub starts 2026-02-24T07:59:54.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 127 584710 584583 71.3539 54.9297 0.00945079 0.0140111 2026-02-24T07:59:54.794 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2026-02-24T07:59:53.848816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4699390496,"num_objects":71700,"num_object_clones":0,"num_object_copies":215100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71700,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":573719,"num_write_kb":4590822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19782468,"kb_used_data":13717044,"kb_used_omap":59,"kb_used_meta":6065284,"kb_avail":2916230332,"statfs":{"total":3006477107200,"available":2986219859968,"internally_reserved":0,"allocated":14046253056,"data_stored":14044139460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60603,"internal_metadata":6210851653},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,61],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339271680,"num_objects":5175,"num_object_clones":0,"num_object_copies":15525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41415,"num_write_kb":331320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.839585"},"pg_stats":[{"pgid":"8.f","version":"119'35544","reported_seq":35572,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969226+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:52.969226+0000","last_peered":"2026-02-24T07:59:52.969226+0000","last_clean":"2026-02-24T07:59:52.969226+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:52.969226+0000","last_undegraded":"2026-02-24T07:59:52.969226+0000","last_fullsized":"2026-02-24T07:59:52.969226+0000","mapping_epoch":110,"log_start":"119'35536","ondisk_log_start":"119'35536","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"119'35704","reported_seq":35724,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.997339+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:52.997339+0000","last_peered":"2026-02-24T07:59:52.997339+0000","last_clean":"2026-02-24T07:59:52.997339+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:52.997339+0000","last_undegraded":"2026-02-24T07:59:52.997339+0000","last_fullsized":"2026-02-24T07:59:52.997339+0000","mapping_epoch":110,"log_start":"119'35688","ondisk_log_start":"119'35688","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292487168,"num_objects":4463,"num_object_clones":0,"num_object_copies":13389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35704,"num_write_kb":285632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"119'35536","reported_seq":35564,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.857380+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:52.857380+0000","last_peered":"2026-02-24T07:59:52.857380+0000","last_clean":"2026-02-24T07:59:52.857380+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:52.857380+0000","last_undegraded":"2026-02-24T07:59:52.857380+0000","last_fullsized":"2026-02-24T07:59:52.857380+0000","mapping_epoch":110,"log_start":"119'35533","ondisk_log_start":"119'35533","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"119'35616","reported_seq":35644,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969610+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:52.969610+0000","last_peered":"2026-02-24T07:59:52.969610+0000","last_clean":"2026-02-24T07:59:52.969610+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:52.969610+0000","last_undegraded":"2026-02-24T07:59:52.969610+0000","last_fullsized":"2026-02-24T07:59:52.969610+0000","mapping_epoch":110,"log_start":"119'35608","ondisk_log_start":"119'35608","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291766272,"num_objects":4452,"num_object_clones":0,"num_object_copies":13356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35616,"num_write_kb":284928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"119'35648","reported_seq":35676,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.986120+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:52.986120+0000","last_peered":"2026-02-24T07:59:52.986120+0000","last_clean":"2026-02-24T07:59:52.986120+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:52.986120+0000","last_undegraded":"2026-02-24T07:59:52.986120+0000","last_fullsized":"2026-02-24T07:59:52.986120+0000","mapping_epoch":110,"log_start":"119'35640","ondisk_log_start":"119'35640","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292028416,"num_objects":4456,"num_object_clones":0,"num_object_copies":13368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35648,"num_write_kb":285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"120'35872","reported_seq":35902,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.098353+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:53.098353+0000","last_peered":"2026-02-24T07:59:53.098353+0000","last_clean":"2026-02-24T07:59:53.098353+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:53.098353+0000","last_undegraded":"2026-02-24T07:59:53.098353+0000","last_fullsized":"2026-02-24T07:59:53.098353+0000","mapping_epoch":110,"log_start":"120'35864","ondisk_log_start":"120'35864","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293863424,"num_objects":4484,"num_object_clones":0,"num_object_copies":13452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35872,"num_write_kb":286976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"119'35416","reported_seq":35444,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861904+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:52.861904+0000","last_peered":"2026-02-24T07:59:52.861904+0000","last_clean":"2026-02-24T07:59:52.861904+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:52.861904+0000","last_undegraded":"2026-02-24T07:59:52.861904+0000","last_fullsized":"2026-02-24T07:59:52.861904+0000","mapping_epoch":110,"log_start":"119'35408","ondisk_log_start":"119'35408","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290127872,"num_objects":4427,"num_object_clones":0,"num_object_copies":13281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35416,"num_write_kb":283328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"120'35632","reported_seq":35662,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.052970+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:53.052970+0000","last_peered":"2026-02-24T07:59:53.052970+0000","last_clean":"2026-02-24T07:59:53.052970+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:53.052970+0000","last_undegraded":"2026-02-24T07:59:53.052970+0000","last_fullsized":"2026-02-24T07:59:53.052970+0000","mapping_epoch":110,"log_start":"120'35624","ondisk_log_start":"120'35624","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291897344,"num_objects":4454,"num_object_clones":0,"num_object_copies":13362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35632,"num_write_kb":285056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"119'36952","reported_seq":36979,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.993372+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:52.993372+0000","last_peered":"2026-02-24T07:59:52.993372+0000","last_clean":"2026-02-24T07:59:52.993372+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:52.993372+0000","last_undegraded":"2026-02-24T07:59:52.993372+0000","last_fullsized":"2026-02-24T07:59:52.993372+0000","mapping_epoch":110,"log_start":"119'36944","ondisk_log_start":"119'36944","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302710784,"num_objects":4619,"num_object_clones":0,"num_object_copies":13857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36952,"num_write_kb":295616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"119'36224","reported_seq":36252,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862757+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:52.862757+0000","last_peered":"2026-02-24T07:59:52.862757+0000","last_clean":"2026-02-24T07:59:52.862757+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:52.862757+0000","last_undegraded":"2026-02-24T07:59:52.862757+0000","last_fullsized":"2026-02-24T07:59:52.862757+0000","mapping_epoch":110,"log_start":"119'36217","ondisk_log_start":"119'36217","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296747008,"num_objects":4528,"num_object_clones":0,"num_object_copies":13584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36224,"num_write_kb":289792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"119'35448","reported_seq":35476,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861486+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:52.861486+0000","last_peered":"2026-02-24T07:59:52.861486+0000","last_clean":"2026-02-24T07:59:52.861486+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:52.861486+0000","last_undegraded":"2026-02-24T07:59:52.861486+0000","last_fullsized":"2026-02-24T07:59:52.861486+0000","mapping_epoch":110,"log_start":"119'35440","ondisk_log_start":"119'35440","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290390016,"num_objects":4431,"num_object_clones":0,"num_object_copies":13293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35448,"num_write_kb":283584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"120'36192","reported_seq":36222,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102339+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:53.102339+0000","last_peered":"2026-02-24T07:59:53.102339+0000","last_clean":"2026-02-24T07:59:53.102339+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:53.102339+0000","last_undegraded":"2026-02-24T07:59:53.102339+0000","last_fullsized":"2026-02-24T07:59:53.102339+0000","mapping_epoch":110,"log_start":"120'36187","ondisk_log_start":"120'36187","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296484864,"num_objects":4524,"num_object_clones":0,"num_object_copies":13572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36192,"num_write_kb":289536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"119'35944","reported_seq":35972,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.855360+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:52.855360+0000","last_peered":"2026-02-24T07:59:52.855360+0000","last_clean":"2026-02-24T07:59:52.855360+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:52.855360+0000","last_undegraded":"2026-02-24T07:59:52.855360+0000","last_fullsized":"2026-02-24T07:59:52.855360+0000","mapping_epoch":110,"log_start":"119'35936","ondisk_log_start":"119'35936","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294453248,"num_objects":4493,"num_object_clones":0,"num_object_copies":13479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35944,"num_write_kb":287552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"120'35536","reported_seq":35566,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.097264+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:53.097264+0000","last_peered":"2026-02-24T07:59:53.097264+0000","last_clean":"2026-02-24T07:59:53.097264+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:53.097264+0000","last_undegraded":"2026-02-24T07:59:53.097264+0000","last_fullsized":"2026-02-24T07:59:53.097264+0000","mapping_epoch":110,"log_start":"120'35520","ondisk_log_start":"120'35520","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"120'36328","reported_seq":36358,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102727+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:53.102727+0000","last_peered":"2026-02-24T07:59:53.102727+0000","last_clean":"2026-02-24T07:59:53.102727+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:53.102727+0000","last_undegraded":"2026-02-24T07:59:53.102727+0000","last_fullsized":"2026-02-24T07:59:53.102727+0000","mapping_epoch":110,"log_start":"120'36320","ondisk_log_start":"120'36320","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297598976,"num_objects":4541,"num_object_clones":0,"num_object_copies":13623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36328,"num_write_kb":290624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"119'35992","reported_seq":36020,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862344+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:52.862344+0000","last_peered":"2026-02-24T07:59:52.862344+0000","last_clean":"2026-02-24T07:59:52.862344+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:52.862344+0000","last_undegraded":"2026-02-24T07:59:52.862344+0000","last_fullsized":"2026-02-24T07:59:52.862344+0000","mapping_epoch":110,"log_start":"119'35984","ondisk_log_start":"119'35984","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294846464,"num_objects":4499,"num_object_clones":0,"num_object_copies":13497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35992,"num_write_kb":287936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":454,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:51.017215+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:51.017215+0000","last_peered":"2026-02-24T07:59:51.017215+0000","last_clean":"2026-02-24T07:59:51.017215+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:51.017215+0000","last_undegraded":"2026-02-24T07:59:51.017215+0000","last_fullsized":"2026-02-24T07:59:51.017215+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4698800128,"num_objects":71698,"num_object_clones":0,"num_object_copies":215094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573584,"num_write_kb":4588672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14093230080,"data_stored":14093230080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215264,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4613116,"kb_used_data":3436008,"kb_used_omap":12,"kb_used_meta":1177075,"kb_avail":729390084,"statfs":{"total":751619276800,"available":746895446016,"internally_reserved":0,"allocated":3518472192,"data_stored":3517942905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13155,"internal_metadata":1205324957},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4847220,"kb_used_data":3441120,"kb_used_omap":12,"kb_used_meta":1406067,"kb_avail":729155980,"statfs":{"total":751619276800,"available":746655723520,"internally_reserved":0,"allocated":3523706880,"data_stored":3523177593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13112,"internal_metadata":1439812808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,32],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5015072,"kb_used_data":3145804,"kb_used_omap":17,"kb_used_meta":1869230,"kb_avail":728988128,"statfs":{"total":751619276800,"available":746483843072,"internally_reserved":0,"allocated":3221303296,"data_stored":3220777561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17947,"internal_metadata":1914092005},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705830,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5307060,"kb_used_data":3694112,"kb_used_omap":16,"kb_used_meta":1612911,"kb_avail":728696140,"statfs":{"total":751619276800,"available":746184847360,"internally_reserved":0,"allocated":3782770688,"data_stored":3782241401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16389,"internal_metadata":1651621883},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3815129088,"data_stored":3815129088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3226951680,"data_stored":3226951680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3526557696,"data_stored":3526557696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3524591616,"data_stored":3524591616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:54.795 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:54.931 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:54.986 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T07:59:55.028 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 07:59:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:07:59:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T07:59:55.232 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:55 trial016 ceph-mon[39544]: pgmap v488: 17 pgs: 17 active+clean; 4.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s wr, 8.56k op/s 2026-02-24T07:59:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:55 trial016 ceph-mon[39544]: osdmap e121: 4 total, 4 up, 4 in 2026-02-24T07:59:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:55 trial016 ceph-mon[39544]: 8.b scrub ok 2026-02-24T07:59:55.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 128 591870 591742 71.1165 55.9297 0.00471419 0.0140575 2026-02-24T07:59:55.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:55.423+0000 7f366d12e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:55.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:55.423+0000 7f366d12e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:55.666 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:55.666 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:56 trial016 ceph-mon[39544]: from='client.15572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:56.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:56.430+0000 7f1c09311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:56.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:56.430+0000 7f1c09311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:56.468 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:56.468 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:56.469 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:56.469 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:56.494 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:56.494 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:56.509 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:56.509 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:56.546 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2026-02-24T07:59:54.888225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4699390496,"num_objects":71700,"num_object_clones":0,"num_object_copies":215100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71700,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":573719,"num_write_kb":4590822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19782468,"kb_used_data":13717044,"kb_used_omap":59,"kb_used_meta":6065284,"kb_avail":2916230332,"statfs":{"total":3006477107200,"available":2986219859968,"internally_reserved":0,"allocated":14046253056,"data_stored":14044139460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60603,"internal_metadata":6210851653},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,61],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339271680,"num_objects":5175,"num_object_clones":0,"num_object_copies":15525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41415,"num_write_kb":331320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.039926"},"pg_stats":[{"pgid":"8.f","version":"119'35544","reported_seq":35572,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969226+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:52.969226+0000","last_peered":"2026-02-24T07:59:52.969226+0000","last_clean":"2026-02-24T07:59:52.969226+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:52.969226+0000","last_undegraded":"2026-02-24T07:59:52.969226+0000","last_fullsized":"2026-02-24T07:59:52.969226+0000","mapping_epoch":110,"log_start":"119'35536","ondisk_log_start":"119'35536","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"119'35704","reported_seq":35724,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.997339+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:52.997339+0000","last_peered":"2026-02-24T07:59:52.997339+0000","last_clean":"2026-02-24T07:59:52.997339+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:52.997339+0000","last_undegraded":"2026-02-24T07:59:52.997339+0000","last_fullsized":"2026-02-24T07:59:52.997339+0000","mapping_epoch":110,"log_start":"119'35688","ondisk_log_start":"119'35688","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292487168,"num_objects":4463,"num_object_clones":0,"num_object_copies":13389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35704,"num_write_kb":285632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"119'35536","reported_seq":35564,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.857380+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:52.857380+0000","last_peered":"2026-02-24T07:59:52.857380+0000","last_clean":"2026-02-24T07:59:52.857380+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:52.857380+0000","last_undegraded":"2026-02-24T07:59:52.857380+0000","last_fullsized":"2026-02-24T07:59:52.857380+0000","mapping_epoch":110,"log_start":"119'35533","ondisk_log_start":"119'35533","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"119'35616","reported_seq":35644,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969610+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:52.969610+0000","last_peered":"2026-02-24T07:59:52.969610+0000","last_clean":"2026-02-24T07:59:52.969610+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:52.969610+0000","last_undegraded":"2026-02-24T07:59:52.969610+0000","last_fullsized":"2026-02-24T07:59:52.969610+0000","mapping_epoch":110,"log_start":"119'35608","ondisk_log_start":"119'35608","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291766272,"num_objects":4452,"num_object_clones":0,"num_object_copies":13356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35616,"num_write_kb":284928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"119'35648","reported_seq":35676,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.986120+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:52.986120+0000","last_peered":"2026-02-24T07:59:52.986120+0000","last_clean":"2026-02-24T07:59:52.986120+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:52.986120+0000","last_undegraded":"2026-02-24T07:59:52.986120+0000","last_fullsized":"2026-02-24T07:59:52.986120+0000","mapping_epoch":110,"log_start":"119'35640","ondisk_log_start":"119'35640","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292028416,"num_objects":4456,"num_object_clones":0,"num_object_copies":13368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35648,"num_write_kb":285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"120'35872","reported_seq":35902,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.098353+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:53.098353+0000","last_peered":"2026-02-24T07:59:53.098353+0000","last_clean":"2026-02-24T07:59:53.098353+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:53.098353+0000","last_undegraded":"2026-02-24T07:59:53.098353+0000","last_fullsized":"2026-02-24T07:59:53.098353+0000","mapping_epoch":110,"log_start":"120'35864","ondisk_log_start":"120'35864","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293863424,"num_objects":4484,"num_object_clones":0,"num_object_copies":13452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35872,"num_write_kb":286976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"119'35416","reported_seq":35444,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861904+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:52.861904+0000","last_peered":"2026-02-24T07:59:52.861904+0000","last_clean":"2026-02-24T07:59:52.861904+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:52.861904+0000","last_undegraded":"2026-02-24T07:59:52.861904+0000","last_fullsized":"2026-02-24T07:59:52.861904+0000","mapping_epoch":110,"log_start":"119'35408","ondisk_log_start":"119'35408","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290127872,"num_objects":4427,"num_object_clones":0,"num_object_copies":13281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35416,"num_write_kb":283328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"120'35632","reported_seq":35662,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.052970+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:53.052970+0000","last_peered":"2026-02-24T07:59:53.052970+0000","last_clean":"2026-02-24T07:59:53.052970+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:53.052970+0000","last_undegraded":"2026-02-24T07:59:53.052970+0000","last_fullsized":"2026-02-24T07:59:53.052970+0000","mapping_epoch":110,"log_start":"120'35624","ondisk_log_start":"120'35624","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291897344,"num_objects":4454,"num_object_clones":0,"num_object_copies":13362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35632,"num_write_kb":285056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"119'36952","reported_seq":36979,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.993372+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:52.993372+0000","last_peered":"2026-02-24T07:59:52.993372+0000","last_clean":"2026-02-24T07:59:52.993372+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:52.993372+0000","last_undegraded":"2026-02-24T07:59:52.993372+0000","last_fullsized":"2026-02-24T07:59:52.993372+0000","mapping_epoch":110,"log_start":"119'36944","ondisk_log_start":"119'36944","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302710784,"num_objects":4619,"num_object_clones":0,"num_object_copies":13857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36952,"num_write_kb":295616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"119'36224","reported_seq":36252,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862757+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:52.862757+0000","last_peered":"2026-02-24T07:59:52.862757+0000","last_clean":"2026-02-24T07:59:52.862757+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:52.862757+0000","last_undegraded":"2026-02-24T07:59:52.862757+0000","last_fullsized":"2026-02-24T07:59:52.862757+0000","mapping_epoch":110,"log_start":"119'36217","ondisk_log_start":"119'36217","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296747008,"num_objects":4528,"num_object_clones":0,"num_object_copies":13584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36224,"num_write_kb":289792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"119'35448","reported_seq":35476,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861486+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:52.861486+0000","last_peered":"2026-02-24T07:59:52.861486+0000","last_clean":"2026-02-24T07:59:52.861486+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:52.861486+0000","last_undegraded":"2026-02-24T07:59:52.861486+0000","last_fullsized":"2026-02-24T07:59:52.861486+0000","mapping_epoch":110,"log_start":"119'35440","ondisk_log_start":"119'35440","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290390016,"num_objects":4431,"num_object_clones":0,"num_object_copies":13293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35448,"num_write_kb":283584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"120'36192","reported_seq":36222,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102339+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:53.102339+0000","last_peered":"2026-02-24T07:59:53.102339+0000","last_clean":"2026-02-24T07:59:53.102339+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:53.102339+0000","last_undegraded":"2026-02-24T07:59:53.102339+0000","last_fullsized":"2026-02-24T07:59:53.102339+0000","mapping_epoch":110,"log_start":"120'36187","ondisk_log_start":"120'36187","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296484864,"num_objects":4524,"num_object_clones":0,"num_object_copies":13572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36192,"num_write_kb":289536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"119'35944","reported_seq":35972,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.855360+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:52.855360+0000","last_peered":"2026-02-24T07:59:52.855360+0000","last_clean":"2026-02-24T07:59:52.855360+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:52.855360+0000","last_undegraded":"2026-02-24T07:59:52.855360+0000","last_fullsized":"2026-02-24T07:59:52.855360+0000","mapping_epoch":110,"log_start":"119'35936","ondisk_log_start":"119'35936","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294453248,"num_objects":4493,"num_object_clones":0,"num_object_copies":13479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35944,"num_write_kb":287552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"120'35536","reported_seq":35566,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.097264+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:53.097264+0000","last_peered":"2026-02-24T07:59:53.097264+0000","last_clean":"2026-02-24T07:59:53.097264+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:53.097264+0000","last_undegraded":"2026-02-24T07:59:53.097264+0000","last_fullsized":"2026-02-24T07:59:53.097264+0000","mapping_epoch":110,"log_start":"120'35520","ondisk_log_start":"120'35520","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"120'36328","reported_seq":36358,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102727+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:53.102727+0000","last_peered":"2026-02-24T07:59:53.102727+0000","last_clean":"2026-02-24T07:59:53.102727+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:53.102727+0000","last_undegraded":"2026-02-24T07:59:53.102727+0000","last_fullsized":"2026-02-24T07:59:53.102727+0000","mapping_epoch":110,"log_start":"120'36320","ondisk_log_start":"120'36320","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297598976,"num_objects":4541,"num_object_clones":0,"num_object_copies":13623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36328,"num_write_kb":290624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"119'35992","reported_seq":36020,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862344+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:52.862344+0000","last_peered":"2026-02-24T07:59:52.862344+0000","last_clean":"2026-02-24T07:59:52.862344+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:52.862344+0000","last_undegraded":"2026-02-24T07:59:52.862344+0000","last_fullsized":"2026-02-24T07:59:52.862344+0000","mapping_epoch":110,"log_start":"119'35984","ondisk_log_start":"119'35984","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294846464,"num_objects":4499,"num_object_clones":0,"num_object_copies":13497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35992,"num_write_kb":287936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":454,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:51.017215+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:51.017215+0000","last_peered":"2026-02-24T07:59:51.017215+0000","last_clean":"2026-02-24T07:59:51.017215+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:51.017215+0000","last_undegraded":"2026-02-24T07:59:51.017215+0000","last_fullsized":"2026-02-24T07:59:51.017215+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4698800128,"num_objects":71698,"num_object_clones":0,"num_object_copies":215094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573584,"num_write_kb":4588672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14093230080,"data_stored":14093230080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215264,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4613116,"kb_used_data":3436008,"kb_used_omap":12,"kb_used_meta":1177075,"kb_avail":729390084,"statfs":{"total":751619276800,"available":746895446016,"internally_reserved":0,"allocated":3518472192,"data_stored":3517942905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13155,"internal_metadata":1205324957},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4847220,"kb_used_data":3441120,"kb_used_omap":12,"kb_used_meta":1406067,"kb_avail":729155980,"statfs":{"total":751619276800,"available":746655723520,"internally_reserved":0,"allocated":3523706880,"data_stored":3523177593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13112,"internal_metadata":1439812808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,32],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5015072,"kb_used_data":3145804,"kb_used_omap":17,"kb_used_meta":1869230,"kb_avail":728988128,"statfs":{"total":751619276800,"available":746483843072,"internally_reserved":0,"allocated":3221303296,"data_stored":3220777561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17947,"internal_metadata":1914092005},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705830,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5307060,"kb_used_data":3694112,"kb_used_omap":16,"kb_used_meta":1612911,"kb_avail":728696140,"statfs":{"total":751619276800,"available":746184847360,"internally_reserved":0,"allocated":3782770688,"data_stored":3782241401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16389,"internal_metadata":1651621883},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3815129088,"data_stored":3815129088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3226951680,"data_stored":3226951680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3526557696,"data_stored":3526557696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3524591616,"data_stored":3524591616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:56.547 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T07:59:56.547 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T07:59:56.547 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T07:59:56.547 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:59:56.563 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 128 598623 598495 70.8383 52.7578 0.00845272 0.0141138 2026-02-24T07:59:56.712 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:56.840 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:56.838+0000 7f98b5340640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:56.840 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:56.838+0000 7f98b5340640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:56.996 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T07:59:56.997 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T07:59:57.046 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2026-02-24T07:59:55.849105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4699390496,"num_objects":71700,"num_object_clones":0,"num_object_copies":215100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71700,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":573719,"num_write_kb":4590822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19782468,"kb_used_data":13717044,"kb_used_omap":59,"kb_used_meta":6065284,"kb_avail":2916230332,"statfs":{"total":3006477107200,"available":2986219859968,"internally_reserved":0,"allocated":14046253056,"data_stored":14044139460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60603,"internal_metadata":6210851653},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,61],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339271680,"num_objects":5175,"num_object_clones":0,"num_object_copies":15525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41415,"num_write_kb":331320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.834625"},"pg_stats":[{"pgid":"8.f","version":"119'35544","reported_seq":35572,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969226+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:52.969226+0000","last_peered":"2026-02-24T07:59:52.969226+0000","last_clean":"2026-02-24T07:59:52.969226+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:52.969226+0000","last_undegraded":"2026-02-24T07:59:52.969226+0000","last_fullsized":"2026-02-24T07:59:52.969226+0000","mapping_epoch":110,"log_start":"119'35536","ondisk_log_start":"119'35536","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.936654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":13329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":284352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"119'35704","reported_seq":35724,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.997339+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:52.997339+0000","last_peered":"2026-02-24T07:59:52.997339+0000","last_clean":"2026-02-24T07:59:52.997339+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:52.997339+0000","last_undegraded":"2026-02-24T07:59:52.997339+0000","last_fullsized":"2026-02-24T07:59:52.997339+0000","mapping_epoch":110,"log_start":"119'35688","ondisk_log_start":"119'35688","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292487168,"num_objects":4463,"num_object_clones":0,"num_object_copies":13389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35704,"num_write_kb":285632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"119'35536","reported_seq":35564,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.857380+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:52.857380+0000","last_peered":"2026-02-24T07:59:52.857380+0000","last_clean":"2026-02-24T07:59:52.857380+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:52.857380+0000","last_undegraded":"2026-02-24T07:59:52.857380+0000","last_fullsized":"2026-02-24T07:59:52.857380+0000","mapping_epoch":110,"log_start":"119'35533","ondisk_log_start":"119'35533","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"119'35616","reported_seq":35644,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.969610+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:52.969610+0000","last_peered":"2026-02-24T07:59:52.969610+0000","last_clean":"2026-02-24T07:59:52.969610+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:52.969610+0000","last_undegraded":"2026-02-24T07:59:52.969610+0000","last_fullsized":"2026-02-24T07:59:52.969610+0000","mapping_epoch":110,"log_start":"119'35608","ondisk_log_start":"119'35608","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291766272,"num_objects":4452,"num_object_clones":0,"num_object_copies":13356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35616,"num_write_kb":284928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"119'35648","reported_seq":35676,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.986120+0000","last_change":"2026-02-24T07:58:48.944614+0000","last_active":"2026-02-24T07:59:52.986120+0000","last_peered":"2026-02-24T07:59:52.986120+0000","last_clean":"2026-02-24T07:59:52.986120+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:52.986120+0000","last_undegraded":"2026-02-24T07:59:52.986120+0000","last_fullsized":"2026-02-24T07:59:52.986120+0000","mapping_epoch":110,"log_start":"119'35640","ondisk_log_start":"119'35640","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292028416,"num_objects":4456,"num_object_clones":0,"num_object_copies":13368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35648,"num_write_kb":285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"120'35872","reported_seq":35902,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.098353+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:53.098353+0000","last_peered":"2026-02-24T07:59:53.098353+0000","last_clean":"2026-02-24T07:59:53.098353+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:53.098353+0000","last_undegraded":"2026-02-24T07:59:53.098353+0000","last_fullsized":"2026-02-24T07:59:53.098353+0000","mapping_epoch":110,"log_start":"120'35864","ondisk_log_start":"120'35864","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293863424,"num_objects":4484,"num_object_clones":0,"num_object_copies":13452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35872,"num_write_kb":286976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"119'35416","reported_seq":35444,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861904+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:52.861904+0000","last_peered":"2026-02-24T07:59:52.861904+0000","last_clean":"2026-02-24T07:59:52.861904+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:52.861904+0000","last_undegraded":"2026-02-24T07:59:52.861904+0000","last_fullsized":"2026-02-24T07:59:52.861904+0000","mapping_epoch":110,"log_start":"119'35408","ondisk_log_start":"119'35408","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290127872,"num_objects":4427,"num_object_clones":0,"num_object_copies":13281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35416,"num_write_kb":283328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"120'35632","reported_seq":35662,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.052970+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:53.052970+0000","last_peered":"2026-02-24T07:59:53.052970+0000","last_clean":"2026-02-24T07:59:53.052970+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:53.052970+0000","last_undegraded":"2026-02-24T07:59:53.052970+0000","last_fullsized":"2026-02-24T07:59:53.052970+0000","mapping_epoch":110,"log_start":"120'35624","ondisk_log_start":"120'35624","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.653450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291897344,"num_objects":4454,"num_object_clones":0,"num_object_copies":13362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35632,"num_write_kb":285056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"119'36952","reported_seq":36979,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.993372+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:52.993372+0000","last_peered":"2026-02-24T07:59:52.993372+0000","last_clean":"2026-02-24T07:59:52.993372+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:52.993372+0000","last_undegraded":"2026-02-24T07:59:52.993372+0000","last_fullsized":"2026-02-24T07:59:52.993372+0000","mapping_epoch":110,"log_start":"119'36944","ondisk_log_start":"119'36944","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:55.963256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302710784,"num_objects":4619,"num_object_clones":0,"num_object_copies":13857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36952,"num_write_kb":295616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"119'36224","reported_seq":36252,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862757+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:52.862757+0000","last_peered":"2026-02-24T07:59:52.862757+0000","last_clean":"2026-02-24T07:59:52.862757+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:52.862757+0000","last_undegraded":"2026-02-24T07:59:52.862757+0000","last_fullsized":"2026-02-24T07:59:52.862757+0000","mapping_epoch":110,"log_start":"119'36217","ondisk_log_start":"119'36217","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296747008,"num_objects":4528,"num_object_clones":0,"num_object_copies":13584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36224,"num_write_kb":289792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"119'35448","reported_seq":35476,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.861486+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:52.861486+0000","last_peered":"2026-02-24T07:59:52.861486+0000","last_clean":"2026-02-24T07:59:52.861486+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:52.861486+0000","last_undegraded":"2026-02-24T07:59:52.861486+0000","last_fullsized":"2026-02-24T07:59:52.861486+0000","mapping_epoch":110,"log_start":"119'35440","ondisk_log_start":"119'35440","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290390016,"num_objects":4431,"num_object_clones":0,"num_object_copies":13293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35448,"num_write_kb":283584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"120'36192","reported_seq":36222,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102339+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:53.102339+0000","last_peered":"2026-02-24T07:59:53.102339+0000","last_clean":"2026-02-24T07:59:53.102339+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:53.102339+0000","last_undegraded":"2026-02-24T07:59:53.102339+0000","last_fullsized":"2026-02-24T07:59:53.102339+0000","mapping_epoch":110,"log_start":"120'36187","ondisk_log_start":"120'36187","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296484864,"num_objects":4524,"num_object_clones":0,"num_object_copies":13572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36192,"num_write_kb":289536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"119'35944","reported_seq":35972,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.855360+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:52.855360+0000","last_peered":"2026-02-24T07:59:52.855360+0000","last_clean":"2026-02-24T07:59:52.855360+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:52.855360+0000","last_undegraded":"2026-02-24T07:59:52.855360+0000","last_fullsized":"2026-02-24T07:59:52.855360+0000","mapping_epoch":110,"log_start":"119'35936","ondisk_log_start":"119'35936","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:53.596176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294453248,"num_objects":4493,"num_object_clones":0,"num_object_copies":13479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35944,"num_write_kb":287552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"120'35536","reported_seq":35566,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.097264+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:53.097264+0000","last_peered":"2026-02-24T07:59:53.097264+0000","last_clean":"2026-02-24T07:59:53.097264+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:53.097264+0000","last_undegraded":"2026-02-24T07:59:53.097264+0000","last_fullsized":"2026-02-24T07:59:53.097264+0000","mapping_epoch":110,"log_start":"120'35520","ondisk_log_start":"120'35520","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:56.119151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291110912,"num_objects":4442,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35536,"num_write_kb":284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"120'36328","reported_seq":36358,"reported_epoch":120,"state":"active+clean","last_fresh":"2026-02-24T07:59:53.102727+0000","last_change":"2026-02-24T07:58:48.944196+0000","last_active":"2026-02-24T07:59:53.102727+0000","last_peered":"2026-02-24T07:59:53.102727+0000","last_clean":"2026-02-24T07:59:53.102727+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:53.102727+0000","last_undegraded":"2026-02-24T07:59:53.102727+0000","last_fullsized":"2026-02-24T07:59:53.102727+0000","mapping_epoch":110,"log_start":"120'36320","ondisk_log_start":"120'36320","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297598976,"num_objects":4541,"num_object_clones":0,"num_object_copies":13623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36328,"num_write_kb":290624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"119'35992","reported_seq":36020,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:52.862344+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:52.862344+0000","last_peered":"2026-02-24T07:59:52.862344+0000","last_clean":"2026-02-24T07:59:52.862344+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:52.862344+0000","last_undegraded":"2026-02-24T07:59:52.862344+0000","last_fullsized":"2026-02-24T07:59:52.862344+0000","mapping_epoch":110,"log_start":"119'35984","ondisk_log_start":"119'35984","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294846464,"num_objects":4499,"num_object_clones":0,"num_object_copies":13497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35992,"num_write_kb":287936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":454,"reported_epoch":119,"state":"active+clean","last_fresh":"2026-02-24T07:59:51.017215+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:51.017215+0000","last_peered":"2026-02-24T07:59:51.017215+0000","last_clean":"2026-02-24T07:59:51.017215+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:51.017215+0000","last_undegraded":"2026-02-24T07:59:51.017215+0000","last_fullsized":"2026-02-24T07:59:51.017215+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:54.277328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4698800128,"num_objects":71698,"num_object_clones":0,"num_object_copies":215094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573584,"num_write_kb":4588672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14093230080,"data_stored":14093230080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215264,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4613116,"kb_used_data":3436008,"kb_used_omap":12,"kb_used_meta":1177075,"kb_avail":729390084,"statfs":{"total":751619276800,"available":746895446016,"internally_reserved":0,"allocated":3518472192,"data_stored":3517942905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13155,"internal_metadata":1205324957},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,15],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4847220,"kb_used_data":3441120,"kb_used_omap":12,"kb_used_meta":1406067,"kb_avail":729155980,"statfs":{"total":751619276800,"available":746655723520,"internally_reserved":0,"allocated":3523706880,"data_stored":3523177593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13112,"internal_metadata":1439812808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,3,23,32],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5015072,"kb_used_data":3145804,"kb_used_omap":17,"kb_used_meta":1869230,"kb_avail":728988128,"statfs":{"total":751619276800,"available":746483843072,"internally_reserved":0,"allocated":3221303296,"data_stored":3220777561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17947,"internal_metadata":1914092005},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705830,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5307060,"kb_used_data":3694112,"kb_used_omap":16,"kb_used_meta":1612911,"kb_avail":728696140,"statfs":{"total":751619276800,"available":746184847360,"internally_reserved":0,"allocated":3782770688,"data_stored":3782241401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16389,"internal_metadata":1651621883},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3815129088,"data_stored":3815129088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3226951680,"data_stored":3226951680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3526557696,"data_stored":3526557696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3524591616,"data_stored":3524591616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:59:57.048 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T07:59:57.049 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 36 2026-02-24T07:59:57.204 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:57.260 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:57 trial016 ceph-mon[39544]: from='client.15574 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:57.260 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:57 trial016 ceph-mon[39544]: pgmap v490: 17 pgs: 17 active+clean; 4.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.10k op/s 2026-02-24T07:59:57.260 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2181396301' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:57.333 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:57.331+0000 7f7bcb389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:57.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:57.331+0000 7f7bcb389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:57.482 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T07:59:57.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:59:57.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 127 608048 607921 70.88 73.6406 0.022519 0.0141054 2026-02-24T07:59:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:58 trial016 ceph-mon[39544]: from='client.15578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:59:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4292778115' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T07:59:58.563 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T07:59:58.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 127 618620 618493 71.0522 82.5938 0.0121209 0.0140714 2026-02-24T07:59:58.707 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T07:59:58.833 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:58.830+0000 7f90ccdd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:58.833 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T07:59:58.831+0000 7f90ccdd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:59:58.849 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T07:59:58.849 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T07:59:58.867 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T07:59:58.867 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T07:59:58.893 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T07:59:58.894 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T07:59:58.909 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T07:59:58.909 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T07:59:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:59 trial016 ceph-mon[39544]: pgmap v491: 17 pgs: 17 active+clean; 4.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 6.06k op/s 2026-02-24T07:59:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:59 trial016 ceph-mon[39544]: 8.0 scrub starts 2026-02-24T07:59:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 07:59:59 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2828036871' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T07:59:59.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 628346 628218 71.1235 75.9766 0.00727519 0.0140573 2026-02-24T08:00:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:00 trial016 ceph-mon[39544]: 8.0 scrub ok 2026-02-24T08:00:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:00 trial016 ceph-mon[39544]: 8.2 scrub starts 2026-02-24T08:00:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:00 trial016 ceph-mon[39544]: 8.2 scrub ok 2026-02-24T08:00:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:00 trial016 ceph-mon[39544]: pgmap v492: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 79 MiB/s wr, 10.05k op/s 2026-02-24T08:00:00.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:00 trial016 ceph-mon[39544]: osdmap e122: 4 total, 4 up, 4 in 2026-02-24T08:00:00.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 127 638374 638247 71.2266 78.3516 0.0100953 0.0140361 2026-02-24T08:00:00.956 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:01.107 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:01.252 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:01.249+0000 7f6016415640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:01.252 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:01.250+0000 7f6016415640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T08:00:01.252 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:00:01.268 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:01.269 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:01.295 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:01.296 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:01.330 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:01.331 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:01.350 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:01.350 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:01.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 648231 648103 71.3079 77 0.00500109 0.0140208 2026-02-24T08:00:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:02 trial016 ceph-mon[39544]: 8.7 scrub starts 2026-02-24T08:00:02.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:02 trial016 ceph-mon[39544]: 8.6 scrub starts 2026-02-24T08:00:02.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2128566019' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:02.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:02 trial016 ceph-mon[39544]: pgmap v494: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.88k op/s 2026-02-24T08:00:02.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:02.526 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:02.527 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:02.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 128 657170 657042 71.2874 69.8359 0.0155567 0.0140247 2026-02-24T08:00:02.683 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:03 trial016 ceph-mon[39544]: 8.6 scrub ok 2026-02-24T08:00:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:03 trial016 ceph-mon[39544]: 8.f scrub starts 2026-02-24T08:00:03.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:03 trial016 ceph-mon[39544]: 8.7 scrub ok 2026-02-24T08:00:03.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:03.041+0000 7f1fc452f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:03.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:03.041+0000 7f1fc452f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:03.199 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:03.200 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:03.421 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:03.486 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2026-02-24T08:00:01.849922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5019181600,"num_objects":76582,"num_object_clones":0,"num_object_copies":229746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76582,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":612756,"num_write_kb":4903118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20706108,"kb_used_data":14618860,"kb_used_omap":64,"kb_used_meta":6087103,"kb_avail":2915306692,"statfs":{"total":3006477107200,"available":2985274052608,"internally_reserved":0,"allocated":14969712640,"data_stored":14967535980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65819,"internal_metadata":6233194213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,10,20,11,21,23],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":319791104,"num_objects":4882,"num_object_clones":0,"num_object_copies":14646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39037,"num_write_kb":312296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001105"},"pg_stats":[{"pgid":"8.f","version":"121'37896","reported_seq":37928,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.969543+0000","last_change":"2026-02-24T07:58:48.944947+0000","last_active":"2026-02-24T07:59:57.969543+0000","last_peered":"2026-02-24T07:59:57.969543+0000","last_clean":"2026-02-24T07:59:57.969543+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T07:59:57.969543+0000","last_undegraded":"2026-02-24T07:59:57.969543+0000","last_fullsized":"2026-02-24T07:59:57.969543+0000","mapping_epoch":110,"log_start":"121'37888","ondisk_log_start":"121'37888","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310444032,"num_objects":4737,"num_object_clones":0,"num_object_copies":14211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37896,"num_write_kb":303168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"121'38224","reported_seq":38256,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.990833+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T07:59:57.990833+0000","last_peered":"2026-02-24T07:59:57.990833+0000","last_clean":"2026-02-24T07:59:57.990833+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T07:59:57.990833+0000","last_undegraded":"2026-02-24T07:59:57.990833+0000","last_fullsized":"2026-02-24T07:59:57.990833+0000","mapping_epoch":110,"log_start":"121'38194","ondisk_log_start":"121'38194","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":3000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313131008,"num_objects":4778,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38224,"num_write_kb":305792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"121'38160","reported_seq":38192,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.875203+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T07:59:57.875203+0000","last_peered":"2026-02-24T07:59:57.875203+0000","last_clean":"2026-02-24T07:59:57.875203+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T07:59:57.875203+0000","last_undegraded":"2026-02-24T07:59:57.875203+0000","last_fullsized":"2026-02-24T07:59:57.875203+0000","mapping_epoch":110,"log_start":"121'38144","ondisk_log_start":"121'38144","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312606720,"num_objects":4770,"num_object_clones":0,"num_object_copies":14310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38160,"num_write_kb":305280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"121'38072","reported_seq":38104,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.990388+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T07:59:57.990388+0000","last_peered":"2026-02-24T07:59:57.990388+0000","last_clean":"2026-02-24T07:59:57.990388+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T07:59:57.990388+0000","last_undegraded":"2026-02-24T07:59:57.990388+0000","last_fullsized":"2026-02-24T07:59:57.990388+0000","mapping_epoch":110,"log_start":"121'38056","ondisk_log_start":"121'38056","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311885824,"num_objects":4759,"num_object_clones":0,"num_object_copies":14277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38072,"num_write_kb":304576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"121'37816","reported_seq":37902,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.989603+0000","last_change":"2026-02-24T07:59:54.895438+0000","last_active":"2026-02-24T07:59:57.989603+0000","last_peered":"2026-02-24T07:59:57.989603+0000","last_clean":"2026-02-24T07:59:57.989603+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T07:59:57.989603+0000","last_undegraded":"2026-02-24T07:59:57.989603+0000","last_fullsized":"2026-02-24T07:59:57.989603+0000","mapping_epoch":110,"log_start":"121'37792","ondisk_log_start":"121'37792","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'36472","last_scrub_stamp":"2026-02-24T07:59:54.895389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:54.895389+0000","objects_scrubbed":4517,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.286954+0000","scrub_duration":1730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309788672,"num_objects":4727,"num_object_clones":0,"num_object_copies":14181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37816,"num_write_kb":302528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"121'38203","reported_seq":38230,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:58.115934+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T07:59:58.115934+0000","last_peered":"2026-02-24T07:59:58.115934+0000","last_clean":"2026-02-24T07:59:58.115934+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T07:59:58.115934+0000","last_undegraded":"2026-02-24T07:59:58.115934+0000","last_fullsized":"2026-02-24T07:59:58.115934+0000","mapping_epoch":110,"log_start":"121'38193","ondisk_log_start":"121'38193","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:59.821433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312958976,"num_objects":4776,"num_object_clones":0,"num_object_copies":14328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38203,"num_write_kb":305624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"121'37904","reported_seq":37936,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.876944+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T07:59:57.876944+0000","last_peered":"2026-02-24T07:59:57.876944+0000","last_clean":"2026-02-24T07:59:57.876944+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T07:59:57.876944+0000","last_undegraded":"2026-02-24T07:59:57.876944+0000","last_fullsized":"2026-02-24T07:59:57.876944+0000","mapping_epoch":110,"log_start":"121'37886","ondisk_log_start":"121'37886","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:01.396044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310509568,"num_objects":4738,"num_object_clones":0,"num_object_copies":14214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37904,"num_write_kb":303232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'38096","reported_seq":38128,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:58.108598+0000","last_change":"2026-02-24T07:58:48.944388+0000","last_active":"2026-02-24T07:59:58.108598+0000","last_peered":"2026-02-24T07:59:58.108598+0000","last_clean":"2026-02-24T07:59:58.108598+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T07:59:58.108598+0000","last_undegraded":"2026-02-24T07:59:58.108598+0000","last_fullsized":"2026-02-24T07:59:58.108598+0000","mapping_epoch":110,"log_start":"121'38092","ondisk_log_start":"121'38092","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312082432,"num_objects":4762,"num_object_clones":0,"num_object_copies":14286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38096,"num_write_kb":304768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"121'39800","reported_seq":39832,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.998260+0000","last_change":"2026-02-24T07:58:48.946096+0000","last_active":"2026-02-24T07:59:57.998260+0000","last_peered":"2026-02-24T07:59:57.998260+0000","last_clean":"2026-02-24T07:59:57.998260+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T07:59:57.998260+0000","last_undegraded":"2026-02-24T07:59:57.998260+0000","last_fullsized":"2026-02-24T07:59:57.998260+0000","mapping_epoch":110,"log_start":"121'39797","ondisk_log_start":"121'39797","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326041600,"num_objects":4975,"num_object_clones":0,"num_object_copies":14925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39800,"num_write_kb":318400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"121'38536","reported_seq":38567,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.881079+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T07:59:57.881079+0000","last_peered":"2026-02-24T07:59:57.881079+0000","last_clean":"2026-02-24T07:59:57.881079+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T07:59:57.881079+0000","last_undegraded":"2026-02-24T07:59:57.881079+0000","last_fullsized":"2026-02-24T07:59:57.881079+0000","mapping_epoch":110,"log_start":"121'38533","ondisk_log_start":"121'38533","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315686912,"num_objects":4817,"num_object_clones":0,"num_object_copies":14451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38536,"num_write_kb":308288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"121'38064","reported_seq":38096,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.877471+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T07:59:57.877471+0000","last_peered":"2026-02-24T07:59:57.877471+0000","last_clean":"2026-02-24T07:59:57.877471+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T07:59:57.877471+0000","last_undegraded":"2026-02-24T07:59:57.877471+0000","last_fullsized":"2026-02-24T07:59:57.877471+0000","mapping_epoch":110,"log_start":"121'38056","ondisk_log_start":"121'38056","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311820288,"num_objects":4758,"num_object_clones":0,"num_object_copies":14274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38064,"num_write_kb":304512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"121'38750","reported_seq":38775,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:58.119636+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T07:59:58.119636+0000","last_peered":"2026-02-24T07:59:58.119636+0000","last_clean":"2026-02-24T07:59:58.119636+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T07:59:58.119636+0000","last_undegraded":"2026-02-24T07:59:58.119636+0000","last_fullsized":"2026-02-24T07:59:58.119636+0000","mapping_epoch":110,"log_start":"121'38740","ondisk_log_start":"121'38740","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317440000,"num_objects":4844,"num_object_clones":0,"num_object_copies":14532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38750,"num_write_kb":310000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"121'38290","reported_seq":38318,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.886308+0000","last_change":"2026-02-24T07:58:48.943200+0000","last_active":"2026-02-24T07:59:57.886308+0000","last_peered":"2026-02-24T07:59:57.886308+0000","last_clean":"2026-02-24T07:59:57.886308+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T07:59:57.886308+0000","last_undegraded":"2026-02-24T07:59:57.886308+0000","last_fullsized":"2026-02-24T07:59:57.886308+0000","mapping_epoch":110,"log_start":"121'38284","ondisk_log_start":"121'38284","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313671680,"num_objects":4787,"num_object_clones":0,"num_object_copies":14361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38290,"num_write_kb":306320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"121'38066","reported_seq":38092,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:58.119387+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T07:59:58.119387+0000","last_peered":"2026-02-24T07:59:58.119387+0000","last_clean":"2026-02-24T07:59:58.119387+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T07:59:58.119387+0000","last_undegraded":"2026-02-24T07:59:58.119387+0000","last_fullsized":"2026-02-24T07:59:58.119387+0000","mapping_epoch":110,"log_start":"121'38058","ondisk_log_start":"121'38058","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311836672,"num_objects":4759,"num_object_clones":0,"num_object_copies":14277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38066,"num_write_kb":304528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"121'38520","reported_seq":38561,"reported_epoch":121,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T07:59:58.118534+0000","last_change":"2026-02-24T07:59:57.909042+0000","last_active":"2026-02-24T07:59:58.118534+0000","last_peered":"2026-02-24T07:59:58.118534+0000","last_clean":"2026-02-24T07:59:58.118534+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T07:59:58.118534+0000","last_undegraded":"2026-02-24T07:59:58.118534+0000","last_fullsized":"2026-02-24T07:59:58.118534+0000","mapping_epoch":110,"log_start":"121'38512","ondisk_log_start":"121'38512","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":1299,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315555840,"num_objects":4815,"num_object_clones":0,"num_object_copies":14445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38520,"num_write_kb":308160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"121'38224","reported_seq":38256,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:57.882305+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T07:59:57.882305+0000","last_peered":"2026-02-24T07:59:57.882305+0000","last_clean":"2026-02-24T07:59:57.882305+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T07:59:57.882305+0000","last_undegraded":"2026-02-24T07:59:57.882305+0000","last_fullsized":"2026-02-24T07:59:57.882305+0000","mapping_epoch":110,"log_start":"121'38216","ondisk_log_start":"121'38216","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313131008,"num_objects":4778,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38224,"num_write_kb":305792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":458,"reported_epoch":121,"state":"active+clean","last_fresh":"2026-02-24T07:59:54.888434+0000","last_change":"2026-02-24T07:58:49.412760+0000","last_active":"2026-02-24T07:59:54.888434+0000","last_peered":"2026-02-24T07:59:54.888434+0000","last_clean":"2026-02-24T07:59:54.888434+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:54.888434+0000","last_undegraded":"2026-02-24T07:59:54.888434+0000","last_fullsized":"2026-02-24T07:59:54.888434+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:58:49.412712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:58:49.412712+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5018591232,"num_objects":76580,"num_object_clones":0,"num_object_copies":229740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612621,"num_write_kb":4900968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15048458240,"data_stored":15048458240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215265,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4915772,"kb_used_data":3666472,"kb_used_omap":14,"kb_used_meta":1249265,"kb_avail":729087428,"statfs":{"total":751619276800,"available":746585526272,"internally_reserved":0,"allocated":3754467328,"data_stored":3753922275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14459,"internal_metadata":1279248261},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444194,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5149812,"kb_used_data":3671520,"kb_used_omap":14,"kb_used_meta":1478257,"kb_avail":728853388,"statfs":{"total":751619276800,"available":746345869312,"internally_reserved":0,"allocated":3759636480,"data_stored":3759091427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":1513736112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5276472,"kb_used_data":3353060,"kb_used_omap":18,"kb_used_meta":1923373,"kb_avail":728726728,"statfs":{"total":751619276800,"available":746216169472,"internally_reserved":0,"allocated":3433533440,"data_stored":3432991939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19251,"internal_metadata":1969534157},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705831,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5364052,"kb_used_data":3927808,"kb_used_omap":17,"kb_used_meta":1436206,"kb_avail":728639148,"statfs":{"total":751619276800,"available":746126487552,"internally_reserved":0,"allocated":4022075392,"data_stored":4021530339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17693,"internal_metadata":1470675683},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,10,20,11,21,23],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8426,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4075290624,"data_stored":4075290624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3443974144,"data_stored":3443974144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3764207616,"data_stored":3764207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3764985856,"data_stored":3764985856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:03.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 664375 664247 71.0819 56.2891 0.00840517 0.014065 2026-02-24T08:00:03.573 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:03.706 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:03.703+0000 7fe811c90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:03.706 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:03.703+0000 7fe811c90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:03.722 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:03.723 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:03.756 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:03.757 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:03.779 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:03.779 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:03.795 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:03.796 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:04 trial016 ceph-mon[39544]: from='client.15586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:04.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/876895625' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:04.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:04 trial016 ceph-mon[39544]: 8.f scrub ok 2026-02-24T08:00:04.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:04 trial016 ceph-mon[39544]: pgmap v495: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.68k op/s 2026-02-24T08:00:04.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 674329 674201 71.1721 77.7656 0.00400815 0.0140478 2026-02-24T08:00:05.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:05.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 127 683447 683320 71.1729 71.2422 0.00556277 0.0140477 2026-02-24T08:00:05.843 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:05.999 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:06.126 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:06.124+0000 7fdd835cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:06.126 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:06.124+0000 7fdd835cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:06.126 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:05 trial016 ceph-mon[39544]: osdmap e123: 4 total, 4 up, 4 in 2026-02-24T08:00:06.126 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:05 trial016 ceph-mon[39544]: 8.1 scrub starts 2026-02-24T08:00:06.144 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:06.144 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:06.162 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:06.162 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:06.177 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:06.177 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:06.189 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:06.189 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:06.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 692765 692637 71.1941 72.7891 0.010223 0.0140438 2026-02-24T08:00:07.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:00:07.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:00:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: pgmap v497: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.85k op/s 2026-02-24T08:00:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: 8.a scrub starts 2026-02-24T08:00:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/174009399' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:07.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:06 trial016 ceph-mon[39544]: 8.1 scrub ok 2026-02-24T08:00:07.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 128 702134 702006 71.2201 73.1953 0.0140603 0.0140385 2026-02-24T08:00:08.239 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:08.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:07 trial016 ceph-mon[39544]: 8.a scrub ok 2026-02-24T08:00:08.394 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:08.489 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:08.490 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:08.490 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:00:08.490 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:08.522 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:08.519+0000 7fa3ca4bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:08.522 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:08.520+0000 7fa3ca4bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:08.540 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:08.540 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:08.557 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:08.557 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:08.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 127 711970 711843 71.2922 76.8516 0.0125914 0.0140245 2026-02-24T08:00:08.575 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:08.575 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:08.590 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:08.590 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:08.652 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:08.778 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:08.776+0000 7fc7b1abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:08.778 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:08.776+0000 7fc7b1abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:08.929 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:08.930 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:08 trial016 ceph-mon[39544]: 8.5 scrub starts 2026-02-24T08:00:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:08 trial016 ceph-mon[39544]: pgmap v498: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 5.97k op/s 2026-02-24T08:00:09.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:08 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2601797754' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:09.564 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 128 719151 719023 71.0997 56.0938 0.00985741 0.0140624 2026-02-24T08:00:09.565 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2026-02-24T08:00:07.850758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5410243104,"num_objects":82547,"num_object_clones":0,"num_object_copies":247641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82547,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":660493,"num_write_kb":5285014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":20924020,"kb_used_data":15793508,"kb_used_omap":58,"kb_used_meta":5130373,"kb_avail":2915088780,"statfs":{"total":3006477107200,"available":2985050910720,"internally_reserved":0,"allocated":16172552192,"data_stored":16170343984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60384,"internal_metadata":5253501984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":391061504,"num_objects":5965,"num_object_clones":0,"num_object_copies":17895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47737,"num_write_kb":381896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001146"},"pg_stats":[{"pgid":"8.f","version":"122'41006","reported_seq":41062,"reported_epoch":122,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:00:02.986555+0000","last_change":"2026-02-24T08:00:02.220693+0000","last_active":"2026-02-24T08:00:02.986555+0000","last_peered":"2026-02-24T08:00:02.986555+0000","last_clean":"2026-02-24T08:00:02.986555+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T08:00:02.986555+0000","last_undegraded":"2026-02-24T08:00:02.986555+0000","last_fullsized":"2026-02-24T08:00:02.986555+0000","mapping_epoch":110,"log_start":"122'40992","ondisk_log_start":"122'40992","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":3199,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335921152,"num_objects":5126,"num_object_clones":0,"num_object_copies":15378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41006,"num_write_kb":328048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"122'41176","reported_seq":41210,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.957727+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T08:00:02.957727+0000","last_peered":"2026-02-24T08:00:02.957727+0000","last_clean":"2026-02-24T08:00:02.957727+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T08:00:02.957727+0000","last_undegraded":"2026-02-24T08:00:02.957727+0000","last_fullsized":"2026-02-24T08:00:02.957727+0000","mapping_epoch":110,"log_start":"122'41160","ondisk_log_start":"122'41160","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337313792,"num_objects":5147,"num_object_clones":0,"num_object_copies":15441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41176,"num_write_kb":329408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"122'41224","reported_seq":41249,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.887829+0000","last_change":"2026-02-24T07:58:48.943020+0000","last_active":"2026-02-24T08:00:02.887829+0000","last_peered":"2026-02-24T08:00:02.887829+0000","last_clean":"2026-02-24T08:00:02.887829+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T08:00:02.887829+0000","last_undegraded":"2026-02-24T08:00:02.887829+0000","last_fullsized":"2026-02-24T08:00:02.887829+0000","mapping_epoch":110,"log_start":"122'41190","ondisk_log_start":"122'41190","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337707008,"num_objects":5153,"num_object_clones":0,"num_object_copies":15459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41224,"num_write_kb":329792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"122'41168","reported_seq":41202,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.984812+0000","last_change":"2026-02-24T07:58:48.944538+0000","last_active":"2026-02-24T08:00:02.984812+0000","last_peered":"2026-02-24T08:00:02.984812+0000","last_clean":"2026-02-24T08:00:02.984812+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T08:00:02.984812+0000","last_undegraded":"2026-02-24T08:00:02.984812+0000","last_fullsized":"2026-02-24T08:00:02.984812+0000","mapping_epoch":110,"log_start":"122'41144","ondisk_log_start":"122'41144","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:08.871885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41168,"num_write_kb":329344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"122'40720","reported_seq":40808,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.957566+0000","last_change":"2026-02-24T07:59:54.895438+0000","last_active":"2026-02-24T08:00:02.957566+0000","last_peered":"2026-02-24T08:00:02.957566+0000","last_clean":"2026-02-24T08:00:02.957566+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T08:00:02.957566+0000","last_undegraded":"2026-02-24T08:00:02.957566+0000","last_fullsized":"2026-02-24T08:00:02.957566+0000","mapping_epoch":110,"log_start":"122'40704","ondisk_log_start":"122'40704","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'36472","last_scrub_stamp":"2026-02-24T07:59:54.895389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:54.895389+0000","objects_scrubbed":4517,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.286954+0000","scrub_duration":1730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333578240,"num_objects":5090,"num_object_clones":0,"num_object_copies":15270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":325760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"122'41168","reported_seq":41202,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.112067+0000","last_change":"2026-02-24T07:58:48.944116+0000","last_active":"2026-02-24T08:00:03.112067+0000","last_peered":"2026-02-24T08:00:03.112067+0000","last_clean":"2026-02-24T08:00:03.112067+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T08:00:03.112067+0000","last_undegraded":"2026-02-24T08:00:03.112067+0000","last_fullsized":"2026-02-24T08:00:03.112067+0000","mapping_epoch":110,"log_start":"122'41160","ondisk_log_start":"122'41160","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41168,"num_write_kb":329344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"122'40960","reported_seq":40994,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.844520+0000","last_change":"2026-02-24T07:58:48.943357+0000","last_active":"2026-02-24T08:00:02.844520+0000","last_peered":"2026-02-24T08:00:02.844520+0000","last_clean":"2026-02-24T08:00:02.844520+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T08:00:02.844520+0000","last_undegraded":"2026-02-24T08:00:02.844520+0000","last_fullsized":"2026-02-24T08:00:02.844520+0000","mapping_epoch":110,"log_start":"122'40952","ondisk_log_start":"122'40952","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":5120,"num_object_clones":0,"num_object_copies":15360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40960,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"122'40784","reported_seq":40878,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.112142+0000","last_change":"2026-02-24T08:00:02.297631+0000","last_active":"2026-02-24T08:00:03.112142+0000","last_peered":"2026-02-24T08:00:03.112142+0000","last_clean":"2026-02-24T08:00:03.112142+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T08:00:03.112142+0000","last_undegraded":"2026-02-24T08:00:03.112142+0000","last_fullsized":"2026-02-24T08:00:03.112142+0000","mapping_epoch":110,"log_start":"122'40760","ondisk_log_start":"122'40760","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'40425","last_scrub_stamp":"2026-02-24T08:00:02.297527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.297527+0000","objects_scrubbed":5020,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:05.712742+0000","scrub_duration":1377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334102528,"num_objects":5098,"num_object_clones":0,"num_object_copies":15294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40784,"num_write_kb":326272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"122'42648","reported_seq":42742,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.000808+0000","last_change":"2026-02-24T08:00:02.085116+0000","last_active":"2026-02-24T08:00:03.000808+0000","last_peered":"2026-02-24T08:00:03.000808+0000","last_clean":"2026-02-24T08:00:03.000808+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T08:00:03.000808+0000","last_undegraded":"2026-02-24T08:00:03.000808+0000","last_fullsized":"2026-02-24T08:00:03.000808+0000","mapping_epoch":110,"log_start":"122'42645","ondisk_log_start":"122'42645","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'42176","last_scrub_stamp":"2026-02-24T08:00:02.084983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.084983+0000","objects_scrubbed":5245,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:09.377303+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349372416,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42648,"num_write_kb":341184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"122'41552","reported_seq":41586,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.825654+0000","last_change":"2026-02-24T07:58:48.942886+0000","last_active":"2026-02-24T08:00:02.825654+0000","last_peered":"2026-02-24T08:00:02.825654+0000","last_clean":"2026-02-24T08:00:02.825654+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T08:00:02.825654+0000","last_undegraded":"2026-02-24T08:00:02.825654+0000","last_fullsized":"2026-02-24T08:00:02.825654+0000","mapping_epoch":110,"log_start":"122'41544","ondisk_log_start":"122'41544","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:06.887552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340393984,"num_objects":5194,"num_object_clones":0,"num_object_copies":15582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41552,"num_write_kb":332416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"122'41160","reported_seq":41194,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.848466+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T08:00:02.848466+0000","last_peered":"2026-02-24T08:00:02.848466+0000","last_clean":"2026-02-24T08:00:02.848466+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T08:00:02.848466+0000","last_undegraded":"2026-02-24T08:00:02.848466+0000","last_fullsized":"2026-02-24T08:00:02.848466+0000","mapping_epoch":110,"log_start":"122'41152","ondisk_log_start":"122'41152","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337182720,"num_objects":5145,"num_object_clones":0,"num_object_copies":15435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41160,"num_write_kb":329280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"122'41552","reported_seq":41586,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.118736+0000","last_change":"2026-02-24T07:58:48.944277+0000","last_active":"2026-02-24T08:00:03.118736+0000","last_peered":"2026-02-24T08:00:03.118736+0000","last_clean":"2026-02-24T08:00:03.118736+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T08:00:03.118736+0000","last_undegraded":"2026-02-24T08:00:03.118736+0000","last_fullsized":"2026-02-24T08:00:03.118736+0000","mapping_epoch":110,"log_start":"122'41549","ondisk_log_start":"122'41549","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:07.863631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340393984,"num_objects":5194,"num_object_clones":0,"num_object_copies":15582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41552,"num_write_kb":332416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"122'41432","reported_seq":41519,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.887978+0000","last_change":"2026-02-24T07:59:59.391367+0000","last_active":"2026-02-24T08:00:02.887978+0000","last_peered":"2026-02-24T08:00:02.887978+0000","last_clean":"2026-02-24T08:00:02.887978+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T08:00:02.887978+0000","last_undegraded":"2026-02-24T08:00:02.887978+0000","last_fullsized":"2026-02-24T08:00:02.887978+0000","mapping_epoch":110,"log_start":"122'41424","ondisk_log_start":"122'41424","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'39272","last_scrub_stamp":"2026-02-24T07:59:59.391300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.391300+0000","objects_scrubbed":4891,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:00.737911+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339410944,"num_objects":5179,"num_object_clones":0,"num_object_copies":15537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41432,"num_write_kb":331456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"122'41184","reported_seq":41218,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.112867+0000","last_change":"2026-02-24T07:58:48.945891+0000","last_active":"2026-02-24T08:00:03.112867+0000","last_peered":"2026-02-24T08:00:03.112867+0000","last_clean":"2026-02-24T08:00:03.112867+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T08:00:03.112867+0000","last_undegraded":"2026-02-24T08:00:03.112867+0000","last_fullsized":"2026-02-24T08:00:03.112867+0000","mapping_epoch":110,"log_start":"122'41168","ondisk_log_start":"122'41168","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337379328,"num_objects":5148,"num_object_clones":0,"num_object_copies":15444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41184,"num_write_kb":329472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"122'41336","reported_seq":41428,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:03.108348+0000","last_change":"2026-02-24T07:59:58.704102+0000","last_active":"2026-02-24T08:00:03.108348+0000","last_peered":"2026-02-24T08:00:03.108348+0000","last_clean":"2026-02-24T08:00:03.108348+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T08:00:03.108348+0000","last_undegraded":"2026-02-24T08:00:03.108348+0000","last_fullsized":"2026-02-24T08:00:03.108348+0000","mapping_epoch":110,"log_start":"122'41332","ondisk_log_start":"122'41332","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'38848","last_scrub_stamp":"2026-02-24T07:59:58.704051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:58.704051+0000","objects_scrubbed":4831,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:04.646942+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338624512,"num_objects":5167,"num_object_clones":0,"num_object_copies":15501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41336,"num_write_kb":330688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"122'41288","reported_seq":41307,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T08:00:02.843246+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T08:00:02.843246+0000","last_peered":"2026-02-24T08:00:02.843246+0000","last_clean":"2026-02-24T08:00:02.843246+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T08:00:02.843246+0000","last_undegraded":"2026-02-24T08:00:02.843246+0000","last_fullsized":"2026-02-24T08:00:02.843246+0000","mapping_epoch":110,"log_start":"122'41272","ondisk_log_start":"122'41272","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338231296,"num_objects":5161,"num_object_clones":0,"num_object_copies":15483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41288,"num_write_kb":330304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":468,"reported_epoch":122,"state":"active+clean","last_fresh":"2026-02-24T07:59:59.889540+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T07:59:59.889540+0000","last_peered":"2026-02-24T07:59:59.889540+0000","last_clean":"2026-02-24T07:59:59.889540+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T07:59:59.889540+0000","last_undegraded":"2026-02-24T07:59:59.889540+0000","last_fullsized":"2026-02-24T07:59:59.889540+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5409652736,"num_objects":82545,"num_object_clones":0,"num_object_copies":247635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660358,"num_write_kb":5282864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16225878016,"data_stored":16225878016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12394,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215266,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5285400,"kb_used_data":3963908,"kb_used_omap":14,"kb_used_meta":1321457,"kb_avail":728717800,"statfs":{"total":751619276800,"available":746207027200,"internally_reserved":0,"allocated":4059041792,"data_stored":4058488852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15167,"internal_metadata":1353172161},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444195,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5292640,"kb_used_data":3959052,"kb_used_omap":14,"kb_used_meta":1333553,"kb_avail":728710560,"statfs":{"total":751619276800,"available":746199613440,"internally_reserved":0,"allocated":4054069248,"data_stored":4053516308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15068,"internal_metadata":1365558564},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4568604,"kb_used_data":3619656,"kb_used_omap":11,"kb_used_meta":948916,"kb_avail":729434596,"statfs":{"total":751619276800,"available":746941026304,"internally_reserved":0,"allocated":3706527744,"data_stored":3705978356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11804,"internal_metadata":971690468},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705832,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5777376,"kb_used_data":4250892,"kb_used_omap":17,"kb_used_meta":1526446,"kb_avail":728225824,"statfs":{"total":751619276800,"available":745703243776,"internally_reserved":0,"allocated":4352913408,"data_stored":4352360468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18345,"internal_metadata":1563080791},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12394,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4393705472,"data_stored":4393705472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3711385600,"data_stored":3711385600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4061413376,"data_stored":4061413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4059373568,"data_stored":4059373568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:09.566 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:00:09.566 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 271 2026-02-24T08:00:09.755 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:10.124 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:10.081+0000 7fb62f626640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:10.125 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:10.081+0000 7fb62f626640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:10.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:09 trial016 ceph-mon[39544]: 8.5 scrub ok 2026-02-24T08:00:10.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:09 trial016 ceph-mon[39544]: 8.8 scrub starts 2026-02-24T08:00:10.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:09 trial016 ceph-mon[39544]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:10.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:09 trial016 ceph-mon[39544]: 8.3 scrub starts 2026-02-24T08:00:10.125 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:09 trial016 ceph-mon[39544]: osdmap e124: 4 total, 4 up, 4 in 2026-02-24T08:00:10.229 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:00:10.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:10.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T08:00:10.564033+0000 min lat: 0.000630903 max lat: 0.136937 avg lat: 0.0140961 2026-02-24T08:00:10.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:00:10.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 726488 726360 70.9274 57.3203 0.0085912 0.0140961 2026-02-24T08:00:10.637 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:10.792 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:10.919 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:10.917+0000 7f1a738a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:10.920 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:10.918+0000 7f1a738a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:10.920 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:10 trial016 ceph-mon[39544]: 8.3 scrub ok 2026-02-24T08:00:10.920 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:10 trial016 ceph-mon[39544]: 8.d scrub starts 2026-02-24T08:00:10.920 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:10 trial016 ceph-mon[39544]: pgmap v499: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.42k op/s 2026-02-24T08:00:10.920 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:10 trial016 ceph-mon[39544]: 8.8 scrub ok 2026-02-24T08:00:10.920 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/37957938' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "271"} : dispatch 2026-02-24T08:00:10.942 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:10.943 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:10.957 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:10.957 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:10.975 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:10.975 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:10.990 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:10.990 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:11.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 128 735937 735809 70.9631 73.8203 0.0107726 0.0140893 2026-02-24T08:00:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:11 trial016 ceph-mon[39544]: 8.c scrub starts 2026-02-24T08:00:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:11 trial016 ceph-mon[39544]: 8.d scrub ok 2026-02-24T08:00:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1143358678' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:12.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 745691 745563 71.0269 76.2031 0.00275412 0.0140766 2026-02-24T08:00:13.038 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:13.192 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:13.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:12 trial016 ceph-mon[39544]: 8.c scrub ok 2026-02-24T08:00:13.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:12 trial016 ceph-mon[39544]: pgmap v501: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 45 MiB/s wr, 5.76k op/s 2026-02-24T08:00:13.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 128 754199 754071 70.9719 66.4688 0.0117817 0.0140842 2026-02-24T08:00:13.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:13.564+0000 7fc7b527f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:13.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:13.564+0000 7fc7b527f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:13.601 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:13.601 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:13.602 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:13.602 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:13.618 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:13.619 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:13.635 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:13.636 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1633246515' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:14.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 127 762528 762401 70.9017 65.0781 0.0368547 0.014101 2026-02-24T08:00:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:14 trial016 ceph-mon[39544]: pgmap v502: 17 pgs: 17 active+clean; 5.7 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s wr, 9.98k op/s 2026-02-24T08:00:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:14 trial016 ceph-mon[39544]: osdmap e125: 4 total, 4 up, 4 in 2026-02-24T08:00:15.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:15.369 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:15.369 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:15.369 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:00:15.370 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:15.520 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:15.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 771814 771686 70.9209 72.5391 0.00811753 0.0140975 2026-02-24T08:00:15.942 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:15.901+0000 7f07ee69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:15.942 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:15.901+0000 7f07ee69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:16.052 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:16.052 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:16.053 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:15 trial016 ceph-mon[39544]: 8.9 scrub starts 2026-02-24T08:00:16.068 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:16.206 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:16.213 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":504,"stamp":"2026-02-24T08:00:15.851846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6143205920,"num_objects":93732,"num_object_clones":0,"num_object_copies":281196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93732,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":749966,"num_write_kb":6000798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23435324,"kb_used_data":17926060,"kb_used_omap":63,"kb_used_meta":5509120,"kb_avail":2912577476,"statfs":{"total":3006477107200,"available":2982479335424,"internally_reserved":0,"allocated":18356285440,"data_stored":18354014136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64953,"internal_metadata":5641339463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,18,38,47,6,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":732962816,"num_objects":11185,"num_object_clones":0,"num_object_copies":33555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89473,"num_write_kb":715784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001088"},"pg_stats":[{"pgid":"8.f","version":"124'46816","reported_seq":46903,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.992658+0000","last_change":"2026-02-24T08:00:03.719845+0000","last_active":"2026-02-24T08:00:12.992658+0000","last_peered":"2026-02-24T08:00:12.992658+0000","last_clean":"2026-02-24T08:00:12.992658+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T08:00:12.992658+0000","last_undegraded":"2026-02-24T08:00:12.992658+0000","last_fullsized":"2026-02-24T08:00:12.992658+0000","mapping_epoch":110,"log_start":"124'46792","ondisk_log_start":"124'46792","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'41360","last_scrub_stamp":"2026-02-24T08:00:03.719751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:03.719751+0000","objects_scrubbed":5124,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.145365+0000","scrub_duration":1498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383516672,"num_objects":5852,"num_object_clones":0,"num_object_copies":17556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46816,"num_write_kb":374528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"124'46624","reported_seq":46662,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.982200+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T08:00:12.982200+0000","last_peered":"2026-02-24T08:00:12.982200+0000","last_clean":"2026-02-24T08:00:12.982200+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T08:00:12.982200+0000","last_undegraded":"2026-02-24T08:00:12.982200+0000","last_fullsized":"2026-02-24T08:00:12.982200+0000","mapping_epoch":110,"log_start":"124'46616","ondisk_log_start":"124'46616","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:16.398799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381943808,"num_objects":5828,"num_object_clones":0,"num_object_copies":17484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46624,"num_write_kb":372992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"124'46976","reported_seq":47076,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.887793+0000","last_change":"2026-02-24T08:00:10.891274+0000","last_active":"2026-02-24T08:00:12.887793+0000","last_peered":"2026-02-24T08:00:12.887793+0000","last_clean":"2026-02-24T08:00:12.887793+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T08:00:12.887793+0000","last_undegraded":"2026-02-24T08:00:12.887793+0000","last_fullsized":"2026-02-24T08:00:12.887793+0000","mapping_epoch":110,"log_start":"124'46969","ondisk_log_start":"124'46969","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45738","last_scrub_stamp":"2026-02-24T08:00:10.891178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.891178+0000","objects_scrubbed":5681,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.537731+0000","scrub_duration":1154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384827392,"num_objects":5872,"num_object_clones":0,"num_object_copies":17616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46976,"num_write_kb":375808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"124'47176","reported_seq":47280,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.985432+0000","last_change":"2026-02-24T08:00:11.621552+0000","last_active":"2026-02-24T08:00:12.985432+0000","last_peered":"2026-02-24T08:00:12.985432+0000","last_clean":"2026-02-24T08:00:12.985432+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T08:00:12.985432+0000","last_undegraded":"2026-02-24T08:00:12.985432+0000","last_fullsized":"2026-02-24T08:00:12.985432+0000","mapping_epoch":110,"log_start":"124'47168","ondisk_log_start":"124'47168","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'46331","last_scrub_stamp":"2026-02-24T08:00:11.621479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:11.621479+0000","objects_scrubbed":5754,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:30.973054+0000","scrub_duration":1310,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386465792,"num_objects":5897,"num_object_clones":0,"num_object_copies":17691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47176,"num_write_kb":377408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"124'46152","reported_seq":46238,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.990428+0000","last_change":"2026-02-24T07:59:54.895438+0000","last_active":"2026-02-24T08:00:12.990428+0000","last_peered":"2026-02-24T08:00:12.990428+0000","last_clean":"2026-02-24T08:00:12.990428+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T08:00:12.990428+0000","last_undegraded":"2026-02-24T08:00:12.990428+0000","last_fullsized":"2026-02-24T08:00:12.990428+0000","mapping_epoch":110,"log_start":"124'46143","ondisk_log_start":"124'46143","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'36472","last_scrub_stamp":"2026-02-24T07:59:54.895389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:54.895389+0000","objects_scrubbed":4517,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.286954+0000","scrub_duration":1730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378077184,"num_objects":5769,"num_object_clones":0,"num_object_copies":17307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46152,"num_write_kb":369216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"124'46870","reported_seq":46965,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:13.111095+0000","last_change":"2026-02-24T08:00:07.298828+0000","last_active":"2026-02-24T08:00:13.111095+0000","last_peered":"2026-02-24T08:00:13.111095+0000","last_clean":"2026-02-24T08:00:13.111095+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T08:00:13.111095+0000","last_undegraded":"2026-02-24T08:00:13.111095+0000","last_fullsized":"2026-02-24T08:00:13.111095+0000","mapping_epoch":110,"log_start":"124'46862","ondisk_log_start":"124'46862","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43506","last_scrub_stamp":"2026-02-24T08:00:07.298720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:07.298720+0000","objects_scrubbed":5401,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:33.726929+0000","scrub_duration":1362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383959040,"num_objects":5859,"num_object_clones":0,"num_object_copies":17577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46870,"num_write_kb":374960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"124'46552","reported_seq":46654,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.879618+0000","last_change":"2026-02-24T08:00:10.035546+0000","last_active":"2026-02-24T08:00:12.879618+0000","last_peered":"2026-02-24T08:00:12.879618+0000","last_clean":"2026-02-24T08:00:12.879618+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T08:00:12.879618+0000","last_undegraded":"2026-02-24T08:00:12.879618+0000","last_fullsized":"2026-02-24T08:00:12.879618+0000","mapping_epoch":110,"log_start":"124'46539","ondisk_log_start":"124'46539","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45000","last_scrub_stamp":"2026-02-24T08:00:10.035513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.035513+0000","objects_scrubbed":5585,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:21.946015+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381353984,"num_objects":5819,"num_object_clones":0,"num_object_copies":17457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5819,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46552,"num_write_kb":372416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"124'46318","reported_seq":46410,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:13.108629+0000","last_change":"2026-02-24T08:00:02.297631+0000","last_active":"2026-02-24T08:00:13.108629+0000","last_peered":"2026-02-24T08:00:13.108629+0000","last_clean":"2026-02-24T08:00:13.108629+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T08:00:13.108629+0000","last_undegraded":"2026-02-24T08:00:13.108629+0000","last_fullsized":"2026-02-24T08:00:13.108629+0000","mapping_epoch":110,"log_start":"124'46310","ondisk_log_start":"124'46310","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'40425","last_scrub_stamp":"2026-02-24T08:00:02.297527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.297527+0000","objects_scrubbed":5020,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:05.712742+0000","scrub_duration":1377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379437056,"num_objects":5790,"num_object_clones":0,"num_object_copies":17370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46318,"num_write_kb":370544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"124'48080","reported_seq":48179,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.999833+0000","last_change":"2026-02-24T08:00:02.085116+0000","last_active":"2026-02-24T08:00:12.999833+0000","last_peered":"2026-02-24T08:00:12.999833+0000","last_clean":"2026-02-24T08:00:12.999833+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T08:00:12.999833+0000","last_undegraded":"2026-02-24T08:00:12.999833+0000","last_fullsized":"2026-02-24T08:00:12.999833+0000","mapping_epoch":110,"log_start":"124'48073","ondisk_log_start":"124'48073","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'42176","last_scrub_stamp":"2026-02-24T08:00:02.084983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.084983+0000","objects_scrubbed":5245,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:09.377303+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393871360,"num_objects":6010,"num_object_clones":0,"num_object_copies":18030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48080,"num_write_kb":384640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"124'46896","reported_seq":46998,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.853057+0000","last_change":"2026-02-24T08:00:08.615366+0000","last_active":"2026-02-24T08:00:12.853057+0000","last_peered":"2026-02-24T08:00:12.853057+0000","last_clean":"2026-02-24T08:00:12.853057+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T08:00:12.853057+0000","last_undegraded":"2026-02-24T08:00:12.853057+0000","last_fullsized":"2026-02-24T08:00:12.853057+0000","mapping_epoch":110,"log_start":"124'46880","ondisk_log_start":"124'46880","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44936","last_scrub_stamp":"2026-02-24T08:00:08.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:08.615310+0000","objects_scrubbed":5577,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.807357+0000","scrub_duration":817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":384172032,"num_objects":5862,"num_object_clones":0,"num_object_copies":17586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46896,"num_write_kb":375168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"124'46304","reported_seq":46340,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.888466+0000","last_change":"2026-02-24T07:58:48.944006+0000","last_active":"2026-02-24T08:00:12.888466+0000","last_peered":"2026-02-24T08:00:12.888466+0000","last_clean":"2026-02-24T08:00:12.888466+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T08:00:12.888466+0000","last_undegraded":"2026-02-24T08:00:12.888466+0000","last_fullsized":"2026-02-24T08:00:12.888466+0000","mapping_epoch":110,"log_start":"124'46296","ondisk_log_start":"124'46296","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:14.459262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379322368,"num_objects":5788,"num_object_clones":0,"num_object_copies":17364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46304,"num_write_kb":370432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"124'47136","reported_seq":47238,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:13.119589+0000","last_change":"2026-02-24T08:00:09.724097+0000","last_active":"2026-02-24T08:00:13.119589+0000","last_peered":"2026-02-24T08:00:13.119589+0000","last_clean":"2026-02-24T08:00:13.119589+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T08:00:13.119589+0000","last_undegraded":"2026-02-24T08:00:13.119589+0000","last_fullsized":"2026-02-24T08:00:13.119589+0000","mapping_epoch":110,"log_start":"124'47122","ondisk_log_start":"124'47122","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44960","last_scrub_stamp":"2026-02-24T08:00:09.724011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:09.724011+0000","objects_scrubbed":5604,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.314262+0000","scrub_duration":777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386138112,"num_objects":5892,"num_object_clones":0,"num_object_copies":17676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47136,"num_write_kb":377088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"124'46568","reported_seq":46662,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.853202+0000","last_change":"2026-02-24T07:59:59.391367+0000","last_active":"2026-02-24T08:00:12.853202+0000","last_peered":"2026-02-24T08:00:12.853202+0000","last_clean":"2026-02-24T08:00:12.853202+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T08:00:12.853202+0000","last_undegraded":"2026-02-24T08:00:12.853202+0000","last_fullsized":"2026-02-24T08:00:12.853202+0000","mapping_epoch":110,"log_start":"124'46561","ondisk_log_start":"124'46561","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'39272","last_scrub_stamp":"2026-02-24T07:59:59.391300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.391300+0000","objects_scrubbed":4891,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:00.737911+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381485056,"num_objects":5821,"num_object_clones":0,"num_object_copies":17463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46568,"num_write_kb":372544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"124'47115","reported_seq":47208,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:13.110494+0000","last_change":"2026-02-24T08:00:06.420923+0000","last_active":"2026-02-24T08:00:13.110494+0000","last_peered":"2026-02-24T08:00:13.110494+0000","last_clean":"2026-02-24T08:00:13.110494+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T08:00:13.110494+0000","last_undegraded":"2026-02-24T08:00:13.110494+0000","last_fullsized":"2026-02-24T08:00:13.110494+0000","mapping_epoch":110,"log_start":"124'47108","ondisk_log_start":"124'47108","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43184","last_scrub_stamp":"2026-02-24T08:00:06.420846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:06.420846+0000","objects_scrubbed":5336,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:25.741960+0000","scrub_duration":1450,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385966080,"num_objects":5890,"num_object_clones":0,"num_object_copies":17670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47115,"num_write_kb":376920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"124'46832","reported_seq":46928,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:13.106987+0000","last_change":"2026-02-24T07:59:58.704102+0000","last_active":"2026-02-24T08:00:13.106987+0000","last_peered":"2026-02-24T08:00:13.106987+0000","last_clean":"2026-02-24T08:00:13.106987+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T08:00:13.106987+0000","last_undegraded":"2026-02-24T08:00:13.106987+0000","last_fullsized":"2026-02-24T08:00:13.106987+0000","mapping_epoch":110,"log_start":"124'46824","ondisk_log_start":"124'46824","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'38848","last_scrub_stamp":"2026-02-24T07:59:58.704051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:58.704051+0000","objects_scrubbed":4831,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:04.646942+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383647744,"num_objects":5854,"num_object_clones":0,"num_object_copies":17562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46832,"num_write_kb":374656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"124'47416","reported_seq":47454,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:12.883205+0000","last_change":"2026-02-24T07:58:48.944004+0000","last_active":"2026-02-24T08:00:12.883205+0000","last_peered":"2026-02-24T08:00:12.883205+0000","last_clean":"2026-02-24T08:00:12.883205+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T08:00:12.883205+0000","last_undegraded":"2026-02-24T08:00:12.883205+0000","last_fullsized":"2026-02-24T08:00:12.883205+0000","mapping_epoch":110,"log_start":"124'47408","ondisk_log_start":"124'47408","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:13.086810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388431872,"num_objects":5927,"num_object_clones":0,"num_object_copies":17781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47416,"num_write_kb":379328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":472,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-24T08:00:09.900453+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:09.900453+0000","last_peered":"2026-02-24T08:00:09.900453+0000","last_clean":"2026-02-24T08:00:09.900453+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:09.900453+0000","last_undegraded":"2026-02-24T08:00:09.900453+0000","last_fullsized":"2026-02-24T08:00:09.900453+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":6142615552,"num_objects":93730,"num_object_clones":0,"num_object_copies":281190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749831,"num_write_kb":5998648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18423808000,"data_stored":18423808000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13277,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215268,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5647928,"kb_used_data":4489124,"kb_used_omap":16,"kb_used_meta":1158767,"kb_avail":728355272,"statfs":{"total":751619276800,"available":745835798528,"internally_reserved":0,"allocated":4596862976,"data_stored":4596294262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17128,"internal_metadata":1186577688},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444197,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5969760,"kb_used_data":4491788,"kb_used_omap":15,"kb_used_meta":1477936,"kb_avail":728033440,"statfs":{"total":751619276800,"available":745506242560,"internally_reserved":0,"allocated":4599590912,"data_stored":4599022198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16372,"internal_metadata":1513406476},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,6,16],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5241716,"kb_used_data":4112288,"kb_used_omap":12,"kb_used_meta":1129395,"kb_avail":728761484,"statfs":{"total":751619276800,"available":746251759616,"internally_reserved":0,"allocated":4210982912,"data_stored":4210417750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13108,"internal_metadata":1156500684},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,11,14,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705834,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6575920,"kb_used_data":4832860,"kb_used_omap":17,"kb_used_meta":1743022,"kb_avail":727427280,"statfs":{"total":751619276800,"available":744885534720,"internally_reserved":0,"allocated":4948848640,"data_stored":4948279926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18345,"internal_metadata":1784854615},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,12,21,17,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13277,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4995121152,"data_stored":4995121152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4221894656,"data_stored":4221894656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4609269760,"data_stored":4609269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4597522432,"data_stored":4597522432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:16.215 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:00:16.216 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 46 2026-02-24T08:00:16.336 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:16.333+0000 7f18a7661640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:16.336 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:16.334+0000 7f18a7661640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:16.354 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:16.354 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:16.371 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:16.371 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:16.375 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:16.402 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:16.402 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:16.418 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:16.419 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:16.508 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:16.505+0000 7fe29b6de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:16.508 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:16.505+0000 7fe29b6de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:16.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 127 779276 779149 70.7742 58.3047 0.0221555 0.0141268 2026-02-24T08:00:16.667 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:00:16.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:17.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:16 trial016 ceph-mon[39544]: pgmap v504: 17 pgs: 17 active+clean; 5.7 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 87 MiB/s wr, 11.18k op/s 2026-02-24T08:00:17.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:16 trial016 ceph-mon[39544]: 8.9 scrub ok 2026-02-24T08:00:17.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1279864143' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:17.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1693359603' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:00:17.566 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 789103 788975 70.8429 76.7656 0.00607501 0.0141134 2026-02-24T08:00:18.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:17 trial016 ceph-mon[39544]: from='client.15602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:18.467 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:18.566 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 798835 798707 70.9018 76.0312 0.00806984 0.0141012 2026-02-24T08:00:18.621 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:18.744 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:18.741+0000 7f762f7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:18.744 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:18.742+0000 7f762f7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:18.760 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:18.761 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:18.785 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:18.785 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:18.802 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:18.803 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:18.816 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:18.816 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:18 trial016 ceph-mon[39544]: 8.4 scrub starts 2026-02-24T08:00:19.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:18 trial016 ceph-mon[39544]: pgmap v505: 17 pgs: 17 active+clean; 5.7 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.42k op/s 2026-02-24T08:00:19.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1359914611' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:19.566 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 808550 808422 70.9579 75.8984 0.0106119 0.0140897 2026-02-24T08:00:20.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:19 trial016 ceph-mon[39544]: 8.4 scrub ok 2026-02-24T08:00:20.565 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 62 817669 817607 70.9667 71.7578 0.0465838 0.0140881 2026-02-24T08:00:20.867 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:20.983 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:21.082 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:21.080+0000 7fefd77e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:21.083 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:21.081+0000 7fefd77e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:21.095 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:21.095 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:21.106 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:21.106 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:21.117 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:21.117 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:21.127 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:21.128 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:21.140 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:20 trial016 ceph-mon[39544]: 8.e scrub starts 2026-02-24T08:00:21.141 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:20 trial016 ceph-mon[39544]: pgmap v506: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.1 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.72k op/s 2026-02-24T08:00:21.566 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0196 2026-02-24T08:00:21.567 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 817669 2026-02-24T08:00:21.567 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T08:00:21.567 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T08:00:21.567 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 70.9628 2026-02-24T08:00:21.567 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 8.79593 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 82.5938 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 47.7344 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 9083 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 1125.88 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 10572 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 6110 2026-02-24T08:00:21.568 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0140888 2026-02-24T08:00:21.569 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.0100136 2026-02-24T08:00:21.569 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.136937 2026-02-24T08:00:21.569 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000630903 2026-02-24T08:00:21.570 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:00:21.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:21.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:21.717 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:00:21.718 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:21.870 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:22.004 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:22.002+0000 7f46b6a60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:22.005 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:22.002+0000 7f46b6a60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:22.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:21 trial016 ceph-mon[39544]: 8.e scrub ok 2026-02-24T08:00:22.005 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1177148842' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:22.154 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:22.155 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:22.204 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2026-02-24T08:00:21.852671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6499205664,"num_objects":99164,"num_object_clones":0,"num_object_copies":297492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99164,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":793423,"num_write_kb":6348454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24096756,"kb_used_data":18974756,"kb_used_omap":65,"kb_used_meta":5121854,"kb_avail":2911916044,"statfs":{"total":3006477107200,"available":2981802029056,"internally_reserved":0,"allocated":19430150144,"data_stored":19427847292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66904,"internal_metadata":5244779176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,8,12,8,34,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":711475200,"num_objects":10857,"num_object_clones":0,"num_object_copies":32571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86850,"num_write_kb":694800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001325"},"pg_stats":[{"pgid":"8.f","version":"125'49600","reported_seq":49691,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.003888+0000","last_change":"2026-02-24T08:00:03.719845+0000","last_active":"2026-02-24T08:00:18.003888+0000","last_peered":"2026-02-24T08:00:18.003888+0000","last_clean":"2026-02-24T08:00:18.003888+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T08:00:18.003888+0000","last_undegraded":"2026-02-24T08:00:18.003888+0000","last_fullsized":"2026-02-24T08:00:18.003888+0000","mapping_epoch":110,"log_start":"125'49584","ondisk_log_start":"125'49584","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'41360","last_scrub_stamp":"2026-02-24T08:00:03.719751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:03.719751+0000","objects_scrubbed":5124,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.145365+0000","scrub_duration":1498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406323200,"num_objects":6200,"num_object_clones":0,"num_object_copies":18600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":396800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"125'49104","reported_seq":49140,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.003693+0000","last_change":"2026-02-24T07:58:48.944954+0000","last_active":"2026-02-24T08:00:18.003693+0000","last_peered":"2026-02-24T08:00:18.003693+0000","last_clean":"2026-02-24T08:00:18.003693+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T08:00:18.003693+0000","last_undegraded":"2026-02-24T08:00:18.003693+0000","last_fullsized":"2026-02-24T08:00:18.003693+0000","mapping_epoch":110,"log_start":"125'49096","ondisk_log_start":"125'49096","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402259968,"num_objects":6138,"num_object_clones":0,"num_object_copies":18414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49104,"num_write_kb":392832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"125'49596","reported_seq":49697,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.890498+0000","last_change":"2026-02-24T08:00:10.891274+0000","last_active":"2026-02-24T08:00:17.890498+0000","last_peered":"2026-02-24T08:00:17.890498+0000","last_clean":"2026-02-24T08:00:17.890498+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T08:00:17.890498+0000","last_undegraded":"2026-02-24T08:00:17.890498+0000","last_fullsized":"2026-02-24T08:00:17.890498+0000","mapping_epoch":110,"log_start":"125'49589","ondisk_log_start":"125'49589","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45738","last_scrub_stamp":"2026-02-24T08:00:10.891178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.891178+0000","objects_scrubbed":5681,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.537731+0000","scrub_duration":1154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406290432,"num_objects":6200,"num_object_clones":0,"num_object_copies":18600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49596,"num_write_kb":396768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"125'49832","reported_seq":49937,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.002831+0000","last_change":"2026-02-24T08:00:11.621552+0000","last_active":"2026-02-24T08:00:18.002831+0000","last_peered":"2026-02-24T08:00:18.002831+0000","last_clean":"2026-02-24T08:00:18.002831+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T08:00:18.002831+0000","last_undegraded":"2026-02-24T08:00:18.002831+0000","last_fullsized":"2026-02-24T08:00:18.002831+0000","mapping_epoch":110,"log_start":"125'49823","ondisk_log_start":"125'49823","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'46331","last_scrub_stamp":"2026-02-24T08:00:11.621479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:11.621479+0000","objects_scrubbed":5754,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:30.973054+0000","scrub_duration":1310,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408223744,"num_objects":6229,"num_object_clones":0,"num_object_copies":18687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49832,"num_write_kb":398656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"125'48784","reported_seq":48878,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.990299+0000","last_change":"2026-02-24T07:59:54.895438+0000","last_active":"2026-02-24T08:00:17.990299+0000","last_peered":"2026-02-24T08:00:17.990299+0000","last_clean":"2026-02-24T08:00:17.990299+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T08:00:17.990299+0000","last_undegraded":"2026-02-24T08:00:17.990299+0000","last_fullsized":"2026-02-24T08:00:17.990299+0000","mapping_epoch":110,"log_start":"125'48776","ondisk_log_start":"125'48776","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'36472","last_scrub_stamp":"2026-02-24T07:59:54.895389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:54.895389+0000","objects_scrubbed":4517,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.286954+0000","scrub_duration":1730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399638528,"num_objects":6098,"num_object_clones":0,"num_object_copies":18294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48784,"num_write_kb":390272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"125'49728","reported_seq":49831,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.100729+0000","last_change":"2026-02-24T08:00:07.298828+0000","last_active":"2026-02-24T08:00:18.100729+0000","last_peered":"2026-02-24T08:00:18.100729+0000","last_clean":"2026-02-24T08:00:18.100729+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T08:00:18.100729+0000","last_undegraded":"2026-02-24T08:00:18.100729+0000","last_fullsized":"2026-02-24T08:00:18.100729+0000","mapping_epoch":110,"log_start":"125'49720","ondisk_log_start":"125'49720","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43506","last_scrub_stamp":"2026-02-24T08:00:07.298720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:07.298720+0000","objects_scrubbed":5401,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:33.726929+0000","scrub_duration":1362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407371776,"num_objects":6216,"num_object_clones":0,"num_object_copies":18648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49728,"num_write_kb":397824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"125'49480","reported_seq":49584,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.885019+0000","last_change":"2026-02-24T08:00:10.035546+0000","last_active":"2026-02-24T08:00:17.885019+0000","last_peered":"2026-02-24T08:00:17.885019+0000","last_clean":"2026-02-24T08:00:17.885019+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T08:00:17.885019+0000","last_undegraded":"2026-02-24T08:00:17.885019+0000","last_fullsized":"2026-02-24T08:00:17.885019+0000","mapping_epoch":110,"log_start":"125'49472","ondisk_log_start":"125'49472","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45000","last_scrub_stamp":"2026-02-24T08:00:10.035513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.035513+0000","objects_scrubbed":5585,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:21.946015+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405340160,"num_objects":6185,"num_object_clones":0,"num_object_copies":18555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49480,"num_write_kb":395840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"125'48976","reported_seq":49076,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.100451+0000","last_change":"2026-02-24T08:00:02.297631+0000","last_active":"2026-02-24T08:00:18.100451+0000","last_peered":"2026-02-24T08:00:18.100451+0000","last_clean":"2026-02-24T08:00:18.100451+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T08:00:18.100451+0000","last_undegraded":"2026-02-24T08:00:18.100451+0000","last_fullsized":"2026-02-24T08:00:18.100451+0000","mapping_epoch":110,"log_start":"125'48963","ondisk_log_start":"125'48963","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'40425","last_scrub_stamp":"2026-02-24T08:00:02.297527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.297527+0000","objects_scrubbed":5020,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:05.712742+0000","scrub_duration":1377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401211392,"num_objects":6122,"num_object_clones":0,"num_object_copies":18366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48976,"num_write_kb":391808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"125'50656","reported_seq":50757,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.990649+0000","last_change":"2026-02-24T08:00:02.085116+0000","last_active":"2026-02-24T08:00:17.990649+0000","last_peered":"2026-02-24T08:00:17.990649+0000","last_clean":"2026-02-24T08:00:17.990649+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T08:00:17.990649+0000","last_undegraded":"2026-02-24T08:00:17.990649+0000","last_fullsized":"2026-02-24T08:00:17.990649+0000","mapping_epoch":110,"log_start":"125'50651","ondisk_log_start":"125'50651","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'42176","last_scrub_stamp":"2026-02-24T08:00:02.084983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.084983+0000","objects_scrubbed":5245,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:09.377303+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414973952,"num_objects":6332,"num_object_clones":0,"num_object_copies":18996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50656,"num_write_kb":405248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"125'49632","reported_seq":49736,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.875936+0000","last_change":"2026-02-24T08:00:08.615366+0000","last_active":"2026-02-24T08:00:17.875936+0000","last_peered":"2026-02-24T08:00:17.875936+0000","last_clean":"2026-02-24T08:00:17.875936+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T08:00:17.875936+0000","last_undegraded":"2026-02-24T08:00:17.875936+0000","last_fullsized":"2026-02-24T08:00:17.875936+0000","mapping_epoch":110,"log_start":"125'49610","ondisk_log_start":"125'49610","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44936","last_scrub_stamp":"2026-02-24T08:00:08.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:08.615310+0000","objects_scrubbed":5577,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.807357+0000","scrub_duration":817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406585344,"num_objects":6204,"num_object_clones":0,"num_object_copies":18612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49632,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"125'48904","reported_seq":48956,"reported_epoch":125,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:00:17.882300+0000","last_change":"2026-02-24T08:00:17.715409+0000","last_active":"2026-02-24T08:00:17.882300+0000","last_peered":"2026-02-24T08:00:17.882300+0000","last_clean":"2026-02-24T08:00:17.882300+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T08:00:17.882300+0000","last_undegraded":"2026-02-24T08:00:17.882300+0000","last_fullsized":"2026-02-24T08:00:17.882300+0000","mapping_epoch":110,"log_start":"125'48896","ondisk_log_start":"125'48896","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:58:47.932480+0000","objects_scrubbed":749,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400621568,"num_objects":6113,"num_object_clones":0,"num_object_copies":18339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48904,"num_write_kb":391232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"125'49860","reported_seq":49961,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.123622+0000","last_change":"2026-02-24T08:00:09.724097+0000","last_active":"2026-02-24T08:00:18.123622+0000","last_peered":"2026-02-24T08:00:18.123622+0000","last_clean":"2026-02-24T08:00:18.123622+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T08:00:18.123622+0000","last_undegraded":"2026-02-24T08:00:18.123622+0000","last_fullsized":"2026-02-24T08:00:18.123622+0000","mapping_epoch":110,"log_start":"125'49856","ondisk_log_start":"125'49856","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44960","last_scrub_stamp":"2026-02-24T08:00:09.724011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:09.724011+0000","objects_scrubbed":5604,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.314262+0000","scrub_duration":777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408453120,"num_objects":6233,"num_object_clones":0,"num_object_copies":18699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49860,"num_write_kb":398880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"125'49336","reported_seq":49430,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.890157+0000","last_change":"2026-02-24T07:59:59.391367+0000","last_active":"2026-02-24T08:00:17.890157+0000","last_peered":"2026-02-24T08:00:17.890157+0000","last_clean":"2026-02-24T08:00:17.890157+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T08:00:17.890157+0000","last_undegraded":"2026-02-24T08:00:17.890157+0000","last_fullsized":"2026-02-24T08:00:17.890157+0000","mapping_epoch":110,"log_start":"125'49332","ondisk_log_start":"125'49332","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'39272","last_scrub_stamp":"2026-02-24T07:59:59.391300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.391300+0000","objects_scrubbed":4891,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:00.737911+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404160512,"num_objects":6167,"num_object_clones":0,"num_object_copies":18501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49336,"num_write_kb":394688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"125'50048","reported_seq":50149,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.114267+0000","last_change":"2026-02-24T08:00:06.420923+0000","last_active":"2026-02-24T08:00:18.114267+0000","last_peered":"2026-02-24T08:00:18.114267+0000","last_clean":"2026-02-24T08:00:18.114267+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T08:00:18.114267+0000","last_undegraded":"2026-02-24T08:00:18.114267+0000","last_fullsized":"2026-02-24T08:00:18.114267+0000","mapping_epoch":110,"log_start":"125'50032","ondisk_log_start":"125'50032","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43184","last_scrub_stamp":"2026-02-24T08:00:06.420846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:06.420846+0000","objects_scrubbed":5336,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:25.741960+0000","scrub_duration":1450,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409993216,"num_objects":6256,"num_object_clones":0,"num_object_copies":18768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50048,"num_write_kb":400384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"125'49536","reported_seq":49634,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:18.118868+0000","last_change":"2026-02-24T07:59:58.704102+0000","last_active":"2026-02-24T08:00:18.118868+0000","last_peered":"2026-02-24T08:00:18.118868+0000","last_clean":"2026-02-24T08:00:18.118868+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T08:00:18.118868+0000","last_undegraded":"2026-02-24T08:00:18.118868+0000","last_fullsized":"2026-02-24T08:00:18.118868+0000","mapping_epoch":110,"log_start":"125'49529","ondisk_log_start":"125'49529","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'38848","last_scrub_stamp":"2026-02-24T07:59:58.704051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:58.704051+0000","objects_scrubbed":4831,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:04.646942+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405798912,"num_objects":6192,"num_object_clones":0,"num_object_copies":18576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49536,"num_write_kb":396288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"125'50216","reported_seq":50325,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:17.879892+0000","last_change":"2026-02-24T08:00:16.171563+0000","last_active":"2026-02-24T08:00:17.879892+0000","last_peered":"2026-02-24T08:00:17.879892+0000","last_clean":"2026-02-24T08:00:17.879892+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T08:00:17.879892+0000","last_undegraded":"2026-02-24T08:00:17.879892+0000","last_fullsized":"2026-02-24T08:00:17.879892+0000","mapping_epoch":110,"log_start":"125'50208","ondisk_log_start":"125'50208","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'49168","last_scrub_stamp":"2026-02-24T08:00:16.171499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:16.171499+0000","objects_scrubbed":6108,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:41.860676+0000","scrub_duration":1472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411369472,"num_objects":6277,"num_object_clones":0,"num_object_copies":18831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50216,"num_write_kb":401728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":474,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:14.891276+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:14.891276+0000","last_peered":"2026-02-24T08:00:14.891276+0000","last_clean":"2026-02-24T08:00:14.891276+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:14.891276+0000","last_undegraded":"2026-02-24T08:00:14.891276+0000","last_fullsized":"2026-02-24T08:00:14.891276+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":6498615296,"num_objects":99162,"num_object_clones":0,"num_object_copies":297486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":793288,"num_write_kb":6346304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19492012032,"data_stored":19492012032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13358,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215269,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6015548,"kb_used_data":4748456,"kb_used_omap":17,"kb_used_meta":1267054,"kb_avail":727987652,"statfs":{"total":751619276800,"available":745459355648,"internally_reserved":0,"allocated":4862418944,"data_stored":4861842343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17775,"internal_metadata":1297463953},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444198,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5574348,"kb_used_data":4754360,"kb_used_omap":16,"kb_used_meta":819951,"kb_avail":728428852,"statfs":{"total":751619276800,"available":745911144448,"internally_reserved":0,"allocated":4868464640,"data_stored":4867888039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17024,"internal_metadata":839630208},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5555832,"kb_used_data":4354212,"kb_used_omap":13,"kb_used_meta":1201586,"kb_avail":728447368,"statfs":{"total":751619276800,"available":745930104832,"internally_reserved":0,"allocated":4458713088,"data_stored":4458140039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13760,"internal_metadata":1230424640},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,8,12,8,8,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705835,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6951028,"kb_used_data":5117728,"kb_used_omap":17,"kb_used_meta":1833262,"kb_avail":727052172,"statfs":{"total":751619276800,"available":744501424128,"internally_reserved":0,"allocated":5240553472,"data_stored":5239976871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18345,"internal_metadata":1877260375},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,0,26,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13358,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5285355520,"data_stored":5285355520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4466393088,"data_stored":4466393088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4876910592,"data_stored":4876910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4863352832,"data_stored":4863352832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:22.206 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 271 2026-02-24T08:00:22.356 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:22.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:22.490+0000 7f1a5aa4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:22.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:22.490+0000 7f1a5aa4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:22.643 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:00:22.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:23.165 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:23.193 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:22 trial016 ceph-mon[39544]: pgmap v507: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.1 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.68k op/s 2026-02-24T08:00:23.193 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3903681417' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "271"} : dispatch 2026-02-24T08:00:23.320 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:23.445 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:23.442+0000 7f61013c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:23.445 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:23.443+0000 7f61013c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:23.462 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:23.462 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:23.478 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:23.478 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:23.494 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:23.494 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:23.507 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:23.508 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:23 trial016 ceph-mon[39544]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2589747622' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:25.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:24 trial016 ceph-mon[39544]: pgmap v508: 17 pgs: 17 active+clean; 5.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 53 MiB/s wr, 8.29k op/s 2026-02-24T08:00:25.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:25.561 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:25.714 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:25.852 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:25.849+0000 7f1fb1af6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:25.856 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:25.854+0000 7f1fb1af6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:25.874 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:25.874 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:25.893 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:25.894 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:25.907 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:25.908 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:25.923 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:25.923 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:26.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:25 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/574631232' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:26 trial016 ceph-mon[39544]: pgmap v509: 17 pgs: 17 active+clean; 5.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 93 B/s rd, 48 MiB/s wr, 7.57k op/s 2026-02-24T08:00:27.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:27.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:27.689 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:00:27.689 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:27.838 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:27.972 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:27.982 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:27 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:00:27.982 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:27 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:00:28.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:28.217+0000 7f9555014640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:28.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:28.217+0000 7f9555014640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:28.346 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:28.366 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:28.367 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:28.938 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2026-02-24T08:00:27.853536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5707309624,"num_objects":87081,"num_object_clones":0,"num_object_copies":261243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87081,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":832936,"num_write_kb":6543503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22871696,"kb_used_data":17442880,"kb_used_omap":65,"kb_used_meta":5428670,"kb_avail":2913141104,"statfs":{"total":3006477107200,"available":2983056490496,"internally_reserved":0,"allocated":17861509120,"data_stored":17859194052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66904,"internal_metadata":5558958760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[24,3,11,16,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-435896296,"num_objects":-6651,"num_object_clones":0,"num_object_copies":-19953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6651,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":82970,"num_write_kb":542705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001689"},"pg_stats":[{"pgid":"8.f","version":"125'52070","reported_seq":52165,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.994037+0000","last_change":"2026-02-24T08:00:03.719845+0000","last_active":"2026-02-24T08:00:22.994037+0000","last_peered":"2026-02-24T08:00:22.994037+0000","last_clean":"2026-02-24T08:00:22.994037+0000","last_became_active":"2026-02-24T07:58:48.944645+0000","last_became_peered":"2026-02-24T07:58:48.944645+0000","last_unstale":"2026-02-24T08:00:22.994037+0000","last_undegraded":"2026-02-24T08:00:22.994037+0000","last_fullsized":"2026-02-24T08:00:22.994037+0000","mapping_epoch":110,"log_start":"125'52064","ondisk_log_start":"125'52064","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'41360","last_scrub_stamp":"2026-02-24T08:00:03.719751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:03.719751+0000","objects_scrubbed":5124,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.145365+0000","scrub_duration":1498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358285312,"num_objects":5467,"num_object_clones":0,"num_object_copies":16401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52070,"num_write_kb":409152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"125'51662","reported_seq":51765,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.004369+0000","last_change":"2026-02-24T08:00:20.575767+0000","last_active":"2026-02-24T08:00:23.004369+0000","last_peered":"2026-02-24T08:00:23.004369+0000","last_clean":"2026-02-24T08:00:23.004369+0000","last_became_active":"2026-02-24T07:58:48.944658+0000","last_became_peered":"2026-02-24T07:58:48.944658+0000","last_unstale":"2026-02-24T08:00:23.004369+0000","last_undegraded":"2026-02-24T08:00:23.004369+0000","last_fullsized":"2026-02-24T08:00:23.004369+0000","mapping_epoch":110,"log_start":"125'51652","ondisk_log_start":"125'51652","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'50716","last_scrub_stamp":"2026-02-24T08:00:20.575619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:20.575619+0000","objects_scrubbed":6297,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:23.227758+0000","scrub_duration":1279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353542144,"num_objects":5395,"num_object_clones":0,"num_object_copies":16185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51662,"num_write_kb":405736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"125'51917","reported_seq":52013,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.889536+0000","last_change":"2026-02-24T08:00:10.891274+0000","last_active":"2026-02-24T08:00:22.889536+0000","last_peered":"2026-02-24T08:00:22.889536+0000","last_clean":"2026-02-24T08:00:22.889536+0000","last_became_active":"2026-02-24T07:58:48.942324+0000","last_became_peered":"2026-02-24T07:58:48.942324+0000","last_unstale":"2026-02-24T08:00:22.889536+0000","last_undegraded":"2026-02-24T08:00:22.889536+0000","last_fullsized":"2026-02-24T08:00:22.889536+0000","mapping_epoch":110,"log_start":"125'51905","ondisk_log_start":"125'51905","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45738","last_scrub_stamp":"2026-02-24T08:00:10.891178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.891178+0000","objects_scrubbed":5681,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.537731+0000","scrub_duration":1154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":361889816,"num_objects":5523,"num_object_clones":0,"num_object_copies":16569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5523,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":51917,"num_write_kb":408449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"125'52561","reported_seq":52656,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.004528+0000","last_change":"2026-02-24T08:00:11.621552+0000","last_active":"2026-02-24T08:00:23.004528+0000","last_peered":"2026-02-24T08:00:23.004528+0000","last_clean":"2026-02-24T08:00:23.004528+0000","last_became_active":"2026-02-24T07:58:48.944249+0000","last_became_peered":"2026-02-24T07:58:48.944249+0000","last_unstale":"2026-02-24T08:00:23.004528+0000","last_undegraded":"2026-02-24T08:00:23.004528+0000","last_fullsized":"2026-02-24T08:00:23.004528+0000","mapping_epoch":110,"log_start":"125'52548","ondisk_log_start":"125'52548","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'46331","last_scrub_stamp":"2026-02-24T08:00:11.621479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:11.621479+0000","objects_scrubbed":5754,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:30.973054+0000","scrub_duration":1310,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358547456,"num_objects":5471,"num_object_clones":0,"num_object_copies":16413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52561,"num_write_kb":412672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"125'51182","reported_seq":51270,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.004472+0000","last_change":"2026-02-24T07:59:54.895438+0000","last_active":"2026-02-24T08:00:23.004472+0000","last_peered":"2026-02-24T08:00:23.004472+0000","last_clean":"2026-02-24T08:00:23.004472+0000","last_became_active":"2026-02-24T07:58:48.944350+0000","last_became_peered":"2026-02-24T07:58:48.944350+0000","last_unstale":"2026-02-24T08:00:23.004472+0000","last_undegraded":"2026-02-24T08:00:23.004472+0000","last_fullsized":"2026-02-24T08:00:23.004472+0000","mapping_epoch":110,"log_start":"125'51174","ondisk_log_start":"125'51174","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'36472","last_scrub_stamp":"2026-02-24T07:59:54.895389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:54.895389+0000","objects_scrubbed":4517,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.286954+0000","scrub_duration":1730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353959936,"num_objects":5401,"num_object_clones":0,"num_object_copies":16203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51182,"num_write_kb":402368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"125'52058","reported_seq":52157,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.118001+0000","last_change":"2026-02-24T08:00:07.298828+0000","last_active":"2026-02-24T08:00:23.118001+0000","last_peered":"2026-02-24T08:00:23.118001+0000","last_clean":"2026-02-24T08:00:23.118001+0000","last_became_active":"2026-02-24T07:58:48.943738+0000","last_became_peered":"2026-02-24T07:58:48.943738+0000","last_unstale":"2026-02-24T08:00:23.118001+0000","last_undegraded":"2026-02-24T08:00:23.118001+0000","last_fullsized":"2026-02-24T08:00:23.118001+0000","mapping_epoch":110,"log_start":"125'52053","ondisk_log_start":"125'52053","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43506","last_scrub_stamp":"2026-02-24T08:00:07.298720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:07.298720+0000","objects_scrubbed":5401,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:33.726929+0000","scrub_duration":1362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352583680,"num_objects":5380,"num_object_clones":0,"num_object_copies":16140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5380,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52058,"num_write_kb":408448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"125'51757","reported_seq":51856,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.889859+0000","last_change":"2026-02-24T08:00:10.035546+0000","last_active":"2026-02-24T08:00:22.889859+0000","last_peered":"2026-02-24T08:00:22.889859+0000","last_clean":"2026-02-24T08:00:22.889859+0000","last_became_active":"2026-02-24T07:58:48.942634+0000","last_became_peered":"2026-02-24T07:58:48.942634+0000","last_unstale":"2026-02-24T08:00:22.889859+0000","last_undegraded":"2026-02-24T08:00:22.889859+0000","last_fullsized":"2026-02-24T08:00:22.889859+0000","mapping_epoch":110,"log_start":"125'51750","ondisk_log_start":"125'51750","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'45000","last_scrub_stamp":"2026-02-24T08:00:10.035513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:10.035513+0000","objects_scrubbed":5585,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:21.946015+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":361103360,"num_objects":5510,"num_object_clones":0,"num_object_copies":16530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51757,"num_write_kb":407232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"125'51505","reported_seq":51602,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.119825+0000","last_change":"2026-02-24T08:00:02.297631+0000","last_active":"2026-02-24T08:00:23.119825+0000","last_peered":"2026-02-24T08:00:23.119825+0000","last_clean":"2026-02-24T08:00:23.119825+0000","last_became_active":"2026-02-24T07:58:48.944127+0000","last_became_peered":"2026-02-24T07:58:48.944127+0000","last_unstale":"2026-02-24T08:00:23.119825+0000","last_undegraded":"2026-02-24T08:00:23.119825+0000","last_fullsized":"2026-02-24T08:00:23.119825+0000","mapping_epoch":110,"log_start":"125'51501","ondisk_log_start":"125'51501","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'40425","last_scrub_stamp":"2026-02-24T08:00:02.297527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.297527+0000","objects_scrubbed":5020,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:05.712742+0000","scrub_duration":1377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343998464,"num_objects":5249,"num_object_clones":0,"num_object_copies":15747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51505,"num_write_kb":403584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"125'53437","reported_seq":53532,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.004565+0000","last_change":"2026-02-24T08:00:02.085116+0000","last_active":"2026-02-24T08:00:23.004565+0000","last_peered":"2026-02-24T08:00:23.004565+0000","last_clean":"2026-02-24T08:00:23.004565+0000","last_became_active":"2026-02-24T07:58:48.945961+0000","last_became_peered":"2026-02-24T07:58:48.945961+0000","last_unstale":"2026-02-24T08:00:23.004565+0000","last_undegraded":"2026-02-24T08:00:23.004565+0000","last_fullsized":"2026-02-24T08:00:23.004565+0000","mapping_epoch":110,"log_start":"125'53427","ondisk_log_start":"125'53427","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'42176","last_scrub_stamp":"2026-02-24T08:00:02.084983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:02.084983+0000","objects_scrubbed":5245,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:09.377303+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362479616,"num_objects":5531,"num_object_clones":0,"num_object_copies":16593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53437,"num_write_kb":419328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"125'52286","reported_seq":52388,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.877818+0000","last_change":"2026-02-24T08:00:08.615366+0000","last_active":"2026-02-24T08:00:22.877818+0000","last_peered":"2026-02-24T08:00:22.877818+0000","last_clean":"2026-02-24T08:00:22.877818+0000","last_became_active":"2026-02-24T07:58:48.942673+0000","last_became_peered":"2026-02-24T07:58:48.942673+0000","last_unstale":"2026-02-24T08:00:22.877818+0000","last_undegraded":"2026-02-24T08:00:22.877818+0000","last_fullsized":"2026-02-24T08:00:22.877818+0000","mapping_epoch":110,"log_start":"125'52279","ondisk_log_start":"125'52279","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44936","last_scrub_stamp":"2026-02-24T08:00:08.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:08.615310+0000","objects_scrubbed":5577,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:15.807357+0000","scrub_duration":817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363593728,"num_objects":5548,"num_object_clones":0,"num_object_copies":16644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52286,"num_write_kb":411264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"125'51116","reported_seq":51209,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.890985+0000","last_change":"2026-02-24T08:00:18.660915+0000","last_active":"2026-02-24T08:00:22.890985+0000","last_peered":"2026-02-24T08:00:22.890985+0000","last_clean":"2026-02-24T08:00:22.890985+0000","last_became_active":"2026-02-24T07:58:48.943745+0000","last_became_peered":"2026-02-24T07:58:48.943745+0000","last_unstale":"2026-02-24T08:00:22.890985+0000","last_undegraded":"2026-02-24T08:00:22.890985+0000","last_fullsized":"2026-02-24T08:00:22.890985+0000","mapping_epoch":110,"log_start":"125'51094","ondisk_log_start":"125'51094","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'49320","last_scrub_stamp":"2026-02-24T08:00:18.660869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:18.660869+0000","objects_scrubbed":6137,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:45.944863+0000","scrub_duration":945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355336192,"num_objects":5422,"num_object_clones":0,"num_object_copies":16266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51116,"num_write_kb":402048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"125'52307","reported_seq":52405,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.125090+0000","last_change":"2026-02-24T08:00:09.724097+0000","last_active":"2026-02-24T08:00:23.125090+0000","last_peered":"2026-02-24T08:00:23.125090+0000","last_clean":"2026-02-24T08:00:23.125090+0000","last_became_active":"2026-02-24T07:58:48.944052+0000","last_became_peered":"2026-02-24T07:58:48.944052+0000","last_unstale":"2026-02-24T08:00:23.125090+0000","last_undegraded":"2026-02-24T08:00:23.125090+0000","last_fullsized":"2026-02-24T08:00:23.125090+0000","mapping_epoch":110,"log_start":"125'52298","ondisk_log_start":"125'52298","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'44960","last_scrub_stamp":"2026-02-24T08:00:09.724011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:09.724011+0000","objects_scrubbed":5604,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:11.314262+0000","scrub_duration":777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353370112,"num_objects":5392,"num_object_clones":0,"num_object_copies":16176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52307,"num_write_kb":410304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"125'51777","reported_seq":51862,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.890087+0000","last_change":"2026-02-24T07:59:59.391367+0000","last_active":"2026-02-24T08:00:22.890087+0000","last_peered":"2026-02-24T08:00:22.890087+0000","last_clean":"2026-02-24T08:00:22.890087+0000","last_became_active":"2026-02-24T07:58:48.942587+0000","last_became_peered":"2026-02-24T07:58:48.942587+0000","last_unstale":"2026-02-24T08:00:22.890087+0000","last_undegraded":"2026-02-24T08:00:22.890087+0000","last_fullsized":"2026-02-24T08:00:22.890087+0000","mapping_epoch":110,"log_start":"125'51765","ondisk_log_start":"125'51765","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'39272","last_scrub_stamp":"2026-02-24T07:59:59.391300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.391300+0000","objects_scrubbed":4891,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:00.737911+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359202816,"num_objects":5481,"num_object_clones":0,"num_object_copies":16443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51777,"num_write_kb":407168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"125'52388","reported_seq":52484,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.125226+0000","last_change":"2026-02-24T08:00:06.420923+0000","last_active":"2026-02-24T08:00:23.125226+0000","last_peered":"2026-02-24T08:00:23.125226+0000","last_clean":"2026-02-24T08:00:23.125226+0000","last_became_active":"2026-02-24T07:58:48.945649+0000","last_became_peered":"2026-02-24T07:58:48.945649+0000","last_unstale":"2026-02-24T08:00:23.125226+0000","last_undegraded":"2026-02-24T08:00:23.125226+0000","last_fullsized":"2026-02-24T08:00:23.125226+0000","mapping_epoch":110,"log_start":"125'52380","ondisk_log_start":"125'52380","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'43184","last_scrub_stamp":"2026-02-24T08:00:06.420846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:06.420846+0000","objects_scrubbed":5336,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:25.741960+0000","scrub_duration":1450,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355729408,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52388,"num_write_kb":411136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"125'52060","reported_seq":52153,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:23.125354+0000","last_change":"2026-02-24T07:59:58.704102+0000","last_active":"2026-02-24T08:00:23.125354+0000","last_peered":"2026-02-24T08:00:23.125354+0000","last_clean":"2026-02-24T08:00:23.125354+0000","last_became_active":"2026-02-24T07:58:48.943772+0000","last_became_peered":"2026-02-24T07:58:48.943772+0000","last_unstale":"2026-02-24T08:00:23.125354+0000","last_undegraded":"2026-02-24T08:00:23.125354+0000","last_fullsized":"2026-02-24T08:00:23.125354+0000","mapping_epoch":110,"log_start":"125'52054","ondisk_log_start":"125'52054","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'38848","last_scrub_stamp":"2026-02-24T07:59:58.704051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T07:59:58.704051+0000","objects_scrubbed":4831,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:04.646942+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347734016,"num_objects":5306,"num_object_clones":0,"num_object_copies":15918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52060,"num_write_kb":407936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"125'52718","reported_seq":52819,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:22.885414+0000","last_change":"2026-02-24T08:00:16.171563+0000","last_active":"2026-02-24T08:00:22.885414+0000","last_peered":"2026-02-24T08:00:22.885414+0000","last_clean":"2026-02-24T08:00:22.885414+0000","last_became_active":"2026-02-24T07:58:48.943686+0000","last_became_peered":"2026-02-24T07:58:48.943686+0000","last_unstale":"2026-02-24T08:00:22.885414+0000","last_undegraded":"2026-02-24T08:00:22.885414+0000","last_fullsized":"2026-02-24T08:00:22.885414+0000","mapping_epoch":110,"log_start":"125'52709","ondisk_log_start":"125'52709","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'49168","last_scrub_stamp":"2026-02-24T08:00:16.171499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:58:47.932480+0000","last_clean_scrub_stamp":"2026-02-24T08:00:16.171499+0000","objects_scrubbed":6108,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:41.860676+0000","scrub_duration":1472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365363200,"num_objects":5575,"num_object_clones":0,"num_object_copies":16725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52718,"num_write_kb":414528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":474,"reported_epoch":125,"state":"active+clean","last_fresh":"2026-02-24T08:00:14.891276+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:14.891276+0000","last_peered":"2026-02-24T08:00:14.891276+0000","last_clean":"2026-02-24T08:00:14.891276+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:14.891276+0000","last_undegraded":"2026-02-24T08:00:14.891276+0000","last_fullsized":"2026-02-24T08:00:14.891276+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5706719256,"num_objects":87079,"num_object_clones":0,"num_object_copies":261237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87079,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":832801,"num_write_kb":6541353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17177186304,"data_stored":17177174088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13358,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215270,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5637424,"kb_used_data":4280092,"kb_used_omap":17,"kb_used_meta":1357294,"kb_avail":728365776,"statfs":{"total":751619276800,"available":745846554624,"internally_reserved":0,"allocated":4382814208,"data_stored":4382233535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17775,"internal_metadata":1389869713},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444199,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5258824,"kb_used_data":4384692,"kb_used_omap":16,"kb_used_meta":874095,"kb_avail":728744376,"statfs":{"total":751619276800,"available":746234241024,"internally_reserved":0,"allocated":4489924608,"data_stored":4489343935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17024,"internal_metadata":895073664},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5140392,"kb_used_data":3848532,"kb_used_omap":13,"kb_used_meta":1291826,"kb_avail":728862808,"statfs":{"total":751619276800,"available":746355515392,"internally_reserved":0,"allocated":3940896768,"data_stored":3940323719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13760,"internal_metadata":1322830400},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705836,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6835056,"kb_used_data":4929564,"kb_used_omap":17,"kb_used_meta":1905454,"kb_avail":727168144,"statfs":{"total":751619276800,"available":744620179456,"internally_reserved":0,"allocated":5047873536,"data_stored":5047292863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18345,"internal_metadata":1951184983},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,3,11,16,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13358,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4641173504,"data_stored":4641169432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3856244736,"data_stored":3856244736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4345368576,"data_stored":4345364504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4334399488,"data_stored":4334395416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:28.939 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 271 2026-02-24T08:00:29.158 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:29.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:28 trial016 ceph-mon[39544]: pgmap v510: 17 pgs: 17 active+clean; 5.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 44 MiB/s wr, 6.91k op/s 2026-02-24T08:00:29.354 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:29.332+0000 7f638310b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:29.354 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:29.332+0000 7f638310b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:29.370 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:29.370 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:29.390 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:29.390 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:29.408 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:29.409 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:29.419 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:29.419 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:30.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:29 trial016 ceph-mon[39544]: from='client.15620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:30.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3640694069' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:30.569 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:30.502+0000 7fedf1131640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:30.570 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:30.502+0000 7fedf1131640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:30.653 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:00:31.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:31.206 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:30 trial016 ceph-mon[39544]: pgmap v511: 17 pgs: 17 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 44 MiB/s wr, 11.29k op/s 2026-02-24T08:00:31.207 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/431652916' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "271"} : dispatch 2026-02-24T08:00:32.330 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:32.482 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:32.511 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 102209 objects 2026-02-24T08:00:32.511 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :10.9432 2026-02-24T08:00:32.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:32.801+0000 7fcc23bb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:32.875 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:32.801+0000 7fcc23bb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:32.876 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:32.876 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:32.876 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:32.876 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:32.877 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:32.877 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:32.879 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:32.879 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:32 trial016 ceph-mon[39544]: pgmap v512: 17 pgs: 17 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 16 MiB/s wr, 7.66k op/s 2026-02-24T08:00:33.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3759323913' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:34.217 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_6 2026-02-24T08:00:34.217 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2026-02-24T08:00:34.335 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:34.435 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:34.432+0000 7f3895232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:34.435 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:34.432+0000 7f3895232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:34.933 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_6' removed 2026-02-24T08:00:34.991 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:00:34.991 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:00:34.992 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_7 2026-02-24T08:00:34.992 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool create unique_pool_7 16 2026-02-24T08:00:35.115 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:35.167 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:34 trial016 ceph-mon[39544]: pgmap v513: 17 pgs: 17 active+clean; 577 KiB data, 5.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 16 MiB/s wr, 10.55k op/s 2026-02-24T08:00:35.168 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3261614562' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:00:35.168 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:35.226 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:35.223+0000 7fc34b978640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:35.226 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:35.223+0000 7fc34b978640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:35.425 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:35.539 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:35.637 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:35.634+0000 7ff2af904640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:35.637 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:35.634+0000 7ff2af904640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:35.650 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:35.650 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:35.660 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:35.661 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:35.671 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:35.671 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:35.681 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:35.682 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:35.936 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_7' created 2026-02-24T08:00:35.954 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3261614562' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:00:35.954 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:35 trial016 ceph-mon[39544]: osdmap e126: 4 total, 4 up, 4 in 2026-02-24T08:00:35.954 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/558022145' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16} : dispatch 2026-02-24T08:00:35.954 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2723087497' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:35.975 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2026-02-24T08:00:36.091 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:36.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:36.145 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:00:36.198 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:36.194+0000 7f9f48e4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:36.198 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:36.195+0000 7f9f48e4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:36.263 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:36.371 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:36.368+0000 7ff3d9789640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:36.371 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:36.369+0000 7ff3d9789640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:36.938 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:00:36.938 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_7' 2026-02-24T08:00:36.990 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:00:37.146 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:37.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:36 trial016 ceph-mon[39544]: pgmap v515: 1 pgs: 1 active+clean; 577 KiB data, 5.3 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:00:37.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/558022145' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]': finished 2026-02-24T08:00:37.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:36 trial016 ceph-mon[39544]: osdmap e127: 4 total, 4 up, 4 in 2026-02-24T08:00:37.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4157545658' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:00:37.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1248891639' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:00:37.247 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:37.244+0000 7f05e99c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:37.248 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:37.244+0000 7f05e99c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:37.716 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:37.834 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:37.932 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:37.929+0000 7fd484b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:37.932 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:37.929+0000 7fd484b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:37.943 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:00:37.945 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:37.945 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:37.956 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:37.956 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:37.967 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:37.968 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:37.979 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:37.979 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:37.981 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:00:37.989 DEBUG:teuthology.orchestra.run.trial016:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2026-02-24T08:00:37.995 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4157545658' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:00:37.995 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1248891639' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:00:37.995 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:37 trial016 ceph-mon[39544]: osdmap e128: 4 total, 4 up, 4 in 2026-02-24T08:00:37.995 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3463663389' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:00:37.995 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1902705403' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:37.996 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:00:37.996 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:00:38.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout:hints = 1 2026-02-24T08:00:38.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:00:38.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object prefix: benchmark_data_trial016_150408 2026-02-24T08:00:38.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:00:38.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:00:38.123 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:38.274 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:38.271+0000 7f508dbc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:38.274 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:38.271+0000 7f508dbc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:38.944 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:00:38.997 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:00:39.044 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 1 128 9892 9764 76.275 76.2812 0.012896 0.0129448 2026-02-24T08:00:39.190 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:39.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:38 trial016 ceph-mon[39544]: pgmap v518: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.3 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:00:39.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3463663389' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:00:39.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:38 trial016 ceph-mon[39544]: osdmap e129: 4 total, 4 up, 4 in 2026-02-24T08:00:39.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3782294657' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:00:39.317 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:39.314+0000 7fe5447b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:39.317 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:39.314+0000 7fe5447b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:39.896 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:00:39.948 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:00:39.948 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:40.018 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:40.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 2 127 19097 18970 74.0958 71.9219 0.0215479 0.0134389 2026-02-24T08:00:40.147 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:40.173 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3782294657' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:00:40.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:39 trial016 ceph-mon[39544]: osdmap e130: 4 total, 4 up, 4 in 2026-02-24T08:00:40.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3469885818' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:00:40.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3469885818' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:00:40.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:39 trial016 ceph-mon[39544]: osdmap e131: 4 total, 4 up, 4 in 2026-02-24T08:00:40.182 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:40.271 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.268+0000 7fbfe369a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.271 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.269+0000 7fbfe369a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.296+0000 7fe09f444640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.296+0000 7fe09f444640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.316 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:40.317 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:40.338 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:40.338 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:40.360 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:40.360 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:40.382 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:40.382 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:40.427 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:40.427 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:40.474 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2026-02-24T08:00:39.895675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3457568,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":485,"num_write_kb":4950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5235484,"kb_used_data":5388,"kb_used_omap":74,"kb_used_meta":5229941,"kb_avail":2930777316,"statfs":{"total":3006477107200,"available":3001115971584,"internally_reserved":0,"allocated":5517312,"data_stored":3122828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":76035,"internal_metadata":5355460349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.960357"},"pg_stats":[{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943107+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:36.943107+0000","last_peered":"2026-02-24T08:00:36.943107+0000","last_clean":"2026-02-24T08:00:36.943107+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:36.943107+0000","last_undegraded":"2026-02-24T08:00:36.943107+0000","last_fullsized":"2026-02-24T08:00:36.943107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:49.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943105+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:36.943105+0000","last_peered":"2026-02-24T08:00:36.943105+0000","last_clean":"2026-02-24T08:00:36.943105+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:36.943105+0000","last_undegraded":"2026-02-24T08:00:36.943105+0000","last_fullsized":"2026-02-24T08:00:36.943105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.364836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943877+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:36.943877+0000","last_peered":"2026-02-24T08:00:36.943877+0000","last_clean":"2026-02-24T08:00:36.943877+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:36.943877+0000","last_undegraded":"2026-02-24T08:00:36.943877+0000","last_fullsized":"2026-02-24T08:00:36.943877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"129'72","reported_seq":77,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.159078+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:38.159078+0000","last_peered":"2026-02-24T08:00:38.159078+0000","last_clean":"2026-02-24T08:00:38.159078+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:38.159078+0000","last_undegraded":"2026-02-24T08:00:38.159078+0000","last_fullsized":"2026-02-24T08:00:38.159078+0000","mapping_epoch":127,"log_start":"129'63","ondisk_log_start":"129'63","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":63,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942779+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:36.942779+0000","last_peered":"2026-02-24T08:00:36.942779+0000","last_clean":"2026-02-24T08:00:36.942779+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:36.942779+0000","last_undegraded":"2026-02-24T08:00:36.942779+0000","last_fullsized":"2026-02-24T08:00:36.942779+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:50.528871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942878+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:36.942878+0000","last_peered":"2026-02-24T08:00:36.942878+0000","last_clean":"2026-02-24T08:00:36.942878+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:36.942878+0000","last_undegraded":"2026-02-24T08:00:36.942878+0000","last_fullsized":"2026-02-24T08:00:36.942878+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.271908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943153+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:36.943153+0000","last_peered":"2026-02-24T08:00:36.943153+0000","last_clean":"2026-02-24T08:00:36.943153+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:36.943153+0000","last_undegraded":"2026-02-24T08:00:36.943153+0000","last_fullsized":"2026-02-24T08:00:36.943153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.401911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944114+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:37.944114+0000","last_peered":"2026-02-24T08:00:37.944114+0000","last_clean":"2026-02-24T08:00:37.944114+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:37.944114+0000","last_undegraded":"2026-02-24T08:00:37.944114+0000","last_fullsized":"2026-02-24T08:00:37.944114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"129'78","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153530+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:38.153530+0000","last_peered":"2026-02-24T08:00:38.153530+0000","last_clean":"2026-02-24T08:00:38.153530+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:38.153530+0000","last_undegraded":"2026-02-24T08:00:38.153530+0000","last_fullsized":"2026-02-24T08:00:38.153530+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":72,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":638976,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942825+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:36.942825+0000","last_peered":"2026-02-24T08:00:36.942825+0000","last_clean":"2026-02-24T08:00:36.942825+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:36.942825+0000","last_undegraded":"2026-02-24T08:00:36.942825+0000","last_fullsized":"2026-02-24T08:00:36.942825+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.592599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"129'80","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157513+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:38.157513+0000","last_peered":"2026-02-24T08:00:38.157513+0000","last_clean":"2026-02-24T08:00:38.157513+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:38.157513+0000","last_undegraded":"2026-02-24T08:00:38.157513+0000","last_fullsized":"2026-02-24T08:00:38.157513+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":72,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944115+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:37.944115+0000","last_peered":"2026-02-24T08:00:37.944115+0000","last_clean":"2026-02-24T08:00:37.944115+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:37.944115+0000","last_undegraded":"2026-02-24T08:00:37.944115+0000","last_fullsized":"2026-02-24T08:00:37.944115+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"129'64","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157588+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:38.157588+0000","last_peered":"2026-02-24T08:00:38.157588+0000","last_clean":"2026-02-24T08:00:38.157588+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:38.157588+0000","last_undegraded":"2026-02-24T08:00:38.157588+0000","last_fullsized":"2026-02-24T08:00:38.157588+0000","mapping_epoch":127,"log_start":"129'56","ondisk_log_start":"129'56","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":56,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"129'56","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153179+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:38.153179+0000","last_peered":"2026-02-24T08:00:38.153179+0000","last_clean":"2026-02-24T08:00:38.153179+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:38.153179+0000","last_undegraded":"2026-02-24T08:00:38.153179+0000","last_fullsized":"2026-02-24T08:00:38.153179+0000","mapping_epoch":127,"log_start":"129'48","ondisk_log_start":"129'48","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":48,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":480,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.936479+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:36.936479+0000","last_peered":"2026-02-24T08:00:36.936479+0000","last_clean":"2026-02-24T08:00:36.936479+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:36.936479+0000","last_undegraded":"2026-02-24T08:00:36.936479+0000","last_fullsized":"2026-02-24T08:00:36.936479+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1449064,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":1447532,"kb_avail":732554136,"statfs":{"total":751619276800,"available":750135435264,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19734,"internal_metadata":1482273514},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":983912,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":982380,"kb_avail":733019288,"statfs":{"total":751619276800,"available":750611750912,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19632,"internal_metadata":1005957968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1220324,"kb_used_data":912,"kb_used_omap":15,"kb_used_meta":1219376,"kb_avail":732782876,"statfs":{"total":751619276800,"available":750369665024,"internally_reserved":0,"allocated":933888,"data_stored":337931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15716,"internal_metadata":1248641692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1582184,"kb_used_data":1492,"kb_used_omap":20,"kb_used_meta":1580651,"kb_avail":732421016,"statfs":{"total":751619276800,"available":749999120384,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20953,"internal_metadata":1618587175},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:40.475 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:40.622 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:40.751 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.747+0000 7f51039a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.751 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:40.748+0000 7f51039a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:40.899 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:40.900 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:40.949 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2026-02-24T08:00:39.895675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3457568,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":485,"num_write_kb":4950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5235484,"kb_used_data":5388,"kb_used_omap":74,"kb_used_meta":5229941,"kb_avail":2930777316,"statfs":{"total":3006477107200,"available":3001115971584,"internally_reserved":0,"allocated":5517312,"data_stored":3122828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":76035,"internal_metadata":5355460349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.960357"},"pg_stats":[{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943107+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:36.943107+0000","last_peered":"2026-02-24T08:00:36.943107+0000","last_clean":"2026-02-24T08:00:36.943107+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:36.943107+0000","last_undegraded":"2026-02-24T08:00:36.943107+0000","last_fullsized":"2026-02-24T08:00:36.943107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:49.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943105+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:36.943105+0000","last_peered":"2026-02-24T08:00:36.943105+0000","last_clean":"2026-02-24T08:00:36.943105+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:36.943105+0000","last_undegraded":"2026-02-24T08:00:36.943105+0000","last_fullsized":"2026-02-24T08:00:36.943105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.364836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943877+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:36.943877+0000","last_peered":"2026-02-24T08:00:36.943877+0000","last_clean":"2026-02-24T08:00:36.943877+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:36.943877+0000","last_undegraded":"2026-02-24T08:00:36.943877+0000","last_fullsized":"2026-02-24T08:00:36.943877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"129'72","reported_seq":77,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.159078+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:38.159078+0000","last_peered":"2026-02-24T08:00:38.159078+0000","last_clean":"2026-02-24T08:00:38.159078+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:38.159078+0000","last_undegraded":"2026-02-24T08:00:38.159078+0000","last_fullsized":"2026-02-24T08:00:38.159078+0000","mapping_epoch":127,"log_start":"129'63","ondisk_log_start":"129'63","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":63,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942779+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:36.942779+0000","last_peered":"2026-02-24T08:00:36.942779+0000","last_clean":"2026-02-24T08:00:36.942779+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:36.942779+0000","last_undegraded":"2026-02-24T08:00:36.942779+0000","last_fullsized":"2026-02-24T08:00:36.942779+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:50.528871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942878+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:36.942878+0000","last_peered":"2026-02-24T08:00:36.942878+0000","last_clean":"2026-02-24T08:00:36.942878+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:36.942878+0000","last_undegraded":"2026-02-24T08:00:36.942878+0000","last_fullsized":"2026-02-24T08:00:36.942878+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.271908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943153+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:36.943153+0000","last_peered":"2026-02-24T08:00:36.943153+0000","last_clean":"2026-02-24T08:00:36.943153+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:36.943153+0000","last_undegraded":"2026-02-24T08:00:36.943153+0000","last_fullsized":"2026-02-24T08:00:36.943153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.401911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944114+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:37.944114+0000","last_peered":"2026-02-24T08:00:37.944114+0000","last_clean":"2026-02-24T08:00:37.944114+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:37.944114+0000","last_undegraded":"2026-02-24T08:00:37.944114+0000","last_fullsized":"2026-02-24T08:00:37.944114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"129'78","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153530+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:38.153530+0000","last_peered":"2026-02-24T08:00:38.153530+0000","last_clean":"2026-02-24T08:00:38.153530+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:38.153530+0000","last_undegraded":"2026-02-24T08:00:38.153530+0000","last_fullsized":"2026-02-24T08:00:38.153530+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":72,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":638976,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942825+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:36.942825+0000","last_peered":"2026-02-24T08:00:36.942825+0000","last_clean":"2026-02-24T08:00:36.942825+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:36.942825+0000","last_undegraded":"2026-02-24T08:00:36.942825+0000","last_fullsized":"2026-02-24T08:00:36.942825+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.592599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"129'80","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157513+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:38.157513+0000","last_peered":"2026-02-24T08:00:38.157513+0000","last_clean":"2026-02-24T08:00:38.157513+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:38.157513+0000","last_undegraded":"2026-02-24T08:00:38.157513+0000","last_fullsized":"2026-02-24T08:00:38.157513+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":72,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944115+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:37.944115+0000","last_peered":"2026-02-24T08:00:37.944115+0000","last_clean":"2026-02-24T08:00:37.944115+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:37.944115+0000","last_undegraded":"2026-02-24T08:00:37.944115+0000","last_fullsized":"2026-02-24T08:00:37.944115+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"129'64","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157588+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:38.157588+0000","last_peered":"2026-02-24T08:00:38.157588+0000","last_clean":"2026-02-24T08:00:38.157588+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:38.157588+0000","last_undegraded":"2026-02-24T08:00:38.157588+0000","last_fullsized":"2026-02-24T08:00:38.157588+0000","mapping_epoch":127,"log_start":"129'56","ondisk_log_start":"129'56","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":56,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"129'56","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153179+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:38.153179+0000","last_peered":"2026-02-24T08:00:38.153179+0000","last_clean":"2026-02-24T08:00:38.153179+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:38.153179+0000","last_undegraded":"2026-02-24T08:00:38.153179+0000","last_fullsized":"2026-02-24T08:00:38.153179+0000","mapping_epoch":127,"log_start":"129'48","ondisk_log_start":"129'48","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":48,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":480,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.936479+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:36.936479+0000","last_peered":"2026-02-24T08:00:36.936479+0000","last_clean":"2026-02-24T08:00:36.936479+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:36.936479+0000","last_undegraded":"2026-02-24T08:00:36.936479+0000","last_fullsized":"2026-02-24T08:00:36.936479+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1449064,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":1447532,"kb_avail":732554136,"statfs":{"total":751619276800,"available":750135435264,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19734,"internal_metadata":1482273514},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":983912,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":982380,"kb_avail":733019288,"statfs":{"total":751619276800,"available":750611750912,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19632,"internal_metadata":1005957968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1220324,"kb_used_data":912,"kb_used_omap":15,"kb_used_meta":1219376,"kb_avail":732782876,"statfs":{"total":751619276800,"available":750369665024,"internally_reserved":0,"allocated":933888,"data_stored":337931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15716,"internal_metadata":1248641692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1582184,"kb_used_data":1492,"kb_used_omap":20,"kb_used_meta":1580651,"kb_avail":732421016,"statfs":{"total":751619276800,"available":749999120384,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20953,"internal_metadata":1618587175},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:40.951 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:00:40.952 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:40.952 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:00:40.952 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:41.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 3 127 29453 29326 76.3639 80.9062 0.010642 0.0130515 2026-02-24T08:00:41.100 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:41.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:40 trial016 ceph-mon[39544]: pgmap v521: 17 pgs: 17 active+clean; 3.3 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 700 KiB/s wr, 87 op/s 2026-02-24T08:00:41.218 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2278035190' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:41.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:41.232+0000 7fbec4739640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:41.235 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:41.232+0000 7fbec4739640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:41.391 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:41.391 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:41.439 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2026-02-24T08:00:39.895675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3457568,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":485,"num_write_kb":4950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5235484,"kb_used_data":5388,"kb_used_omap":74,"kb_used_meta":5229941,"kb_avail":2930777316,"statfs":{"total":3006477107200,"available":3001115971584,"internally_reserved":0,"allocated":5517312,"data_stored":3122828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":76035,"internal_metadata":5355460349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.960357"},"pg_stats":[{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943107+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:36.943107+0000","last_peered":"2026-02-24T08:00:36.943107+0000","last_clean":"2026-02-24T08:00:36.943107+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:36.943107+0000","last_undegraded":"2026-02-24T08:00:36.943107+0000","last_fullsized":"2026-02-24T08:00:36.943107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:49.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943105+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:36.943105+0000","last_peered":"2026-02-24T08:00:36.943105+0000","last_clean":"2026-02-24T08:00:36.943105+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:36.943105+0000","last_undegraded":"2026-02-24T08:00:36.943105+0000","last_fullsized":"2026-02-24T08:00:36.943105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.364836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943877+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:36.943877+0000","last_peered":"2026-02-24T08:00:36.943877+0000","last_clean":"2026-02-24T08:00:36.943877+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:36.943877+0000","last_undegraded":"2026-02-24T08:00:36.943877+0000","last_fullsized":"2026-02-24T08:00:36.943877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"129'72","reported_seq":77,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.159078+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:38.159078+0000","last_peered":"2026-02-24T08:00:38.159078+0000","last_clean":"2026-02-24T08:00:38.159078+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:38.159078+0000","last_undegraded":"2026-02-24T08:00:38.159078+0000","last_fullsized":"2026-02-24T08:00:38.159078+0000","mapping_epoch":127,"log_start":"129'63","ondisk_log_start":"129'63","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":63,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942779+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:36.942779+0000","last_peered":"2026-02-24T08:00:36.942779+0000","last_clean":"2026-02-24T08:00:36.942779+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:36.942779+0000","last_undegraded":"2026-02-24T08:00:36.942779+0000","last_fullsized":"2026-02-24T08:00:36.942779+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:50.528871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944101+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:37.944101+0000","last_peered":"2026-02-24T08:00:37.944101+0000","last_clean":"2026-02-24T08:00:37.944101+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:37.944101+0000","last_undegraded":"2026-02-24T08:00:37.944101+0000","last_fullsized":"2026-02-24T08:00:37.944101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942878+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:36.942878+0000","last_peered":"2026-02-24T08:00:36.942878+0000","last_clean":"2026-02-24T08:00:36.942878+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:36.942878+0000","last_undegraded":"2026-02-24T08:00:36.942878+0000","last_fullsized":"2026-02-24T08:00:36.942878+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.271908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.943153+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:36.943153+0000","last_peered":"2026-02-24T08:00:36.943153+0000","last_clean":"2026-02-24T08:00:36.943153+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:36.943153+0000","last_undegraded":"2026-02-24T08:00:36.943153+0000","last_fullsized":"2026-02-24T08:00:36.943153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.401911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944114+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:37.944114+0000","last_peered":"2026-02-24T08:00:37.944114+0000","last_clean":"2026-02-24T08:00:37.944114+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:37.944114+0000","last_undegraded":"2026-02-24T08:00:37.944114+0000","last_fullsized":"2026-02-24T08:00:37.944114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"129'78","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153530+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:38.153530+0000","last_peered":"2026-02-24T08:00:38.153530+0000","last_clean":"2026-02-24T08:00:38.153530+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:38.153530+0000","last_undegraded":"2026-02-24T08:00:38.153530+0000","last_fullsized":"2026-02-24T08:00:38.153530+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":72,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":638976,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.942825+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:36.942825+0000","last_peered":"2026-02-24T08:00:36.942825+0000","last_clean":"2026-02-24T08:00:36.942825+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:36.942825+0000","last_undegraded":"2026-02-24T08:00:36.942825+0000","last_fullsized":"2026-02-24T08:00:36.942825+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.592599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"129'80","reported_seq":86,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157513+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:38.157513+0000","last_peered":"2026-02-24T08:00:38.157513+0000","last_clean":"2026-02-24T08:00:38.157513+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:38.157513+0000","last_undegraded":"2026-02-24T08:00:38.157513+0000","last_fullsized":"2026-02-24T08:00:38.157513+0000","mapping_epoch":127,"log_start":"129'72","ondisk_log_start":"129'72","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":72,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:37.944115+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:37.944115+0000","last_peered":"2026-02-24T08:00:37.944115+0000","last_clean":"2026-02-24T08:00:37.944115+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:37.944115+0000","last_undegraded":"2026-02-24T08:00:37.944115+0000","last_fullsized":"2026-02-24T08:00:37.944115+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"129'64","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.157588+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:38.157588+0000","last_peered":"2026-02-24T08:00:38.157588+0000","last_clean":"2026-02-24T08:00:38.157588+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:38.157588+0000","last_undegraded":"2026-02-24T08:00:38.157588+0000","last_fullsized":"2026-02-24T08:00:38.157588+0000","mapping_epoch":127,"log_start":"129'56","ondisk_log_start":"129'56","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":56,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"129'56","reported_seq":70,"reported_epoch":129,"state":"active+clean","last_fresh":"2026-02-24T08:00:38.153179+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:38.153179+0000","last_peered":"2026-02-24T08:00:38.153179+0000","last_clean":"2026-02-24T08:00:38.153179+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:38.153179+0000","last_undegraded":"2026-02-24T08:00:38.153179+0000","last_fullsized":"2026-02-24T08:00:38.153179+0000","mapping_epoch":127,"log_start":"129'48","ondisk_log_start":"129'48","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":48,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":480,"reported_epoch":128,"state":"active+clean","last_fresh":"2026-02-24T08:00:36.936479+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:36.936479+0000","last_peered":"2026-02-24T08:00:36.936479+0000","last_clean":"2026-02-24T08:00:36.936479+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:36.936479+0000","last_undegraded":"2026-02-24T08:00:36.936479+0000","last_fullsized":"2026-02-24T08:00:36.936479+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2867200,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1449064,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":1447532,"kb_avail":732554136,"statfs":{"total":751619276800,"available":750135435264,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19734,"internal_metadata":1482273514},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":983912,"kb_used_data":1492,"kb_used_omap":19,"kb_used_meta":982380,"kb_avail":733019288,"statfs":{"total":751619276800,"available":750611750912,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19632,"internal_metadata":1005957968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1220324,"kb_used_data":912,"kb_used_omap":15,"kb_used_meta":1219376,"kb_avail":732782876,"statfs":{"total":751619276800,"available":750369665024,"internally_reserved":0,"allocated":933888,"data_stored":337931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15716,"internal_metadata":1248641692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1582184,"kb_used_data":1492,"kb_used_omap":20,"kb_used_meta":1580651,"kb_avail":732421016,"statfs":{"total":751619276800,"available":749999120384,"internally_reserved":0,"allocated":1527808,"data_stored":928299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20953,"internal_metadata":1618587175},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13547,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:41.441 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:00:41.441 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 281 2026-02-24T08:00:41.591 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:41.723 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:41.719+0000 7ff8742c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:41.723 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:41.720+0000 7ff8742c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:41.882 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:00:41.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:42.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 4 128 38774 38646 75.4747 72.8125 0.00438392 0.013214 2026-02-24T08:00:42.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:41 trial016 ceph-mon[39544]: from='client.15649 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:42.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:41 trial016 ceph-mon[39544]: from='client.15653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:42.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2959355480' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "281"} : dispatch 2026-02-24T08:00:42.433 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:42.578 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:42.698 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:42.694+0000 7fa6ef7f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:42.698 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:42.695+0000 7fa6ef7f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:42.713 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:42.713 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:42.727 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:42.727 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:42.740 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:42.740 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:42.755 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:42.755 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:43.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 5 128 48050 47922 74.8672 72.4688 0.00839675 0.0133339 2026-02-24T08:00:43.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:42 trial016 ceph-mon[39544]: from='client.15655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:43.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:42 trial016 ceph-mon[39544]: pgmap v523: 17 pgs: 17 active+clean; 3.3 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 569 KiB/s wr, 71 op/s 2026-02-24T08:00:43.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:42 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3961742430' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:44.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 6 128 57858 57730 75.1592 76.625 0.0174623 0.0132737 2026-02-24T08:00:44.809 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:44.959 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:45.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 7 128 67850 67722 75.5733 78.0625 0.0146316 0.0132192 2026-02-24T08:00:45.084 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:45.081+0000 7fb09ba0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:45.084 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:45.081+0000 7fb09ba0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:45.102 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:45.102 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:45.102 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:45.102 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:44 trial016 ceph-mon[39544]: pgmap v524: 17 pgs: 17 active+clean; 372 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.93k op/s 2026-02-24T08:00:45.126 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:45.127 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:45.141 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:45.141 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:45.157 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:45.157 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:46.046 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 8 128 77953 77825 75.9921 78.9297 0.00594376 0.0131424 2026-02-24T08:00:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/785795287' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:46.924 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:46.925 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:46.925 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:47.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 9 128 88035 87907 76.2996 78.7656 0.0030586 0.0130909 2026-02-24T08:00:47.078 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:47.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:47.192+0000 7ff413a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:47.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:47.192+0000 7ff413a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:47.210 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:47.235 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:46 trial016 ceph-mon[39544]: pgmap v525: 17 pgs: 17 active+clean; 372 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 6.01k op/s 2026-02-24T08:00:47.358 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:47.358 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:47.359 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:47.411 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":525,"stamp":"2026-02-24T08:00:45.856074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":390578720,"num_objects":5954,"num_object_clones":0,"num_object_copies":17862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5954,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":47741,"num_write_kb":382998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6507044,"kb_used_data":1042772,"kb_used_omap":82,"kb_used_meta":5464109,"kb_avail":2929505756,"statfs":{"total":3006477107200,"available":2999813894144,"internally_reserved":0,"allocated":1067798528,"data_stored":1065310868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":84514,"internal_metadata":5595248094},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,13,5,25,33,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":389988352,"num_objects":5952,"num_object_clones":0,"num_object_copies":17856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47606,"num_write_kb":380848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.913738"},"pg_stats":[{"pgid":"9.f","version":"131'2680","reported_seq":2680,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.893379+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:42.893379+0000","last_peered":"2026-02-24T08:00:42.893379+0000","last_clean":"2026-02-24T08:00:42.893379+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:42.893379+0000","last_undegraded":"2026-02-24T08:00:42.893379+0000","last_fullsized":"2026-02-24T08:00:42.893379+0000","mapping_epoch":127,"log_start":"131'2644","ondisk_log_start":"131'2644","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":2644,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2680,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'2968","reported_seq":2986,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.871304+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:42.871304+0000","last_peered":"2026-02-24T08:00:42.871304+0000","last_clean":"2026-02-24T08:00:42.871304+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:42.871304+0000","last_undegraded":"2026-02-24T08:00:42.871304+0000","last_fullsized":"2026-02-24T08:00:42.871304+0000","mapping_epoch":127,"log_start":"131'2960","ondisk_log_start":"131'2960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2960,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'2832","reported_seq":2846,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.880664+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:42.880664+0000","last_peered":"2026-02-24T08:00:42.880664+0000","last_clean":"2026-02-24T08:00:42.880664+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:42.880664+0000","last_undegraded":"2026-02-24T08:00:42.880664+0000","last_fullsized":"2026-02-24T08:00:42.880664+0000","mapping_epoch":127,"log_start":"131'2826","ondisk_log_start":"131'2826","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":2826,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2832,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"131'3032","reported_seq":3050,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.147968+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:43.147968+0000","last_peered":"2026-02-24T08:00:43.147968+0000","last_clean":"2026-02-24T08:00:43.147968+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:43.147968+0000","last_undegraded":"2026-02-24T08:00:43.147968+0000","last_fullsized":"2026-02-24T08:00:43.147968+0000","mapping_epoch":127,"log_start":"131'3024","ondisk_log_start":"131'3024","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3032,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'2856","reported_seq":2873,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.009166+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:43.009166+0000","last_peered":"2026-02-24T08:00:43.009166+0000","last_clean":"2026-02-24T08:00:43.009166+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:43.009166+0000","last_undegraded":"2026-02-24T08:00:43.009166+0000","last_fullsized":"2026-02-24T08:00:43.009166+0000","mapping_epoch":127,"log_start":"131'2853","ondisk_log_start":"131'2853","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2853,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2856,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'2968","reported_seq":2986,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.873228+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:42.873228+0000","last_peered":"2026-02-24T08:00:42.873228+0000","last_clean":"2026-02-24T08:00:42.873228+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:42.873228+0000","last_undegraded":"2026-02-24T08:00:42.873228+0000","last_fullsized":"2026-02-24T08:00:42.873228+0000","mapping_epoch":127,"log_start":"131'2960","ondisk_log_start":"131'2960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2960,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"131'2772","reported_seq":2787,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.988121+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:42.988121+0000","last_peered":"2026-02-24T08:00:42.988121+0000","last_clean":"2026-02-24T08:00:42.988121+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:42.988121+0000","last_undegraded":"2026-02-24T08:00:42.988121+0000","last_fullsized":"2026-02-24T08:00:42.988121+0000","mapping_epoch":127,"log_start":"131'2768","ondisk_log_start":"131'2768","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2768,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22708224,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2772,"num_write_kb":22176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'2800","reported_seq":2818,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.874117+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:42.874117+0000","last_peered":"2026-02-24T08:00:42.874117+0000","last_clean":"2026-02-24T08:00:42.874117+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:42.874117+0000","last_undegraded":"2026-02-24T08:00:42.874117+0000","last_fullsized":"2026-02-24T08:00:42.874117+0000","mapping_epoch":127,"log_start":"131'2784","ondisk_log_start":"131'2784","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2784,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":22400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'2938","reported_seq":2934,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.893407+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:42.893407+0000","last_peered":"2026-02-24T08:00:42.893407+0000","last_clean":"2026-02-24T08:00:42.893407+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:42.893407+0000","last_undegraded":"2026-02-24T08:00:42.893407+0000","last_fullsized":"2026-02-24T08:00:42.893407+0000","mapping_epoch":127,"log_start":"131'2913","ondisk_log_start":"131'2913","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2913,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24068096,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2938,"num_write_kb":23504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"131'3192","reported_seq":3210,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.006758+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:43.006758+0000","last_peered":"2026-02-24T08:00:43.006758+0000","last_clean":"2026-02-24T08:00:43.006758+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:43.006758+0000","last_undegraded":"2026-02-24T08:00:43.006758+0000","last_fullsized":"2026-02-24T08:00:43.006758+0000","mapping_epoch":127,"log_start":"131'3187","ondisk_log_start":"131'3187","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26148864,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3192,"num_write_kb":25536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"131'3168","reported_seq":3186,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.157914+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:43.157914+0000","last_peered":"2026-02-24T08:00:43.157914+0000","last_clean":"2026-02-24T08:00:43.157914+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:43.157914+0000","last_undegraded":"2026-02-24T08:00:43.157914+0000","last_fullsized":"2026-02-24T08:00:43.157914+0000","mapping_epoch":127,"log_start":"131'3160","ondisk_log_start":"131'3160","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3168,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'2880","reported_seq":2898,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:42.856648+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:42.856648+0000","last_peered":"2026-02-24T08:00:42.856648+0000","last_clean":"2026-02-24T08:00:42.856648+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:42.856648+0000","last_undegraded":"2026-02-24T08:00:42.856648+0000","last_fullsized":"2026-02-24T08:00:42.856648+0000","mapping_epoch":127,"log_start":"131'2872","ondisk_log_start":"131'2872","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":2872,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2880,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"131'3400","reported_seq":3416,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.162775+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:43.162775+0000","last_peered":"2026-02-24T08:00:43.162775+0000","last_clean":"2026-02-24T08:00:43.162775+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:43.162775+0000","last_undegraded":"2026-02-24T08:00:43.162775+0000","last_fullsized":"2026-02-24T08:00:43.162775+0000","mapping_epoch":127,"log_start":"131'3376","ondisk_log_start":"131'3376","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3400,"num_write_kb":27200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"131'3016","reported_seq":3034,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.003017+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:43.003017+0000","last_peered":"2026-02-24T08:00:43.003017+0000","last_clean":"2026-02-24T08:00:43.003017+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:43.003017+0000","last_undegraded":"2026-02-24T08:00:43.003017+0000","last_fullsized":"2026-02-24T08:00:43.003017+0000","mapping_epoch":127,"log_start":"131'3008","ondisk_log_start":"131'3008","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3016,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"131'3016","reported_seq":3027,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.162733+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:43.162733+0000","last_peered":"2026-02-24T08:00:43.162733+0000","last_clean":"2026-02-24T08:00:43.162733+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:43.162733+0000","last_undegraded":"2026-02-24T08:00:43.162733+0000","last_fullsized":"2026-02-24T08:00:43.162733+0000","mapping_epoch":127,"log_start":"131'3000","ondisk_log_start":"131'3000","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3016,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"131'3088","reported_seq":3106,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:43.157353+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:43.157353+0000","last_peered":"2026-02-24T08:00:43.157353+0000","last_clean":"2026-02-24T08:00:43.157353+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:43.157353+0000","last_undegraded":"2026-02-24T08:00:43.157353+0000","last_fullsized":"2026-02-24T08:00:43.157353+0000","mapping_epoch":127,"log_start":"131'3072","ondisk_log_start":"131'3072","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3088,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":389988352,"num_objects":5952,"num_object_clones":0,"num_object_copies":17856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47606,"num_write_kb":380848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1168932864,"data_stored":1168932864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215274,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1760924,"kb_used_data":259208,"kb_used_omap":21,"kb_used_meta":1501674,"kb_avail":732242276,"statfs":{"total":751619276800,"available":749816090624,"internally_reserved":0,"allocated":265428992,"data_stored":264806189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21693,"internal_metadata":1537715011},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444203,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1251700,"kb_used_data":233184,"kb_used_omap":21,"kb_used_meta":1018474,"kb_avail":732751500,"statfs":{"total":751619276800,"available":750337536000,"internally_reserved":0,"allocated":238780416,"data_stored":238157613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1042918316},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1648368,"kb_used_data":338716,"kb_used_omap":17,"kb_used_meta":1309614,"kb_avail":732354832,"statfs":{"total":751619276800,"available":749931347968,"internally_reserved":0,"allocated":346845184,"data_stored":346225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17672,"internal_metadata":1341045496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,5,16,25,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705840,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1846052,"kb_used_data":211664,"kb_used_omap":23,"kb_used_meta":1634344,"kb_avail":732157148,"statfs":{"total":751619276800,"available":749728919552,"internally_reserved":0,"allocated":216743936,"data_stored":216121133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":1673569271},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,13,0,9,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242663424,"data_stored":242663424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":352796672,"data_stored":352796672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":261636096,"data_stored":261636096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311836672,"data_stored":311836672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:47.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:47.488+0000 7f9ef3eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:47.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:47.489+0000 7f9ef3eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:47.509 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:47.509 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:47.525 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:47.525 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:47.538 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:47.538 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:47.552 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:47.553 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:48.045 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 10 128 97682 97554 76.2058 75.3672 0.0143078 0.0131111 2026-02-24T08:00:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:47 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:00:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:47 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:00:48.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:47 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2342559601' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:49.046 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 11 128 107767 107639 76.4401 78.7891 0.0058151 0.0130682 2026-02-24T08:00:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:48 trial016 ceph-mon[39544]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:48 trial016 ceph-mon[39544]: pgmap v526: 17 pgs: 17 active+clean; 372 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 41 MiB/s wr, 5.30k op/s 2026-02-24T08:00:49.601 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:49.753 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:49.887 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:49.885+0000 7f75cdbcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:49.888 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:49.886+0000 7f75cdbcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:49.913 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:49.913 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:49.938 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:49.939 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:49.955 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:49.955 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:49.974 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:49.974 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:50.046 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 12 128 117804 117676 76.604 78.4141 0.00252867 0.0130437 2026-02-24T08:00:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:49 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1646421992' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:51.046 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 13 127 127593 127466 76.5944 76.4844 0.0218504 0.0130445 2026-02-24T08:00:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:50 trial016 ceph-mon[39544]: pgmap v527: 17 pgs: 17 active+clean; 760 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 76 MiB/s wr, 9.68k op/s 2026-02-24T08:00:52.023 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:52.046 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 14 128 138452 138324 77.182 84.8281 0.00209017 0.0129475 2026-02-24T08:00:52.175 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:52.306 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:52.303+0000 7f54c28d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:52.306 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:52.304+0000 7f54c28d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:52.321 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:52.321 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:52.345 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:52.345 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:52.360 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:52.360 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:52.372 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:52.373 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:52.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:52.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:52.414 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_7 2026-02-24T08:00:52.414 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:52.558 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:52.685 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:52.683+0000 7f4ab09f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:52.685 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:52.683+0000 7f4ab09f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:52.841 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:52.842 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:00:52.897 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2026-02-24T08:00:51.856852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":796901920,"num_objects":12154,"num_object_clones":0,"num_object_copies":36462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12154,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":97341,"num_write_kb":779798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7688196,"kb_used_data":2208044,"kb_used_omap":82,"kb_used_meta":5479981,"kb_avail":2928324604,"statfs":{"total":3006477107200,"available":2998604394496,"internally_reserved":0,"allocated":2261037056,"data_stored":2258549396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":84514,"internal_metadata":5611501022},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,8,22,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":793444352,"num_objects":12108,"num_object_clones":0,"num_object_copies":36324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96856,"num_write_kb":774848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.961176"},"pg_stats":[{"pgid":"9.f","version":"131'5552","reported_seq":5570,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.887074+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:47.887074+0000","last_peered":"2026-02-24T08:00:47.887074+0000","last_clean":"2026-02-24T08:00:47.887074+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:47.887074+0000","last_undegraded":"2026-02-24T08:00:47.887074+0000","last_fullsized":"2026-02-24T08:00:47.887074+0000","mapping_epoch":127,"log_start":"131'5544","ondisk_log_start":"131'5544","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5552,"num_write_kb":44416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'5960","reported_seq":5978,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.886386+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:47.886386+0000","last_peered":"2026-02-24T08:00:47.886386+0000","last_clean":"2026-02-24T08:00:47.886386+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:47.886386+0000","last_undegraded":"2026-02-24T08:00:47.886386+0000","last_fullsized":"2026-02-24T08:00:47.886386+0000","mapping_epoch":127,"log_start":"131'5952","ondisk_log_start":"131'5952","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":47680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'6056","reported_seq":6074,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.866462+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:47.866462+0000","last_peered":"2026-02-24T08:00:47.866462+0000","last_clean":"2026-02-24T08:00:47.866462+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:47.866462+0000","last_undegraded":"2026-02-24T08:00:47.866462+0000","last_fullsized":"2026-02-24T08:00:47.866462+0000","mapping_epoch":127,"log_start":"131'6048","ondisk_log_start":"131'6048","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49610752,"num_objects":757,"num_object_clones":0,"num_object_copies":2271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6056,"num_write_kb":48448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"131'6160","reported_seq":6178,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.156358+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:48.156358+0000","last_peered":"2026-02-24T08:00:48.156358+0000","last_clean":"2026-02-24T08:00:48.156358+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:48.156358+0000","last_undegraded":"2026-02-24T08:00:48.156358+0000","last_fullsized":"2026-02-24T08:00:48.156358+0000","mapping_epoch":127,"log_start":"131'6139","ondisk_log_start":"131'6139","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":3000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50462720,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6160,"num_write_kb":49280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'6055","reported_seq":6070,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.008011+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:48.008011+0000","last_peered":"2026-02-24T08:00:48.008011+0000","last_clean":"2026-02-24T08:00:48.008011+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:48.008011+0000","last_undegraded":"2026-02-24T08:00:48.008011+0000","last_fullsized":"2026-02-24T08:00:48.008011+0000","mapping_epoch":127,"log_start":"131'6049","ondisk_log_start":"131'6049","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49602560,"num_objects":757,"num_object_clones":0,"num_object_copies":2271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6055,"num_write_kb":48440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'6158","reported_seq":6170,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.892181+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:47.892181+0000","last_peered":"2026-02-24T08:00:47.892181+0000","last_clean":"2026-02-24T08:00:47.892181+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:47.892181+0000","last_undegraded":"2026-02-24T08:00:47.892181+0000","last_fullsized":"2026-02-24T08:00:47.892181+0000","mapping_epoch":127,"log_start":"131'6146","ondisk_log_start":"131'6146","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50446336,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6158,"num_write_kb":49264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"131'5840","reported_seq":5858,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.005932+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:48.005932+0000","last_peered":"2026-02-24T08:00:48.005932+0000","last_clean":"2026-02-24T08:00:48.005932+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:48.005932+0000","last_undegraded":"2026-02-24T08:00:48.005932+0000","last_fullsized":"2026-02-24T08:00:48.005932+0000","mapping_epoch":127,"log_start":"131'5834","ondisk_log_start":"131'5834","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47841280,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5840,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'5992","reported_seq":6010,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.888514+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:47.888514+0000","last_peered":"2026-02-24T08:00:47.888514+0000","last_clean":"2026-02-24T08:00:47.888514+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:47.888514+0000","last_undegraded":"2026-02-24T08:00:47.888514+0000","last_fullsized":"2026-02-24T08:00:47.888514+0000","mapping_epoch":127,"log_start":"131'5984","ondisk_log_start":"131'5984","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49086464,"num_objects":749,"num_object_clones":0,"num_object_copies":2247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":47936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'6137","reported_seq":6154,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.893204+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:47.893204+0000","last_peered":"2026-02-24T08:00:47.893204+0000","last_clean":"2026-02-24T08:00:47.893204+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:47.893204+0000","last_undegraded":"2026-02-24T08:00:47.893204+0000","last_fullsized":"2026-02-24T08:00:47.893204+0000","mapping_epoch":127,"log_start":"131'6131","ondisk_log_start":"131'6131","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50274304,"num_objects":768,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":49096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"131'6280","reported_seq":6298,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.002106+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:48.002106+0000","last_peered":"2026-02-24T08:00:48.002106+0000","last_clean":"2026-02-24T08:00:48.002106+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:48.002106+0000","last_undegraded":"2026-02-24T08:00:48.002106+0000","last_fullsized":"2026-02-24T08:00:48.002106+0000","mapping_epoch":127,"log_start":"131'6272","ondisk_log_start":"131'6272","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445760,"num_objects":785,"num_object_clones":0,"num_object_copies":2355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6280,"num_write_kb":50240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"131'6296","reported_seq":6314,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.135991+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:48.135991+0000","last_peered":"2026-02-24T08:00:48.135991+0000","last_clean":"2026-02-24T08:00:48.135991+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:48.135991+0000","last_undegraded":"2026-02-24T08:00:48.135991+0000","last_fullsized":"2026-02-24T08:00:48.135991+0000","mapping_epoch":127,"log_start":"131'6280","ondisk_log_start":"131'6280","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51576832,"num_objects":787,"num_object_clones":0,"num_object_copies":2361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6296,"num_write_kb":50368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'5896","reported_seq":5914,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:47.865844+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:47.865844+0000","last_peered":"2026-02-24T08:00:47.865844+0000","last_clean":"2026-02-24T08:00:47.865844+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:47.865844+0000","last_undegraded":"2026-02-24T08:00:47.865844+0000","last_fullsized":"2026-02-24T08:00:47.865844+0000","mapping_epoch":127,"log_start":"131'5889","ondisk_log_start":"131'5889","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"131'6368","reported_seq":6386,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.155385+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:48.155385+0000","last_peered":"2026-02-24T08:00:48.155385+0000","last_clean":"2026-02-24T08:00:48.155385+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:48.155385+0000","last_undegraded":"2026-02-24T08:00:48.155385+0000","last_fullsized":"2026-02-24T08:00:48.155385+0000","mapping_epoch":127,"log_start":"131'6346","ondisk_log_start":"131'6346","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":3000,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6368,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"131'6408","reported_seq":6426,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.003191+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:48.003191+0000","last_peered":"2026-02-24T08:00:48.003191+0000","last_clean":"2026-02-24T08:00:48.003191+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:48.003191+0000","last_undegraded":"2026-02-24T08:00:48.003191+0000","last_fullsized":"2026-02-24T08:00:48.003191+0000","mapping_epoch":127,"log_start":"131'6400","ondisk_log_start":"131'6400","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6408,"num_write_kb":51264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"131'5744","reported_seq":5762,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.163521+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:48.163521+0000","last_peered":"2026-02-24T08:00:48.163521+0000","last_clean":"2026-02-24T08:00:48.163521+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:48.163521+0000","last_undegraded":"2026-02-24T08:00:48.163521+0000","last_fullsized":"2026-02-24T08:00:48.163521+0000","mapping_epoch":127,"log_start":"131'5712","ondisk_log_start":"131'5712","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47054848,"num_objects":718,"num_object_clones":0,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5744,"num_write_kb":45952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"131'6304","reported_seq":6322,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:48.132851+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:48.132851+0000","last_peered":"2026-02-24T08:00:48.132851+0000","last_clean":"2026-02-24T08:00:48.132851+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:48.132851+0000","last_undegraded":"2026-02-24T08:00:48.132851+0000","last_fullsized":"2026-02-24T08:00:48.132851+0000","mapping_epoch":127,"log_start":"131'6296","ondisk_log_start":"131'6296","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51642368,"num_objects":788,"num_object_clones":0,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":50432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":796311552,"num_objects":12152,"num_object_clones":0,"num_object_copies":36456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97206,"num_write_kb":777648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2387091456,"data_stored":2387091456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215275,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1757236,"kb_used_data":582560,"kb_used_omap":21,"kb_used_meta":1174634,"kb_avail":732245964,"statfs":{"total":751619276800,"available":749819867136,"internally_reserved":0,"allocated":596541440,"data_stored":595918637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21693,"internal_metadata":1202826051},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444204,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1620748,"kb_used_data":493944,"kb_used_omap":21,"kb_used_meta":1126762,"kb_avail":732382452,"statfs":{"total":751619276800,"available":749959630848,"internally_reserved":0,"allocated":505798656,"data_stored":505175853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1153805228},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,8,8,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2115064,"kb_used_data":679076,"kb_used_omap":17,"kb_used_meta":1435950,"kb_avail":731888136,"statfs":{"total":751619276800,"available":749453451264,"internally_reserved":0,"allocated":695373824,"data_stored":694754573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17672,"internal_metadata":1470413560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705841,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2195148,"kb_used_data":452464,"kb_used_omap":23,"kb_used_meta":1742632,"kb_avail":731808052,"statfs":{"total":751619276800,"available":749371445248,"internally_reserved":0,"allocated":463323136,"data_stored":462700333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":1784456183},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,0,14],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":495321088,"data_stored":495321088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":708345856,"data_stored":708345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":537305088,"data_stored":537305088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":646119424,"data_stored":646119424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:00:52.898 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:00:52.899 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_7 pg_num 26 2026-02-24T08:00:53.045 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:53.047 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 15 127 147982 147855 76.9931 74.4609 0.011253 0.0129813 2026-02-24T08:00:53.107 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:52 trial016 ceph-mon[39544]: pgmap v528: 17 pgs: 17 active+clean; 760 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.10k op/s 2026-02-24T08:00:53.107 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:52 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3600074453' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:53.185 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:53.183+0000 7f55a1f31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:53.185 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:53.183+0000 7f55a1f31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:53.330 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:00:53.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:00:54.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 16 128 157792 157664 76.9703 76.6328 0.00407675 0.0129824 2026-02-24T08:00:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:53 trial016 ceph-mon[39544]: from='client.15671 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:00:54.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:53 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3554486163' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:00:54.421 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:00:54.577 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:54.966 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:00:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:00:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:00:55.023 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:55.002+0000 7f43fcd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:55.024 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:55.002+0000 7f43fcd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:55.039 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:55.039 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:55.047 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 17 128 166159 166031 76.2875 65.3672 0.00813495 0.0130986 2026-02-24T08:00:55.057 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:55.057 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:55.073 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:55.074 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:55.092 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:55.092 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:55.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:54 trial016 ceph-mon[39544]: pgmap v529: 17 pgs: 17 active+clean; 1.1 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s wr, 12.26k op/s 2026-02-24T08:00:56.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 18 127 173629 173502 75.2918 58.3672 0.00999436 0.0132751 2026-02-24T08:00:56.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3054371166' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:57.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 19 128 183194 183066 75.2614 74.7188 0.0205463 0.0132793 2026-02-24T08:00:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:56 trial016 ceph-mon[39544]: pgmap v530: 17 pgs: 17 active+clean; 1.1 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.32k op/s 2026-02-24T08:00:57.845 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:00:58.001 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:58.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T08:00:58.047178+0000 min lat: 0.000610054 max lat: 0.0844816 avg lat: 0.013291 2026-02-24T08:00:58.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:00:58.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 20 128 192688 192560 75.2066 74.1719 0.0110311 0.013291 2026-02-24T08:00:58.402 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:00:58.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:00:58.403 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:00:58.403 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:00:58.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:58.474+0000 7fe728f39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:58.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:58.474+0000 7fe728f39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:58.512 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:00:58.512 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:00:58.528 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:00:58.528 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:00:58.543 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:00:58.543 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:00:58.545 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:00:58.563 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:00:58.563 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:00:59.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 21 128 199463 199335 74.1456 52.9297 0.0146071 0.0134793 2026-02-24T08:00:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:58 trial016 ceph-mon[39544]: pgmap v531: 17 pgs: 17 active+clean; 1.1 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.32k op/s 2026-02-24T08:00:59.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:00:58 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1039496166' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:00:59.640 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:59.621+0000 7f5f12496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:59.640 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:00:59.622+0000 7f5f12496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:00:59.758 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:00:59.758 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:00.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 22 128 205501 205373 72.9195 47.1719 0.0453715 0.0136954 2026-02-24T08:01:00.446 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":531,"stamp":"2026-02-24T08:00:57.857653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1208885792,"num_objects":18440,"num_object_clones":0,"num_object_copies":55320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18440,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":147632,"num_write_kb":1182126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9256804,"kb_used_data":3415692,"kb_used_omap":82,"kb_used_meta":5840941,"kb_avail":2926755996,"statfs":{"total":3006477107200,"available":2996998139904,"internally_reserved":0,"allocated":3497668608,"data_stored":3495180948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":84514,"internal_metadata":5981124062},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,0,7,39,16,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":818307072,"num_objects":12486,"num_object_clones":0,"num_object_copies":37458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99891,"num_write_kb":799128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001578"},"pg_stats":[{"pgid":"9.f","version":"131'8468","reported_seq":8481,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.897251+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:00:52.897251+0000","last_peered":"2026-02-24T08:00:52.897251+0000","last_clean":"2026-02-24T08:00:52.897251+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:00:52.897251+0000","last_undegraded":"2026-02-24T08:00:52.897251+0000","last_fullsized":"2026-02-24T08:00:52.897251+0000","mapping_epoch":127,"log_start":"131'8459","ondisk_log_start":"131'8459","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69369856,"num_objects":1059,"num_object_clones":0,"num_object_copies":3177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8468,"num_write_kb":67744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'9072","reported_seq":9090,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.887373+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:00:52.887373+0000","last_peered":"2026-02-24T08:00:52.887373+0000","last_clean":"2026-02-24T08:00:52.887373+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:00:52.887373+0000","last_undegraded":"2026-02-24T08:00:52.887373+0000","last_fullsized":"2026-02-24T08:00:52.887373+0000","mapping_epoch":127,"log_start":"131'9060","ondisk_log_start":"131'9060","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74317824,"num_objects":1134,"num_object_clones":0,"num_object_copies":3402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9072,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'9000","reported_seq":9018,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.874774+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:00:52.874774+0000","last_peered":"2026-02-24T08:00:52.874774+0000","last_clean":"2026-02-24T08:00:52.874774+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:00:52.874774+0000","last_undegraded":"2026-02-24T08:00:52.874774+0000","last_fullsized":"2026-02-24T08:00:52.874774+0000","mapping_epoch":127,"log_start":"131'8984","ondisk_log_start":"131'8984","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73728000,"num_objects":1125,"num_object_clones":0,"num_object_copies":3375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9000,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"131'9000","reported_seq":9018,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.126352+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:00:53.126352+0000","last_peered":"2026-02-24T08:00:53.126352+0000","last_clean":"2026-02-24T08:00:53.126352+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:00:53.126352+0000","last_undegraded":"2026-02-24T08:00:53.126352+0000","last_fullsized":"2026-02-24T08:00:53.126352+0000","mapping_epoch":127,"log_start":"131'8984","ondisk_log_start":"131'8984","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73728000,"num_objects":1125,"num_object_clones":0,"num_object_copies":3375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9000,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'9184","reported_seq":9202,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.001028+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:00:53.001028+0000","last_peered":"2026-02-24T08:00:53.001028+0000","last_clean":"2026-02-24T08:00:53.001028+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:00:53.001028+0000","last_undegraded":"2026-02-24T08:00:53.001028+0000","last_fullsized":"2026-02-24T08:00:53.001028+0000","mapping_epoch":127,"log_start":"131'9176","ondisk_log_start":"131'9176","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75235328,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9184,"num_write_kb":73472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'9408","reported_seq":9426,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.878376+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:00:52.878376+0000","last_peered":"2026-02-24T08:00:52.878376+0000","last_clean":"2026-02-24T08:00:52.878376+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:00:52.878376+0000","last_undegraded":"2026-02-24T08:00:52.878376+0000","last_fullsized":"2026-02-24T08:00:52.878376+0000","mapping_epoch":127,"log_start":"131'9400","ondisk_log_start":"131'9400","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77070336,"num_objects":1176,"num_object_clones":0,"num_object_copies":3528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9408,"num_write_kb":75264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"131'9112","reported_seq":9130,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.979839+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:00:52.979839+0000","last_peered":"2026-02-24T08:00:52.979839+0000","last_clean":"2026-02-24T08:00:52.979839+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:00:52.979839+0000","last_undegraded":"2026-02-24T08:00:52.979839+0000","last_fullsized":"2026-02-24T08:00:52.979839+0000","mapping_epoch":127,"log_start":"131'9106","ondisk_log_start":"131'9106","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9112,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'9320","reported_seq":9338,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.894695+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:00:52.894695+0000","last_peered":"2026-02-24T08:00:52.894695+0000","last_clean":"2026-02-24T08:00:52.894695+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:00:52.894695+0000","last_undegraded":"2026-02-24T08:00:52.894695+0000","last_fullsized":"2026-02-24T08:00:52.894695+0000","mapping_epoch":127,"log_start":"131'9313","ondisk_log_start":"131'9313","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76349440,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9320,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'9288","reported_seq":9306,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.894344+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:00:52.894344+0000","last_peered":"2026-02-24T08:00:52.894344+0000","last_clean":"2026-02-24T08:00:52.894344+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:00:52.894344+0000","last_undegraded":"2026-02-24T08:00:52.894344+0000","last_fullsized":"2026-02-24T08:00:52.894344+0000","mapping_epoch":127,"log_start":"131'9280","ondisk_log_start":"131'9280","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76087296,"num_objects":1161,"num_object_clones":0,"num_object_copies":3483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9288,"num_write_kb":74304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"131'9384","reported_seq":9402,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.997401+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:00:52.997401+0000","last_peered":"2026-02-24T08:00:52.997401+0000","last_clean":"2026-02-24T08:00:52.997401+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:00:52.997401+0000","last_undegraded":"2026-02-24T08:00:52.997401+0000","last_fullsized":"2026-02-24T08:00:52.997401+0000","mapping_epoch":127,"log_start":"131'9377","ondisk_log_start":"131'9377","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76873728,"num_objects":1173,"num_object_clones":0,"num_object_copies":3519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9384,"num_write_kb":75072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"131'9424","reported_seq":9442,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.165579+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:00:53.165579+0000","last_peered":"2026-02-24T08:00:53.165579+0000","last_clean":"2026-02-24T08:00:53.165579+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:00:53.165579+0000","last_undegraded":"2026-02-24T08:00:53.165579+0000","last_fullsized":"2026-02-24T08:00:53.165579+0000","mapping_epoch":127,"log_start":"131'9416","ondisk_log_start":"131'9416","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77201408,"num_objects":1178,"num_object_clones":0,"num_object_copies":3534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'9016","reported_seq":9026,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:52.885131+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:00:52.885131+0000","last_peered":"2026-02-24T08:00:52.885131+0000","last_clean":"2026-02-24T08:00:52.885131+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:00:52.885131+0000","last_undegraded":"2026-02-24T08:00:52.885131+0000","last_fullsized":"2026-02-24T08:00:52.885131+0000","mapping_epoch":127,"log_start":"131'9000","ondisk_log_start":"131'9000","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73859072,"num_objects":1127,"num_object_clones":0,"num_object_copies":3381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9016,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"131'9584","reported_seq":9602,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.146222+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:00:53.146222+0000","last_peered":"2026-02-24T08:00:53.146222+0000","last_clean":"2026-02-24T08:00:53.146222+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:00:53.146222+0000","last_undegraded":"2026-02-24T08:00:53.146222+0000","last_fullsized":"2026-02-24T08:00:53.146222+0000","mapping_epoch":127,"log_start":"131'9560","ondisk_log_start":"131'9560","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78512128,"num_objects":1198,"num_object_clones":0,"num_object_copies":3594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9584,"num_write_kb":76672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"131'9952","reported_seq":9970,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.008843+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:00:53.008843+0000","last_peered":"2026-02-24T08:00:53.008843+0000","last_clean":"2026-02-24T08:00:53.008843+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:00:53.008843+0000","last_undegraded":"2026-02-24T08:00:53.008843+0000","last_fullsized":"2026-02-24T08:00:53.008843+0000","mapping_epoch":127,"log_start":"131'9948","ondisk_log_start":"131'9948","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81526784,"num_objects":1244,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9952,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"131'8720","reported_seq":8738,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.149526+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:00:53.149526+0000","last_peered":"2026-02-24T08:00:53.149526+0000","last_clean":"2026-02-24T08:00:53.149526+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:00:53.149526+0000","last_undegraded":"2026-02-24T08:00:53.149526+0000","last_fullsized":"2026-02-24T08:00:53.149526+0000","mapping_epoch":127,"log_start":"131'8696","ondisk_log_start":"131'8696","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8720,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"131'9565","reported_seq":9577,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:53.165988+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:00:53.165988+0000","last_peered":"2026-02-24T08:00:53.165988+0000","last_clean":"2026-02-24T08:00:53.165988+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:00:53.165988+0000","last_undegraded":"2026-02-24T08:00:53.165988+0000","last_fullsized":"2026-02-24T08:00:53.165988+0000","mapping_epoch":127,"log_start":"131'9552","ondisk_log_start":"131'9552","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78356480,"num_objects":1196,"num_object_clones":0,"num_object_copies":3588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9565,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1208295424,"num_objects":18438,"num_object_clones":0,"num_object_copies":55314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147497,"num_write_kb":1179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3623895040,"data_stored":3623895040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215276,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2181756,"kb_used_data":916832,"kb_used_omap":21,"kb_used_meta":1264874,"kb_avail":731821444,"statfs":{"total":751619276800,"available":749385158656,"internally_reserved":0,"allocated":938835968,"data_stored":938213165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21693,"internal_metadata":1295231811},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444205,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1979932,"kb_used_data":762888,"kb_used_omap":21,"kb_used_meta":1217002,"kb_avail":732023268,"statfs":{"total":751619276800,"available":749591826432,"internally_reserved":0,"allocated":781197312,"data_stored":780574509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1246210988},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,25,16,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2570696,"kb_used_data":1026420,"kb_used_omap":17,"kb_used_meta":1544238,"kb_avail":731432504,"statfs":{"total":751619276800,"available":748986884096,"internally_reserved":0,"allocated":1051054080,"data_stored":1050434829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17672,"internal_metadata":1581300472},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705842,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2524420,"kb_used_data":709552,"kb_used_omap":23,"kb_used_meta":1814824,"kb_avail":731478780,"statfs":{"total":751619276800,"available":749034270720,"internally_reserved":0,"allocated":726581248,"data_stored":725958445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":1858380791},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,0,14],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":754237440,"data_stored":754237440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1068466176,"data_stored":1068466176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":817438720,"data_stored":817438720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":983752704,"data_stored":983752704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:00.448 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 281 2026-02-24T08:01:00.601 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:00.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:00.827+0000 7fd01da3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:00.830 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:00.827+0000 7fd01da3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:00.974 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:01:01.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 23 127 213419 213292 72.4388 61.8672 0.0198416 0.0137935 2026-02-24T08:01:01.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='client.15679 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: pgmap v532: 17 pgs: 17 active+clean; 1.5 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 94 MiB/s wr, 12.04k op/s 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T08:01:01.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:00 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:01:01.808 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:01.964 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:02.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 24 128 222898 222770 72.5055 74.0469 0.010036 0.0137804 2026-02-24T08:01:02.265 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:01 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2660794092' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "281"} : dispatch 2026-02-24T08:01:02.397 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:02.397 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:02.397 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:02.397 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:02.318+0000 7f5835bcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:02.319+0000 7f5835bcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:02.398 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:03.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 25 128 229555 229427 71.6855 52.0078 0.00706359 0.013944 2026-02-24T08:01:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:02 trial016 ceph-mon[39544]: pgmap v533: 17 pgs: 17 active+clean; 1.5 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.91k op/s 2026-02-24T08:01:03.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1398475370' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:04.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 26 128 240167 240039 72.1168 82.9062 0.014288 0.0138612 2026-02-24T08:01:04.942 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:05.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 27 127 250744 250617 72.5064 82.6406 0.0133461 0.0137865 2026-02-24T08:01:05.101 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:05.170 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:04 trial016 ceph-mon[39544]: pgmap v534: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.01k op/s 2026-02-24T08:01:05.170 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:05.233 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:05.230+0000 7f31847c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:05.233 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:05.230+0000 7f31847c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:05.249 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:05.249 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:05.276 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:05.276 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:05.290 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:05.290 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:05.308 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:05.309 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:06.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 28 127 260966 260839 72.7687 79.8594 0.0114904 0.0137376 2026-02-24T08:01:06.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:06.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:06.201 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:01:06.201 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:06.227 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:05 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/534158098' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:06.353 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:06.481 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:06.479+0000 7f7a7bf31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:06.482 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:06.479+0000 7f7a7bf31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:06.635 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:06.635 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:06.685 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2026-02-24T08:01:05.858727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1878983200,"num_objects":28665,"num_object_clones":0,"num_object_copies":85995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28665,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":229431,"num_write_kb":1836518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11218908,"kb_used_data":5417420,"kb_used_omap":82,"kb_used_meta":5801325,"kb_avail":2924793892,"statfs":{"total":3006477107200,"available":2994988945408,"internally_reserved":0,"allocated":5547438080,"data_stored":5544950420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":84514,"internal_metadata":5940557278},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[25,6,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":670097408,"num_objects":10225,"num_object_clones":0,"num_object_copies":30675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81799,"num_write_kb":654392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001631"},"pg_stats":[{"pgid":"9.f","version":"131'13448","reported_seq":13466,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.882460+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:02.882460+0000","last_peered":"2026-02-24T08:01:02.882460+0000","last_clean":"2026-02-24T08:01:02.882460+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:02.882460+0000","last_undegraded":"2026-02-24T08:01:02.882460+0000","last_fullsized":"2026-02-24T08:01:02.882460+0000","mapping_epoch":127,"log_start":"131'13416","ondisk_log_start":"131'13416","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110166016,"num_objects":1681,"num_object_clones":0,"num_object_copies":5043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13448,"num_write_kb":107584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'14280","reported_seq":14298,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.881924+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:02.881924+0000","last_peered":"2026-02-24T08:01:02.881924+0000","last_clean":"2026-02-24T08:01:02.881924+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:02.881924+0000","last_undegraded":"2026-02-24T08:01:02.881924+0000","last_fullsized":"2026-02-24T08:01:02.881924+0000","mapping_epoch":127,"log_start":"131'14264","ondisk_log_start":"131'14264","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116981760,"num_objects":1785,"num_object_clones":0,"num_object_copies":5355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14280,"num_write_kb":114240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'14096","reported_seq":14114,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.877437+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:02.877437+0000","last_peered":"2026-02-24T08:01:02.877437+0000","last_clean":"2026-02-24T08:01:02.877437+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:02.877437+0000","last_undegraded":"2026-02-24T08:01:02.877437+0000","last_fullsized":"2026-02-24T08:01:02.877437+0000","mapping_epoch":127,"log_start":"131'14092","ondisk_log_start":"131'14092","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115474432,"num_objects":1762,"num_object_clones":0,"num_object_copies":5286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14096,"num_write_kb":112768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"131'14440","reported_seq":14458,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.165326+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:03.165326+0000","last_peered":"2026-02-24T08:01:03.165326+0000","last_clean":"2026-02-24T08:01:03.165326+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:03.165326+0000","last_undegraded":"2026-02-24T08:01:03.165326+0000","last_fullsized":"2026-02-24T08:01:03.165326+0000","mapping_epoch":127,"log_start":"131'14424","ondisk_log_start":"131'14424","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118292480,"num_objects":1805,"num_object_clones":0,"num_object_copies":5415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14440,"num_write_kb":115520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'14064","reported_seq":14082,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.992819+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:02.992819+0000","last_peered":"2026-02-24T08:01:02.992819+0000","last_clean":"2026-02-24T08:01:02.992819+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:02.992819+0000","last_undegraded":"2026-02-24T08:01:02.992819+0000","last_fullsized":"2026-02-24T08:01:02.992819+0000","mapping_epoch":127,"log_start":"131'14056","ondisk_log_start":"131'14056","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115212288,"num_objects":1758,"num_object_clones":0,"num_object_copies":5274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14064,"num_write_kb":112512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'14080","reported_seq":14090,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.881275+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:02.881275+0000","last_peered":"2026-02-24T08:01:02.881275+0000","last_clean":"2026-02-24T08:01:02.881275+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:02.881275+0000","last_undegraded":"2026-02-24T08:01:02.881275+0000","last_fullsized":"2026-02-24T08:01:02.881275+0000","mapping_epoch":127,"log_start":"131'14071","ondisk_log_start":"131'14071","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14080,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"131'14056","reported_seq":14074,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.006935+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:03.006935+0000","last_peered":"2026-02-24T08:01:03.006935+0000","last_clean":"2026-02-24T08:01:03.006935+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:03.006935+0000","last_undegraded":"2026-02-24T08:01:03.006935+0000","last_fullsized":"2026-02-24T08:01:03.006935+0000","mapping_epoch":127,"log_start":"131'14040","ondisk_log_start":"131'14040","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115146752,"num_objects":1757,"num_object_clones":0,"num_object_copies":5271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14056,"num_write_kb":112448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'14479","reported_seq":14490,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.878781+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:02.878781+0000","last_peered":"2026-02-24T08:01:02.878781+0000","last_clean":"2026-02-24T08:01:02.878781+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:02.878781+0000","last_undegraded":"2026-02-24T08:01:02.878781+0000","last_fullsized":"2026-02-24T08:01:02.878781+0000","mapping_epoch":127,"log_start":"131'14468","ondisk_log_start":"131'14468","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118611968,"num_objects":1810,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14479,"num_write_kb":115832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'14336","reported_seq":14354,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.850493+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:02.850493+0000","last_peered":"2026-02-24T08:01:02.850493+0000","last_clean":"2026-02-24T08:01:02.850493+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:02.850493+0000","last_undegraded":"2026-02-24T08:01:02.850493+0000","last_fullsized":"2026-02-24T08:01:02.850493+0000","mapping_epoch":127,"log_start":"131'14312","ondisk_log_start":"131'14312","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":1792,"num_object_clones":0,"num_object_copies":5376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14336,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"131'14611","reported_seq":14627,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.012928+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:03.012928+0000","last_peered":"2026-02-24T08:01:03.012928+0000","last_clean":"2026-02-24T08:01:03.012928+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:03.012928+0000","last_undegraded":"2026-02-24T08:01:03.012928+0000","last_fullsized":"2026-02-24T08:01:03.012928+0000","mapping_epoch":127,"log_start":"131'14601","ondisk_log_start":"131'14601","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119693312,"num_objects":1827,"num_object_clones":0,"num_object_copies":5481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14611,"num_write_kb":116888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"131'14574","reported_seq":14582,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.169520+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:03.169520+0000","last_peered":"2026-02-24T08:01:03.169520+0000","last_clean":"2026-02-24T08:01:03.169520+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:03.169520+0000","last_undegraded":"2026-02-24T08:01:03.169520+0000","last_fullsized":"2026-02-24T08:01:03.169520+0000","mapping_epoch":127,"log_start":"131'14560","ondisk_log_start":"131'14560","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119390208,"num_objects":1822,"num_object_clones":0,"num_object_copies":5466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14574,"num_write_kb":116592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'14168","reported_seq":14186,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.836111+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:02.836111+0000","last_peered":"2026-02-24T08:01:02.836111+0000","last_clean":"2026-02-24T08:01:02.836111+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:02.836111+0000","last_undegraded":"2026-02-24T08:01:02.836111+0000","last_fullsized":"2026-02-24T08:01:02.836111+0000","mapping_epoch":127,"log_start":"131'14160","ondisk_log_start":"131'14160","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116064256,"num_objects":1771,"num_object_clones":0,"num_object_copies":5313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14168,"num_write_kb":113344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"131'14848","reported_seq":14858,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.163671+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:03.163671+0000","last_peered":"2026-02-24T08:01:03.163671+0000","last_clean":"2026-02-24T08:01:03.163671+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:03.163671+0000","last_undegraded":"2026-02-24T08:01:03.163671+0000","last_fullsized":"2026-02-24T08:01:03.163671+0000","mapping_epoch":127,"log_start":"131'14832","ondisk_log_start":"131'14832","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":1856,"num_object_clones":0,"num_object_copies":5568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14848,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"131'14872","reported_seq":14890,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:02.992954+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:02.992954+0000","last_peered":"2026-02-24T08:01:02.992954+0000","last_clean":"2026-02-24T08:01:02.992954+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:02.992954+0000","last_undegraded":"2026-02-24T08:01:02.992954+0000","last_fullsized":"2026-02-24T08:01:02.992954+0000","mapping_epoch":127,"log_start":"131'14864","ondisk_log_start":"131'14864","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121831424,"num_objects":1859,"num_object_clones":0,"num_object_copies":5577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14872,"num_write_kb":118976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"131'14008","reported_seq":14024,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.160695+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:03.160695+0000","last_peered":"2026-02-24T08:01:03.160695+0000","last_clean":"2026-02-24T08:01:03.160695+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:03.160695+0000","last_undegraded":"2026-02-24T08:01:03.160695+0000","last_fullsized":"2026-02-24T08:01:03.160695+0000","mapping_epoch":127,"log_start":"131'14000","ondisk_log_start":"131'14000","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114753536,"num_objects":1751,"num_object_clones":0,"num_object_copies":5253,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14008,"num_write_kb":112064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"131'14936","reported_seq":14954,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:03.148344+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:03.148344+0000","last_peered":"2026-02-24T08:01:03.148344+0000","last_clean":"2026-02-24T08:01:03.148344+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:03.148344+0000","last_undegraded":"2026-02-24T08:01:03.148344+0000","last_fullsized":"2026-02-24T08:01:03.148344+0000","mapping_epoch":127,"log_start":"131'14928","ondisk_log_start":"131'14928","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122355712,"num_objects":1867,"num_object_clones":0,"num_object_copies":5601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14936,"num_write_kb":119488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1878392832,"num_objects":28663,"num_object_clones":0,"num_object_copies":85989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229296,"num_write_kb":1834368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5632229376,"data_stored":5632229376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215278,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2927228,"kb_used_data":1463784,"kb_used_omap":21,"kb_used_meta":1463402,"kb_avail":731075972,"statfs":{"total":751619276800,"available":748621795328,"internally_reserved":0,"allocated":1498914816,"data_stored":1498292013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21693,"internal_metadata":1498524483},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444207,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2604452,"kb_used_data":1224656,"kb_used_omap":21,"kb_used_meta":1379754,"kb_avail":731398748,"statfs":{"total":751619276800,"available":748952317952,"internally_reserved":0,"allocated":1254047744,"data_stored":1253424941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1412869036},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575025,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2596560,"kb_used_data":1597564,"kb_used_omap":17,"kb_used_meta":998958,"kb_avail":731406640,"statfs":{"total":751619276800,"available":748960399360,"internally_reserved":0,"allocated":1635905536,"data_stored":1635286285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17672,"internal_metadata":1022933752},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,6],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3090668,"kb_used_data":1131416,"kb_used_omap":23,"kb_used_meta":1959208,"kb_avail":730912532,"statfs":{"total":751619276800,"available":748454432768,"internally_reserved":0,"allocated":1158569984,"data_stored":1157947181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":2006230007},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1171111936,"data_stored":1171111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1653432320,"data_stored":1653432320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1278885888,"data_stored":1278885888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1528799232,"data_stored":1528799232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:06.689 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:01:06.690 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 291 2026-02-24T08:01:06.873 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:06.995 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:06.992+0000 7fadd454b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:06.995 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:06.993+0000 7fadd454b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:07.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 29 128 270757 270629 72.8966 76.4844 0.00937664 0.0137136 2026-02-24T08:01:07.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:06 trial016 ceph-mon[39544]: pgmap v535: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.82k op/s 2026-02-24T08:01:07.150 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:01:07.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:01:07.359 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:07.516 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:07.640 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:07.637+0000 7f9a0a47e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:07.640 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:07.638+0000 7f9a0a47e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:07.660 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:07.661 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:07.674 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:07.674 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:07.691 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:07.692 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:07.720 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:07.720 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:08.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 30 128 280664 280536 73.0465 77.3984 0.0225821 0.0136849 2026-02-24T08:01:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:07 trial016 ceph-mon[39544]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3143241850' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "291"} : dispatch 2026-02-24T08:01:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3131664861' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:07 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:01:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:07 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:01:09.048 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 31 128 291149 291021 73.3323 81.9141 0.00872073 0.0136326 2026-02-24T08:01:09.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:08 trial016 ceph-mon[39544]: pgmap v536: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.82k op/s 2026-02-24T08:01:09.769 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:09.912 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:10.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 32 128 300128 300000 73.2327 70.1484 0.0121162 0.0136353 2026-02-24T08:01:10.313 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:10.310+0000 7f0be9d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:10.313 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:10.311+0000 7f0be9d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:10.327 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:10.328 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:10.340 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:10.340 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:10.352 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:10.353 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:10.365 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:10.366 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:11.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 33 127 307659 307532 72.7965 58.8438 0.0113317 0.0137335 2026-02-24T08:01:11.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:10 trial016 ceph-mon[39544]: pgmap v537: 17 pgs: 17 active+clean; 2.1 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.05k op/s 2026-02-24T08:01:11.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:10 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1817570428' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:12.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 34 128 317731 317603 72.9694 78.6797 0.00630081 0.0136994 2026-02-24T08:01:12.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:12.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:12.195 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:01:12.195 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:01:12.342 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:12.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:12.500+0000 7f92df20c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:12.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:12.501+0000 7f92df20c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:12.524 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:12.524 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:12.524 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:12.524 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:12.525 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:12.564 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:12.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:12.566 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:01:12.715 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:12.765 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:12.862 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:12.860+0000 7fe57e781640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:12.862 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:12.860+0000 7fe57e781640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:12.893 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:12.893 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:12.893 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:12.893 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:12.893 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:12.894 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:12.915 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:12.936 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:12.937 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:12.937 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:01:13.034 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:12 trial016 ceph-mon[39544]: pgmap v538: 17 pgs: 17 active+clean; 2.1 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.33k op/s 2026-02-24T08:01:13.037 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.035+0000 7f49d9b05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.037 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.035+0000 7f49d9b05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 35 128 327636 327508 73.0953 77.3828 0.0203746 0.0136761 2026-02-24T08:01:13.053 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:13.053 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:13.073 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:13.073 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:13.087 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:13.087 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:13.091 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:13.109 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:13.110 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:13.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.217+0000 7f40afbc6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.217+0000 7f40afbc6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.244 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:13.244 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:13.244 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:13.244 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:13.244 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:13.245 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:13.279 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:13.280 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:13.280 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:01:13.427 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:13.559 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.557+0000 7f8ac334d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.559 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:13.557+0000 7f8ac334d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:13.586 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:13.586 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:13.586 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:13.586 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:13.586 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:13.587 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:13.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:13.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:14.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 36 127 337389 337262 73.1815 76.2031 0.00502745 0.0136594 2026-02-24T08:01:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4036909442' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:15.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 37 127 347443 347316 73.3263 78.5469 0.0153685 0.0136327 2026-02-24T08:01:15.160 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:15.185 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:14 trial016 ceph-mon[39544]: pgmap v539: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s wr, 11.25k op/s 2026-02-24T08:01:15.185 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:15.310 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:15.446 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:15.444+0000 7f8b5dbdb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:15.447 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:15.444+0000 7f8b5dbdb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:15.463 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:15.464 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:15.481 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:15.481 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:15.496 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:15.497 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:15.512 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:15.512 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:16.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 38 128 356727 356599 73.305 72.5234 0.0144119 0.0136375 2026-02-24T08:01:16.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:15 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3680772690' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:17.049 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 39 128 366551 366423 73.3932 76.75 0.00490212 0.0136212 2026-02-24T08:01:17.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:16 trial016 ceph-mon[39544]: pgmap v540: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.15k op/s 2026-02-24T08:01:17.560 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:17.714 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:18.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T08:01:18.048707+0000 min lat: 0.000610054 max lat: 0.101579 avg lat: 0.0136217 2026-02-24T08:01:18.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:01:18.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 40 128 375936 375808 73.3913 73.3203 0.00871278 0.0136217 2026-02-24T08:01:18.153 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:17 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:01:18.153 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:17 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:01:18.234 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:18.207+0000 7fb8e8534640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:18.234 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:18.207+0000 7fb8e8534640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:18.247 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:18.248 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:18.261 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:18.261 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:18.277 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:18.277 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:18.289 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:18.290 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:18.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:18.628 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:18.629 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:18.796 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:19.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 41 128 381954 381826 72.747 47.0156 0.0110657 0.0137425 2026-02-24T08:01:19.116 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:18 trial016 ceph-mon[39544]: pgmap v541: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.15k op/s 2026-02-24T08:01:19.116 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:18 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2447009359' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:19.309 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:19.243+0000 7f60f531b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:19.309 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:19.243+0000 7f60f531b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:19.392 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:19.393 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:19.870 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2026-02-24T08:01:17.860346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2680783392,"num_objects":40899,"num_object_clones":0,"num_object_copies":122697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40899,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":327307,"num_write_kb":2619526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":255,"ondisk_log_size":255,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13429028,"kb_used_data":7717716,"kb_used_omap":72,"kb_used_meta":5711159,"kb_avail":2922583772,"statfs":{"total":3006477107200,"available":2992725782528,"internally_reserved":0,"allocated":7902941184,"data_stored":7900453524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74462,"internal_metadata":5848227106},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,7,0,21],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":801800192,"num_objects":12234,"num_object_clones":0,"num_object_copies":36702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97876,"num_write_kb":783008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001618"},"pg_stats":[{"pgid":"9.f","version":"131'19584","reported_seq":19574,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.900713+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:12.900713+0000","last_peered":"2026-02-24T08:01:12.900713+0000","last_clean":"2026-02-24T08:01:12.900713+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:12.900713+0000","last_undegraded":"2026-02-24T08:01:12.900713+0000","last_fullsized":"2026-02-24T08:01:12.900713+0000","mapping_epoch":127,"log_start":"131'19552","ondisk_log_start":"131'19552","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160432128,"num_objects":2448,"num_object_clones":0,"num_object_copies":7344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19584,"num_write_kb":156672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'20368","reported_seq":20386,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.875609+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:12.875609+0000","last_peered":"2026-02-24T08:01:12.875609+0000","last_clean":"2026-02-24T08:01:12.875609+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:12.875609+0000","last_undegraded":"2026-02-24T08:01:12.875609+0000","last_fullsized":"2026-02-24T08:01:12.875609+0000","mapping_epoch":127,"log_start":"131'20355","ondisk_log_start":"131'20355","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166854656,"num_objects":2546,"num_object_clones":0,"num_object_copies":7638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":162944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'20184","reported_seq":20202,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.832938+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:12.832938+0000","last_peered":"2026-02-24T08:01:12.832938+0000","last_clean":"2026-02-24T08:01:12.832938+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:12.832938+0000","last_undegraded":"2026-02-24T08:01:12.832938+0000","last_fullsized":"2026-02-24T08:01:12.832938+0000","mapping_epoch":127,"log_start":"131'20169","ondisk_log_start":"131'20169","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165347328,"num_objects":2523,"num_object_clones":0,"num_object_copies":7569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20184,"num_write_kb":161472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"131'20344","reported_seq":20359,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.160319+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:13.160319+0000","last_peered":"2026-02-24T08:01:13.160319+0000","last_clean":"2026-02-24T08:01:13.160319+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:13.160319+0000","last_undegraded":"2026-02-24T08:01:13.160319+0000","last_fullsized":"2026-02-24T08:01:13.160319+0000","mapping_epoch":127,"log_start":"131'20335","ondisk_log_start":"131'20335","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166658048,"num_objects":2543,"num_object_clones":0,"num_object_copies":7629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20344,"num_write_kb":162752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'20336","reported_seq":20354,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.006038+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:13.006038+0000","last_peered":"2026-02-24T08:01:13.006038+0000","last_clean":"2026-02-24T08:01:13.006038+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:13.006038+0000","last_undegraded":"2026-02-24T08:01:13.006038+0000","last_fullsized":"2026-02-24T08:01:13.006038+0000","mapping_epoch":127,"log_start":"131'20330","ondisk_log_start":"131'20330","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20336,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'20000","reported_seq":20018,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.874618+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:12.874618+0000","last_peered":"2026-02-24T08:01:12.874618+0000","last_clean":"2026-02-24T08:01:12.874618+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:12.874618+0000","last_undegraded":"2026-02-24T08:01:12.874618+0000","last_fullsized":"2026-02-24T08:01:12.874618+0000","mapping_epoch":127,"log_start":"131'19961","ondisk_log_start":"131'19961","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":3000,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163840000,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20000,"num_write_kb":160000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"131'20184","reported_seq":20202,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.972350+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:12.972350+0000","last_peered":"2026-02-24T08:01:12.972350+0000","last_clean":"2026-02-24T08:01:12.972350+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:12.972350+0000","last_undegraded":"2026-02-24T08:01:12.972350+0000","last_fullsized":"2026-02-24T08:01:12.972350+0000","mapping_epoch":127,"log_start":"131'20181","ondisk_log_start":"131'20181","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165347328,"num_objects":2523,"num_object_clones":0,"num_object_copies":7569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20184,"num_write_kb":161472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'20776","reported_seq":20794,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.823998+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:12.823998+0000","last_peered":"2026-02-24T08:01:12.823998+0000","last_clean":"2026-02-24T08:01:12.823998+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:12.823998+0000","last_undegraded":"2026-02-24T08:01:12.823998+0000","last_fullsized":"2026-02-24T08:01:12.823998+0000","mapping_epoch":127,"log_start":"131'20752","ondisk_log_start":"131'20752","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196992,"num_objects":2597,"num_object_clones":0,"num_object_copies":7791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20776,"num_write_kb":166208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'20456","reported_seq":20474,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.847314+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:12.847314+0000","last_peered":"2026-02-24T08:01:12.847314+0000","last_clean":"2026-02-24T08:01:12.847314+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:12.847314+0000","last_undegraded":"2026-02-24T08:01:12.847314+0000","last_fullsized":"2026-02-24T08:01:12.847314+0000","mapping_epoch":127,"log_start":"131'20431","ondisk_log_start":"131'20431","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167575552,"num_objects":2557,"num_object_clones":0,"num_object_copies":7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20456,"num_write_kb":163648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"131'20832","reported_seq":20850,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.005088+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:13.005088+0000","last_peered":"2026-02-24T08:01:13.005088+0000","last_clean":"2026-02-24T08:01:13.005088+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:13.005088+0000","last_undegraded":"2026-02-24T08:01:13.005088+0000","last_fullsized":"2026-02-24T08:01:13.005088+0000","mapping_epoch":127,"log_start":"131'20828","ondisk_log_start":"131'20828","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170655744,"num_objects":2604,"num_object_clones":0,"num_object_copies":7812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20832,"num_write_kb":166656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"131'20736","reported_seq":20754,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.170071+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:13.170071+0000","last_peered":"2026-02-24T08:01:13.170071+0000","last_clean":"2026-02-24T08:01:13.170071+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:13.170071+0000","last_undegraded":"2026-02-24T08:01:13.170071+0000","last_fullsized":"2026-02-24T08:01:13.170071+0000","mapping_epoch":127,"log_start":"131'20712","ondisk_log_start":"131'20712","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169869312,"num_objects":2592,"num_object_clones":0,"num_object_copies":7776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20736,"num_write_kb":165888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'20416","reported_seq":20434,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.876136+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:12.876136+0000","last_peered":"2026-02-24T08:01:12.876136+0000","last_clean":"2026-02-24T08:01:12.876136+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:12.876136+0000","last_undegraded":"2026-02-24T08:01:12.876136+0000","last_fullsized":"2026-02-24T08:01:12.876136+0000","mapping_epoch":127,"log_start":"131'20408","ondisk_log_start":"131'20408","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167247872,"num_objects":2552,"num_object_clones":0,"num_object_copies":7656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2552,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20416,"num_write_kb":163328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"131'20980","reported_seq":20994,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.148269+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:13.148269+0000","last_peered":"2026-02-24T08:01:13.148269+0000","last_clean":"2026-02-24T08:01:13.148269+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:13.148269+0000","last_undegraded":"2026-02-24T08:01:13.148269+0000","last_fullsized":"2026-02-24T08:01:13.148269+0000","mapping_epoch":127,"log_start":"131'20968","ondisk_log_start":"131'20968","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171868160,"num_objects":2623,"num_object_clones":0,"num_object_copies":7869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20980,"num_write_kb":167840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"131'21008","reported_seq":21026,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:12.997681+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:12.997681+0000","last_peered":"2026-02-24T08:01:12.997681+0000","last_clean":"2026-02-24T08:01:12.997681+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:12.997681+0000","last_undegraded":"2026-02-24T08:01:12.997681+0000","last_fullsized":"2026-02-24T08:01:12.997681+0000","mapping_epoch":127,"log_start":"131'21002","ondisk_log_start":"131'21002","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172097536,"num_objects":2626,"num_object_clones":0,"num_object_copies":7878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21008,"num_write_kb":168064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"131'19984","reported_seq":19998,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.154911+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:13.154911+0000","last_peered":"2026-02-24T08:01:13.154911+0000","last_clean":"2026-02-24T08:01:13.154911+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:13.154911+0000","last_undegraded":"2026-02-24T08:01:13.154911+0000","last_fullsized":"2026-02-24T08:01:13.154911+0000","mapping_epoch":127,"log_start":"131'19976","ondisk_log_start":"131'19976","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163708928,"num_objects":2498,"num_object_clones":0,"num_object_copies":7494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19984,"num_write_kb":159872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"131'20984","reported_seq":21002,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:13.168797+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:13.168797+0000","last_peered":"2026-02-24T08:01:13.168797+0000","last_clean":"2026-02-24T08:01:13.168797+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:13.168797+0000","last_undegraded":"2026-02-24T08:01:13.168797+0000","last_fullsized":"2026-02-24T08:01:13.168797+0000","mapping_epoch":127,"log_start":"131'20960","ondisk_log_start":"131'20960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171900928,"num_objects":2623,"num_object_clones":0,"num_object_copies":7869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20984,"num_write_kb":167872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2680193024,"num_objects":40897,"num_object_clones":0,"num_object_copies":122691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327172,"num_write_kb":2617376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8040235008,"data_stored":8040235008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":252,"ondisk_log_size":252,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215280,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3743860,"kb_used_data":2081888,"kb_used_omap":21,"kb_used_meta":1661930,"kb_avail":730259340,"statfs":{"total":751619276800,"available":747785564160,"internally_reserved":0,"allocated":2131853312,"data_stored":2131230509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21693,"internal_metadata":1701817155},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444209,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3272396,"kb_used_data":1748216,"kb_used_omap":21,"kb_used_meta":1524138,"kb_avail":730730804,"statfs":{"total":751619276800,"available":748268343296,"internally_reserved":0,"allocated":1790173184,"data_stored":1789550381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1560718252},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3488600,"kb_used_data":2273028,"kb_used_omap":17,"kb_used_meta":1215534,"kb_avail":730514600,"statfs":{"total":751619276800,"available":748046950400,"internally_reserved":0,"allocated":2327580672,"data_stored":2326961421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18324,"internal_metadata":1244706924},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,21],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705846,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2924172,"kb_used_data":1614584,"kb_used_omap":12,"kb_used_meta":1309555,"kb_avail":731079028,"statfs":{"total":751619276800,"available":748624924672,"internally_reserved":0,"allocated":1653334016,"data_stored":1652711213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12857,"internal_metadata":1340984775},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13673,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1674764288,"data_stored":1674764288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2354962432,"data_stored":2354962432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1829109760,"data_stored":1829109760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2181398528,"data_stored":2181398528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:20.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 42 127 389476 389349 72.4142 58.7734 0.0103441 0.0138066 2026-02-24T08:01:20.888 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:21.047 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:21.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 43 128 399868 399740 72.6179 81.1797 0.0095775 0.0137665 2026-02-24T08:01:21.175 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:21.173+0000 7fc33b766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:21.175 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:21.173+0000 7fc33b766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:21.175 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:20 trial016 ceph-mon[39544]: from='client.15709 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:21.175 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:20 trial016 ceph-mon[39544]: pgmap v542: 17 pgs: 17 active+clean; 2.9 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s wr, 12.18k op/s 2026-02-24T08:01:21.190 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:21.190 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:21.204 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:21.204 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:21.220 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:21.220 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:21.231 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:21.231 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:22.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 44 127 410024 409897 72.7708 79.3516 0.0297694 0.0137376 2026-02-24T08:01:22.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:21 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/260430157' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:23.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 45 128 420041 419913 72.8924 78.25 0.00464232 0.013715 2026-02-24T08:01:23.284 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:23.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:22 trial016 ceph-mon[39544]: pgmap v543: 17 pgs: 17 active+clean; 2.9 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s wr, 7.94k op/s 2026-02-24T08:01:23.437 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:23.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:23.564+0000 7fb73c20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:23.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:23.564+0000 7fb73c20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:23.584 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:23.584 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:23.611 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:23.612 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:23.627 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:23.627 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:23.641 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:23.641 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:24.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 46 127 429966 429839 72.9935 77.5469 0.00610056 0.0136962 2026-02-24T08:01:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:23 trial016 ceph-mon[39544]: osdmap e132: 4 total, 4 up, 4 in 2026-02-24T08:01:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2755014445' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:24.872 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:24.872 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:24.872 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:01:24.872 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:25.014 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:25.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 47 128 439563 439435 73.0353 74.9688 0.000884735 0.013687 2026-02-24T08:01:25.148 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:25.146+0000 7f4b12656640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:25.148 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:25.146+0000 7f4b12656640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:25.295 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:25.296 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:25.297 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:25.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:24 trial016 ceph-mon[39544]: pgmap v545: 17 pgs: 17 active+clean; 3.2 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.23k op/s 2026-02-24T08:01:25.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:24 trial016 ceph-mon[39544]: osdmap e133: 4 total, 4 up, 4 in 2026-02-24T08:01:25.694 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:25.921 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:25.925 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2026-02-24T08:01:24.902216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3437355552,"num_objects":52444,"num_object_clones":0,"num_object_copies":157332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52444,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":419662,"num_write_kb":3358366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16354868,"kb_used_data":9920484,"kb_used_omap":73,"kb_used_meta":6434230,"kb_avail":2919657932,"statfs":{"total":3006477107200,"available":2989729722368,"internally_reserved":0,"allocated":10158575616,"data_stored":10156087956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":75102,"internal_metadata":6588652194},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,10,10,16,32,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":756572160,"num_objects":11545,"num_object_clones":0,"num_object_copies":34635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92355,"num_write_kb":738840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.042153"},"pg_stats":[{"pgid":"9.f","version":"131'25024","reported_seq":25042,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.876567+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:22.876567+0000","last_peered":"2026-02-24T08:01:22.876567+0000","last_clean":"2026-02-24T08:01:22.876567+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:22.876567+0000","last_undegraded":"2026-02-24T08:01:22.876567+0000","last_fullsized":"2026-02-24T08:01:22.876567+0000","mapping_epoch":127,"log_start":"131'25016","ondisk_log_start":"131'25016","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204996608,"num_objects":3128,"num_object_clones":0,"num_object_copies":9384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25024,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"131'26528","reported_seq":26546,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.891058+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:22.891058+0000","last_peered":"2026-02-24T08:01:22.891058+0000","last_clean":"2026-02-24T08:01:22.891058+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:22.891058+0000","last_undegraded":"2026-02-24T08:01:22.891058+0000","last_fullsized":"2026-02-24T08:01:22.891058+0000","mapping_epoch":127,"log_start":"131'26520","ondisk_log_start":"131'26520","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217317376,"num_objects":3316,"num_object_clones":0,"num_object_copies":9948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26528,"num_write_kb":212224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"131'25824","reported_seq":25842,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.887406+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:22.887406+0000","last_peered":"2026-02-24T08:01:22.887406+0000","last_clean":"2026-02-24T08:01:22.887406+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:22.887406+0000","last_undegraded":"2026-02-24T08:01:22.887406+0000","last_fullsized":"2026-02-24T08:01:22.887406+0000","mapping_epoch":127,"log_start":"131'25808","ondisk_log_start":"131'25808","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211550208,"num_objects":3228,"num_object_clones":0,"num_object_copies":9684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25824,"num_write_kb":206592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"132'25936","reported_seq":25948,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.162578+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:23.162578+0000","last_peered":"2026-02-24T08:01:23.162578+0000","last_clean":"2026-02-24T08:01:23.162578+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:23.162578+0000","last_undegraded":"2026-02-24T08:01:23.162578+0000","last_fullsized":"2026-02-24T08:01:23.162578+0000","mapping_epoch":127,"log_start":"132'25921","ondisk_log_start":"132'25921","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212467712,"num_objects":3242,"num_object_clones":0,"num_object_copies":9726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25936,"num_write_kb":207488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"131'26112","reported_seq":26132,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.994505+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:22.994505+0000","last_peered":"2026-02-24T08:01:22.994505+0000","last_clean":"2026-02-24T08:01:22.994505+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:22.994505+0000","last_undegraded":"2026-02-24T08:01:22.994505+0000","last_fullsized":"2026-02-24T08:01:22.994505+0000","mapping_epoch":127,"log_start":"131'26103","ondisk_log_start":"131'26103","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":3264,"num_object_clones":0,"num_object_copies":9792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26112,"num_write_kb":208896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"131'25280","reported_seq":25298,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.856140+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:22.856140+0000","last_peered":"2026-02-24T08:01:22.856140+0000","last_clean":"2026-02-24T08:01:22.856140+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:22.856140+0000","last_undegraded":"2026-02-24T08:01:22.856140+0000","last_fullsized":"2026-02-24T08:01:22.856140+0000","mapping_epoch":127,"log_start":"131'25272","ondisk_log_start":"131'25272","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207093760,"num_objects":3160,"num_object_clones":0,"num_object_copies":9480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25280,"num_write_kb":202240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"132'26236","reported_seq":26252,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.016187+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:23.016187+0000","last_peered":"2026-02-24T08:01:23.016187+0000","last_clean":"2026-02-24T08:01:23.016187+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:23.016187+0000","last_undegraded":"2026-02-24T08:01:23.016187+0000","last_fullsized":"2026-02-24T08:01:23.016187+0000","mapping_epoch":127,"log_start":"132'26230","ondisk_log_start":"132'26230","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214925312,"num_objects":3280,"num_object_clones":0,"num_object_copies":9840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26236,"num_write_kb":209888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"131'26696","reported_seq":26714,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.890687+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:22.890687+0000","last_peered":"2026-02-24T08:01:22.890687+0000","last_clean":"2026-02-24T08:01:22.890687+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:22.890687+0000","last_undegraded":"2026-02-24T08:01:22.890687+0000","last_fullsized":"2026-02-24T08:01:22.890687+0000","mapping_epoch":127,"log_start":"131'26688","ondisk_log_start":"131'26688","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218693632,"num_objects":3337,"num_object_clones":0,"num_object_copies":10011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26696,"num_write_kb":213568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"131'25968","reported_seq":25986,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.885409+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:22.885409+0000","last_peered":"2026-02-24T08:01:22.885409+0000","last_clean":"2026-02-24T08:01:22.885409+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:22.885409+0000","last_undegraded":"2026-02-24T08:01:22.885409+0000","last_fullsized":"2026-02-24T08:01:22.885409+0000","mapping_epoch":127,"log_start":"131'25960","ondisk_log_start":"131'25960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212729856,"num_objects":3246,"num_object_clones":0,"num_object_copies":9738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25968,"num_write_kb":207744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"132'26883","reported_seq":26898,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.015933+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:23.015933+0000","last_peered":"2026-02-24T08:01:23.015933+0000","last_clean":"2026-02-24T08:01:23.015933+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:23.015933+0000","last_undegraded":"2026-02-24T08:01:23.015933+0000","last_fullsized":"2026-02-24T08:01:23.015933+0000","mapping_epoch":127,"log_start":"132'26877","ondisk_log_start":"132'26877","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":3000,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220225536,"num_objects":3361,"num_object_clones":0,"num_object_copies":10083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26883,"num_write_kb":215064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"132'26104","reported_seq":26124,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.163232+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:23.163232+0000","last_peered":"2026-02-24T08:01:23.163232+0000","last_clean":"2026-02-24T08:01:23.163232+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:23.163232+0000","last_undegraded":"2026-02-24T08:01:23.163232+0000","last_fullsized":"2026-02-24T08:01:23.163232+0000","mapping_epoch":127,"log_start":"132'26096","ondisk_log_start":"132'26096","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213843968,"num_objects":3263,"num_object_clones":0,"num_object_copies":9789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26104,"num_write_kb":208832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"131'26296","reported_seq":26314,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:01:22.886815+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:22.886815+0000","last_peered":"2026-02-24T08:01:22.886815+0000","last_clean":"2026-02-24T08:01:22.886815+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:22.886815+0000","last_undegraded":"2026-02-24T08:01:22.886815+0000","last_fullsized":"2026-02-24T08:01:22.886815+0000","mapping_epoch":127,"log_start":"131'26288","ondisk_log_start":"131'26288","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215416832,"num_objects":3287,"num_object_clones":0,"num_object_copies":9861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26296,"num_write_kb":210368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"132'26984","reported_seq":27004,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.140619+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:23.140619+0000","last_peered":"2026-02-24T08:01:23.140619+0000","last_clean":"2026-02-24T08:01:23.140619+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:23.140619+0000","last_undegraded":"2026-02-24T08:01:23.140619+0000","last_fullsized":"2026-02-24T08:01:23.140619+0000","mapping_epoch":127,"log_start":"132'26960","ondisk_log_start":"132'26960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221052928,"num_objects":3373,"num_object_clones":0,"num_object_copies":10119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3373,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26984,"num_write_kb":215872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"132'27016","reported_seq":27036,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.009763+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:23.009763+0000","last_peered":"2026-02-24T08:01:23.009763+0000","last_clean":"2026-02-24T08:01:23.009763+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:23.009763+0000","last_undegraded":"2026-02-24T08:01:23.009763+0000","last_fullsized":"2026-02-24T08:01:23.009763+0000","mapping_epoch":127,"log_start":"132'27011","ondisk_log_start":"132'27011","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221315072,"num_objects":3377,"num_object_clones":0,"num_object_copies":10131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27016,"num_write_kb":216128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"132'25528","reported_seq":25548,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.153783+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:23.153783+0000","last_peered":"2026-02-24T08:01:23.153783+0000","last_clean":"2026-02-24T08:01:23.153783+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:23.153783+0000","last_undegraded":"2026-02-24T08:01:23.153783+0000","last_fullsized":"2026-02-24T08:01:23.153783+0000","mapping_epoch":127,"log_start":"132'25512","ondisk_log_start":"132'25512","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209125376,"num_objects":3191,"num_object_clones":0,"num_object_copies":9573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25528,"num_write_kb":204224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"132'27112","reported_seq":27132,"reported_epoch":132,"state":"active+clean","last_fresh":"2026-02-24T08:01:23.171179+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:23.171179+0000","last_peered":"2026-02-24T08:01:23.171179+0000","last_clean":"2026-02-24T08:01:23.171179+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:23.171179+0000","last_undegraded":"2026-02-24T08:01:23.171179+0000","last_fullsized":"2026-02-24T08:01:23.171179+0000","mapping_epoch":127,"log_start":"132'27109","ondisk_log_start":"132'27109","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222101504,"num_objects":3389,"num_object_clones":0,"num_object_copies":10167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27112,"num_write_kb":216896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":486,"reported_epoch":131,"state":"active+clean","last_fresh":"2026-02-24T08:00:39.895123+0000","last_change":"2026-02-24T07:59:59.804675+0000","last_active":"2026-02-24T08:00:39.895123+0000","last_peered":"2026-02-24T08:00:39.895123+0000","last_clean":"2026-02-24T08:00:39.895123+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:00:39.895123+0000","last_undegraded":"2026-02-24T08:00:39.895123+0000","last_fullsized":"2026-02-24T08:00:39.895123+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T07:59:59.804642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T07:59:59.804642+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:24.751089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":3436765184,"num_objects":52442,"num_object_clones":0,"num_object_copies":157326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419527,"num_write_kb":3356216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10307502080,"data_stored":10307502080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13700,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215282,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4501500,"kb_used_data":2675944,"kb_used_omap":21,"kb_used_meta":1825514,"kb_avail":729501700,"statfs":{"total":751619276800,"available":747009740800,"internally_reserved":0,"allocated":2740166656,"data_stored":2739543853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22333,"internal_metadata":1869326531},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,10,0,8],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444211,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3959164,"kb_used_data":2254504,"kb_used_omap":21,"kb_used_meta":1704618,"kb_avail":730044036,"statfs":{"total":751619276800,"available":747565092864,"internally_reserved":0,"allocated":2308612096,"data_stored":2307989293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21588,"internal_metadata":1745529772},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,6,0,16,24,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4346136,"kb_used_data":2913988,"kb_used_omap":17,"kb_used_meta":1432110,"kb_avail":729657064,"statfs":{"total":751619276800,"available":747168833536,"internally_reserved":0,"allocated":2983923712,"data_stored":2983304461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18324,"internal_metadata":1466480748},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3548068,"kb_used_data":2076048,"kb_used_omap":12,"kb_used_meta":1471987,"kb_avail":730455132,"statfs":{"total":751619276800,"available":747986055168,"internally_reserved":0,"allocated":2125873152,"data_stored":2125250349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12857,"internal_metadata":1507315143},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13700,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2148220928,"data_stored":2148220928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3013468160,"data_stored":3013468160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2344984576,"data_stored":2344984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2800828416,"data_stored":2800828416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:25.926 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:01:25.927 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 301 2026-02-24T08:01:26.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 48 128 446716 446588 72.6779 55.8828 0.0321559 0.0137487 2026-02-24T08:01:26.066 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:26.260+0000 7f8314e42640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:26.261+0000 7f8314e42640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:26.411 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:26.412 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:26.412 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:26.412 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:26.738 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:26.737+0000 7fd8021c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:26.739 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:26.737+0000 7fd8021c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:26.892 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:01:26.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:01:27.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 49 128 453839 453711 72.3303 55.6484 0.0140236 0.0138216 2026-02-24T08:01:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:26 trial016 ceph-mon[39544]: from='client.15715 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:27 trial016 ceph-mon[39544]: pgmap v547: 17 pgs: 17 active+clean; 3.2 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 90 MiB/s wr, 11.54k op/s 2026-02-24T08:01:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2486369572' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:27.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1662564424' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "301"} : dispatch 2026-02-24T08:01:28.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 50 128 463921 463793 72.4589 78.7656 0.0139595 0.0137984 2026-02-24T08:01:28.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:28 trial016 ceph-mon[39544]: 1.0 scrub starts 2026-02-24T08:01:28.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:28 trial016 ceph-mon[39544]: 1.0 scrub ok 2026-02-24T08:01:28.663 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:28.819 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:28.944 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:28.942+0000 7f728a820640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:28.944 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:28.942+0000 7f728a820640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:28.961 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:28.962 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:28.990 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:28.990 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:29.005 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:29.005 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:29.018 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:29.019 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:29.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 51 127 474309 474182 72.6295 81.1641 0.00629034 0.0137657 2026-02-24T08:01:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:29 trial016 ceph-mon[39544]: pgmap v548: 17 pgs: 17 active+clean; 3.2 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.50k op/s 2026-02-24T08:01:29.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3288602604' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:30.050 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 52 128 483844 483716 72.665 74.4844 0.0275684 0.013757 2026-02-24T08:01:31.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 53 128 494016 493888 72.7933 79.4688 0.0137195 0.0137348 2026-02-24T08:01:31.068 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:31.221 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:31.262 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:31 trial016 ceph-mon[39544]: pgmap v549: 17 pgs: 17 active+clean; 3.5 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.02k op/s 2026-02-24T08:01:31.368 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:31.366+0000 7fb627037640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:31.369 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:31.366+0000 7fb627037640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:31.387 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:31.388 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:31.415 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:31.415 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:31.430 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:31.430 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:31.449 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:31.449 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:31.937 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:31.938 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:01:32.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 54 128 503804 503676 72.8612 76.4688 0.0132314 0.0137217 2026-02-24T08:01:32.088 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:32.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:32.216+0000 7f8bf044c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:32.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:32.217+0000 7f8bf044c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:32.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:32 trial016 ceph-mon[39544]: osdmap e134: 4 total, 4 up, 4 in 2026-02-24T08:01:32.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1971255784' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:33.009 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:01:33.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 55 128 514132 514004 73.0034 80.6875 0.000962249 0.0136937 2026-02-24T08:01:33.058 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:01:33.208 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:33.264 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:33 trial016 ceph-mon[39544]: pgmap v551: 17 pgs: 17 active+clean; 3.5 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.51k op/s 2026-02-24T08:01:33.264 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1548267040' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:01:33.339 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:33.337+0000 7f02f3483640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:33.339 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:33.337+0000 7f02f3483640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:33.499 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:33.654 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:33.772 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:33.769+0000 7fc5eaeff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:33.772 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:33.769+0000 7fc5eaeff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:33.789 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:33.789 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:33.814 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:33.814 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:33.828 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:33.829 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:33.841 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:33.842 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:34.014 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:01:34.040 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1548267040' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:01:34.041 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:34 trial016 ceph-mon[39544]: osdmap e135: 4 total, 4 up, 4 in 2026-02-24T08:01:34.041 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4160322104' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:01:34.041 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3061463333' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:34.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 56 127 523820 523693 73.0514 75.6953 0.00800251 0.0136862 2026-02-24T08:01:34.066 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:01:34.215 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:34.344 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:34.342+0000 7fac2d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:34.344 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:34.342+0000 7fac2d997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:34.906 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:01:34.961 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:01:35.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 57 128 533656 533528 73.1177 76.8359 0.00408177 0.0136731 2026-02-24T08:01:35.110 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:35.173 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:35.173 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: pgmap v553: 17 pgs: 17 active+clean; 3.9 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 92 MiB/s wr, 11.77k op/s 2026-02-24T08:01:35.173 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4160322104' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:01:35.173 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: osdmap e136: 4 total, 4 up, 4 in 2026-02-24T08:01:35.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3874170289' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:01:35.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3874170289' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:01:35.174 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:35 trial016 ceph-mon[39544]: osdmap e137: 4 total, 4 up, 4 in 2026-02-24T08:01:35.250 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:35.248+0000 7fe7ab35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:35.250 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:35.249+0000 7fe7ab35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:35.893 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:36.018 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:01:36.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 58 127 543148 543021 73.1356 74.1641 0.0142965 0.0136688 2026-02-24T08:01:36.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2717653540' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:01:36.501 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:36.586 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:01:36.587 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:36.868 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:37.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 59 128 550458 550330 72.8638 57.1016 0.00895689 0.0137216 2026-02-24T08:01:37.117 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:37.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:37.081+0000 7f7dbff38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:37.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:37.081+0000 7f7dbff38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:37.118 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:37.135 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:37.135 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:37.136 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:37 trial016 ceph-mon[39544]: pgmap v556: 17 pgs: 17 active+clean; 3.9 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.31k op/s 2026-02-24T08:01:37.136 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2717653540' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:01:37.136 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:37 trial016 ceph-mon[39544]: osdmap e138: 4 total, 4 up, 4 in 2026-02-24T08:01:37.156 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:37.156 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:37.172 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:37.172 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:38.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:37.967+0000 7f449ab75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:38.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:37.967+0000 7f449ab75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:38.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T08:01:38.050743+0000 min lat: 0.000594996 max lat: 0.105233 avg lat: 0.0137749 2026-02-24T08:01:38.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:01:38.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 60 128 557615 557487 72.5812 55.9141 0.00400925 0.0137749 2026-02-24T08:01:38.112 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:38.113 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:38 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1480388460' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:38.373 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2026-02-24T08:01:37.863097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4209050144,"num_objects":64218,"num_object_clones":0,"num_object_copies":192654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64218,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":513863,"num_write_kb":4111974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18344788,"kb_used_data":12222972,"kb_used_omap":71,"kb_used_meta":6121656,"kb_avail":2917668012,"statfs":{"total":3006477107200,"available":2987692044288,"internally_reserved":0,"allocated":12516323328,"data_stored":12513741424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72884,"internal_metadata":6268576588},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,16,53],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":233308160,"num_objects":3560,"num_object_clones":0,"num_object_copies":10680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28480,"num_write_kb":227840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854366"},"pg_stats":[{"pgid":"9.f","version":"134'30864","reported_seq":30888,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889770+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:32.889770+0000","last_peered":"2026-02-24T08:01:32.889770+0000","last_clean":"2026-02-24T08:01:32.889770+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:32.889770+0000","last_undegraded":"2026-02-24T08:01:32.889770+0000","last_fullsized":"2026-02-24T08:01:32.889770+0000","mapping_epoch":127,"log_start":"134'30848","ondisk_log_start":"134'30848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"134'32536","reported_seq":32560,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889165+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:32.889165+0000","last_peered":"2026-02-24T08:01:32.889165+0000","last_clean":"2026-02-24T08:01:32.889165+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:32.889165+0000","last_undegraded":"2026-02-24T08:01:32.889165+0000","last_fullsized":"2026-02-24T08:01:32.889165+0000","mapping_epoch":127,"log_start":"134'32520","ondisk_log_start":"134'32520","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266534912,"num_objects":4067,"num_object_clones":0,"num_object_copies":12201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32536,"num_write_kb":260288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"134'31400","reported_seq":31424,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.888926+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:32.888926+0000","last_peered":"2026-02-24T08:01:32.888926+0000","last_clean":"2026-02-24T08:01:32.888926+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:32.888926+0000","last_undegraded":"2026-02-24T08:01:32.888926+0000","last_fullsized":"2026-02-24T08:01:32.888926+0000","mapping_epoch":127,"log_start":"134'31392","ondisk_log_start":"134'31392","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257228800,"num_objects":3925,"num_object_clones":0,"num_object_copies":11775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31400,"num_write_kb":251200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"135'31936","reported_seq":31962,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.165644+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:33.165644+0000","last_peered":"2026-02-24T08:01:33.165644+0000","last_clean":"2026-02-24T08:01:33.165644+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:33.165644+0000","last_undegraded":"2026-02-24T08:01:33.165644+0000","last_fullsized":"2026-02-24T08:01:33.165644+0000","mapping_epoch":127,"log_start":"135'31920","ondisk_log_start":"135'31920","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261619712,"num_objects":3992,"num_object_clones":0,"num_object_copies":11976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31936,"num_write_kb":255488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"135'32496","reported_seq":32522,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.017331+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:33.017331+0000","last_peered":"2026-02-24T08:01:33.017331+0000","last_clean":"2026-02-24T08:01:33.017331+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:33.017331+0000","last_undegraded":"2026-02-24T08:01:33.017331+0000","last_fullsized":"2026-02-24T08:01:33.017331+0000","mapping_epoch":127,"log_start":"135'32493","ondisk_log_start":"135'32493","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266207232,"num_objects":4062,"num_object_clones":0,"num_object_copies":12186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4062,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32496,"num_write_kb":259968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"134'31352","reported_seq":31376,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.899986+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:32.899986+0000","last_peered":"2026-02-24T08:01:32.899986+0000","last_clean":"2026-02-24T08:01:32.899986+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:32.899986+0000","last_undegraded":"2026-02-24T08:01:32.899986+0000","last_fullsized":"2026-02-24T08:01:32.899986+0000","mapping_epoch":127,"log_start":"134'31344","ondisk_log_start":"134'31344","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256835584,"num_objects":3919,"num_object_clones":0,"num_object_copies":11757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31352,"num_write_kb":250816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"134'32344","reported_seq":32370,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011766+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:33.011766+0000","last_peered":"2026-02-24T08:01:33.011766+0000","last_clean":"2026-02-24T08:01:33.011766+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:33.011766+0000","last_undegraded":"2026-02-24T08:01:33.011766+0000","last_fullsized":"2026-02-24T08:01:33.011766+0000","mapping_epoch":127,"log_start":"134'32341","ondisk_log_start":"134'32341","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264962048,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32344,"num_write_kb":258752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"134'32488","reported_seq":32512,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.890914+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:32.890914+0000","last_peered":"2026-02-24T08:01:32.890914+0000","last_clean":"2026-02-24T08:01:32.890914+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:32.890914+0000","last_undegraded":"2026-02-24T08:01:32.890914+0000","last_fullsized":"2026-02-24T08:01:32.890914+0000","mapping_epoch":127,"log_start":"134'32480","ondisk_log_start":"134'32480","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266141696,"num_objects":4061,"num_object_clones":0,"num_object_copies":12183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32488,"num_write_kb":259904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"134'31856","reported_seq":31880,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.904336+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:32.904336+0000","last_peered":"2026-02-24T08:01:32.904336+0000","last_clean":"2026-02-24T08:01:32.904336+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:32.904336+0000","last_undegraded":"2026-02-24T08:01:32.904336+0000","last_fullsized":"2026-02-24T08:01:32.904336+0000","mapping_epoch":127,"log_start":"134'31848","ondisk_log_start":"134'31848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260964352,"num_objects":3982,"num_object_clones":0,"num_object_copies":11946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31856,"num_write_kb":254848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"134'32648","reported_seq":32674,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011837+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:33.011837+0000","last_peered":"2026-02-24T08:01:33.011837+0000","last_clean":"2026-02-24T08:01:33.011837+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:33.011837+0000","last_undegraded":"2026-02-24T08:01:33.011837+0000","last_fullsized":"2026-02-24T08:01:33.011837+0000","mapping_epoch":127,"log_start":"134'32645","ondisk_log_start":"134'32645","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267452416,"num_objects":4081,"num_object_clones":0,"num_object_copies":12243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32648,"num_write_kb":261184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"135'31784","reported_seq":31807,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167747+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:33.167747+0000","last_peered":"2026-02-24T08:01:33.167747+0000","last_clean":"2026-02-24T08:01:33.167747+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:33.167747+0000","last_undegraded":"2026-02-24T08:01:33.167747+0000","last_fullsized":"2026-02-24T08:01:33.167747+0000","mapping_epoch":127,"log_start":"135'31776","ondisk_log_start":"135'31776","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260374528,"num_objects":3973,"num_object_clones":0,"num_object_copies":11919,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3973,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31784,"num_write_kb":254272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"134'31848","reported_seq":31872,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.860359+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:32.860359+0000","last_peered":"2026-02-24T08:01:32.860359+0000","last_clean":"2026-02-24T08:01:32.860359+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:32.860359+0000","last_undegraded":"2026-02-24T08:01:32.860359+0000","last_fullsized":"2026-02-24T08:01:32.860359+0000","mapping_epoch":127,"log_start":"134'31840","ondisk_log_start":"134'31840","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260898816,"num_objects":3981,"num_object_clones":0,"num_object_copies":11943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31848,"num_write_kb":254784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"135'33008","reported_seq":33026,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167566+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:33.167566+0000","last_peered":"2026-02-24T08:01:33.167566+0000","last_clean":"2026-02-24T08:01:33.167566+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:33.167566+0000","last_undegraded":"2026-02-24T08:01:33.167566+0000","last_fullsized":"2026-02-24T08:01:33.167566+0000","mapping_epoch":127,"log_start":"135'32999","ondisk_log_start":"135'32999","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"134'33008","reported_seq":33034,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011820+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:33.011820+0000","last_peered":"2026-02-24T08:01:33.011820+0000","last_clean":"2026-02-24T08:01:33.011820+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:33.011820+0000","last_undegraded":"2026-02-24T08:01:33.011820+0000","last_fullsized":"2026-02-24T08:01:33.011820+0000","mapping_epoch":127,"log_start":"134'32992","ondisk_log_start":"134'32992","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"135'31408","reported_seq":31422,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.171124+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:33.171124+0000","last_peered":"2026-02-24T08:01:33.171124+0000","last_clean":"2026-02-24T08:01:33.171124+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:33.171124+0000","last_undegraded":"2026-02-24T08:01:33.171124+0000","last_fullsized":"2026-02-24T08:01:33.171124+0000","mapping_epoch":127,"log_start":"135'31394","ondisk_log_start":"135'31394","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257294336,"num_objects":3926,"num_object_clones":0,"num_object_copies":11778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31408,"num_write_kb":251264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"135'32752","reported_seq":32778,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.139505+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:33.139505+0000","last_peered":"2026-02-24T08:01:33.139505+0000","last_clean":"2026-02-24T08:01:33.139505+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:33.139505+0000","last_undegraded":"2026-02-24T08:01:33.139505+0000","last_fullsized":"2026-02-24T08:01:33.139505+0000","mapping_epoch":127,"log_start":"135'32736","ondisk_log_start":"135'32736","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268304384,"num_objects":4094,"num_object_clones":0,"num_object_copies":12282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32752,"num_write_kb":262016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":500,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:31.003011+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:31.003011+0000","last_peered":"2026-02-24T08:01:31.003011+0000","last_clean":"2026-02-24T08:01:31.003011+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:31.003011+0000","last_undegraded":"2026-02-24T08:01:31.003011+0000","last_fullsized":"2026-02-24T08:01:31.003011+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":4208459776,"num_objects":64216,"num_object_clones":0,"num_object_copies":192648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513728,"num_write_kb":4109824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12621946880,"data_stored":12621946880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215284,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4376984,"kb_used_data":3345412,"kb_used_omap":13,"kb_used_meta":1031538,"kb_avail":729626216,"statfs":{"total":751619276800,"available":747137245184,"internally_reserved":0,"allocated":3425701888,"data_stored":3425055524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14247,"internal_metadata":1056295001},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444213,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4652008,"kb_used_data":2766860,"kb_used_omap":22,"kb_used_meta":1885097,"kb_avail":729351192,"statfs":{"total":751619276800,"available":746855620608,"internally_reserved":0,"allocated":2833264640,"data_stored":2832618276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23544,"internal_metadata":1930339336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,9,37],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5216244,"kb_used_data":3567520,"kb_used_omap":19,"kb_used_meta":1648684,"kb_avail":728786956,"statfs":{"total":751619276800,"available":746277842944,"internally_reserved":0,"allocated":3653140480,"data_stored":3652497668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20280,"internal_metadata":1688252616},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705850,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4099552,"kb_used_data":2543180,"kb_used_omap":14,"kb_used_meta":1556337,"kb_avail":729903648,"statfs":{"total":751619276800,"available":747421335552,"internally_reserved":0,"allocated":2604216320,"data_stored":2603569956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14813,"internal_metadata":1593689635},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2629541888,"data_stored":2629541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3687292928,"data_stored":3687292928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2876547072,"data_stored":2876547072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3428564992,"data_stored":3428564992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:38.374 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:38.519 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:38.689 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:38.687+0000 7fbcb0004640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:38.689 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:38.687+0000 7fbcb0004640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:38.837 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:38.837 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:38.886 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2026-02-24T08:01:37.863097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4209050144,"num_objects":64218,"num_object_clones":0,"num_object_copies":192654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64218,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":513863,"num_write_kb":4111974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18344788,"kb_used_data":12222972,"kb_used_omap":71,"kb_used_meta":6121656,"kb_avail":2917668012,"statfs":{"total":3006477107200,"available":2987692044288,"internally_reserved":0,"allocated":12516323328,"data_stored":12513741424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72884,"internal_metadata":6268576588},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,16,53],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":233308160,"num_objects":3560,"num_object_clones":0,"num_object_copies":10680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28480,"num_write_kb":227840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854366"},"pg_stats":[{"pgid":"9.f","version":"134'30864","reported_seq":30888,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889770+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:32.889770+0000","last_peered":"2026-02-24T08:01:32.889770+0000","last_clean":"2026-02-24T08:01:32.889770+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:32.889770+0000","last_undegraded":"2026-02-24T08:01:32.889770+0000","last_fullsized":"2026-02-24T08:01:32.889770+0000","mapping_epoch":127,"log_start":"134'30848","ondisk_log_start":"134'30848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"134'32536","reported_seq":32560,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889165+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:32.889165+0000","last_peered":"2026-02-24T08:01:32.889165+0000","last_clean":"2026-02-24T08:01:32.889165+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:32.889165+0000","last_undegraded":"2026-02-24T08:01:32.889165+0000","last_fullsized":"2026-02-24T08:01:32.889165+0000","mapping_epoch":127,"log_start":"134'32520","ondisk_log_start":"134'32520","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266534912,"num_objects":4067,"num_object_clones":0,"num_object_copies":12201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32536,"num_write_kb":260288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"134'31400","reported_seq":31424,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.888926+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:32.888926+0000","last_peered":"2026-02-24T08:01:32.888926+0000","last_clean":"2026-02-24T08:01:32.888926+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:32.888926+0000","last_undegraded":"2026-02-24T08:01:32.888926+0000","last_fullsized":"2026-02-24T08:01:32.888926+0000","mapping_epoch":127,"log_start":"134'31392","ondisk_log_start":"134'31392","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257228800,"num_objects":3925,"num_object_clones":0,"num_object_copies":11775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31400,"num_write_kb":251200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"135'31936","reported_seq":31962,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.165644+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:33.165644+0000","last_peered":"2026-02-24T08:01:33.165644+0000","last_clean":"2026-02-24T08:01:33.165644+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:33.165644+0000","last_undegraded":"2026-02-24T08:01:33.165644+0000","last_fullsized":"2026-02-24T08:01:33.165644+0000","mapping_epoch":127,"log_start":"135'31920","ondisk_log_start":"135'31920","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261619712,"num_objects":3992,"num_object_clones":0,"num_object_copies":11976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31936,"num_write_kb":255488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"135'32496","reported_seq":32522,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.017331+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:33.017331+0000","last_peered":"2026-02-24T08:01:33.017331+0000","last_clean":"2026-02-24T08:01:33.017331+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:33.017331+0000","last_undegraded":"2026-02-24T08:01:33.017331+0000","last_fullsized":"2026-02-24T08:01:33.017331+0000","mapping_epoch":127,"log_start":"135'32493","ondisk_log_start":"135'32493","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266207232,"num_objects":4062,"num_object_clones":0,"num_object_copies":12186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4062,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32496,"num_write_kb":259968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"134'31352","reported_seq":31376,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.899986+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:32.899986+0000","last_peered":"2026-02-24T08:01:32.899986+0000","last_clean":"2026-02-24T08:01:32.899986+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:32.899986+0000","last_undegraded":"2026-02-24T08:01:32.899986+0000","last_fullsized":"2026-02-24T08:01:32.899986+0000","mapping_epoch":127,"log_start":"134'31344","ondisk_log_start":"134'31344","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256835584,"num_objects":3919,"num_object_clones":0,"num_object_copies":11757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31352,"num_write_kb":250816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"134'32344","reported_seq":32370,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011766+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:33.011766+0000","last_peered":"2026-02-24T08:01:33.011766+0000","last_clean":"2026-02-24T08:01:33.011766+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:33.011766+0000","last_undegraded":"2026-02-24T08:01:33.011766+0000","last_fullsized":"2026-02-24T08:01:33.011766+0000","mapping_epoch":127,"log_start":"134'32341","ondisk_log_start":"134'32341","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264962048,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32344,"num_write_kb":258752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"134'32488","reported_seq":32512,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.890914+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:32.890914+0000","last_peered":"2026-02-24T08:01:32.890914+0000","last_clean":"2026-02-24T08:01:32.890914+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:32.890914+0000","last_undegraded":"2026-02-24T08:01:32.890914+0000","last_fullsized":"2026-02-24T08:01:32.890914+0000","mapping_epoch":127,"log_start":"134'32480","ondisk_log_start":"134'32480","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266141696,"num_objects":4061,"num_object_clones":0,"num_object_copies":12183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32488,"num_write_kb":259904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"134'31856","reported_seq":31880,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.904336+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:32.904336+0000","last_peered":"2026-02-24T08:01:32.904336+0000","last_clean":"2026-02-24T08:01:32.904336+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:32.904336+0000","last_undegraded":"2026-02-24T08:01:32.904336+0000","last_fullsized":"2026-02-24T08:01:32.904336+0000","mapping_epoch":127,"log_start":"134'31848","ondisk_log_start":"134'31848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260964352,"num_objects":3982,"num_object_clones":0,"num_object_copies":11946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31856,"num_write_kb":254848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"134'32648","reported_seq":32674,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011837+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:33.011837+0000","last_peered":"2026-02-24T08:01:33.011837+0000","last_clean":"2026-02-24T08:01:33.011837+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:33.011837+0000","last_undegraded":"2026-02-24T08:01:33.011837+0000","last_fullsized":"2026-02-24T08:01:33.011837+0000","mapping_epoch":127,"log_start":"134'32645","ondisk_log_start":"134'32645","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267452416,"num_objects":4081,"num_object_clones":0,"num_object_copies":12243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32648,"num_write_kb":261184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"135'31784","reported_seq":31807,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167747+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:33.167747+0000","last_peered":"2026-02-24T08:01:33.167747+0000","last_clean":"2026-02-24T08:01:33.167747+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:33.167747+0000","last_undegraded":"2026-02-24T08:01:33.167747+0000","last_fullsized":"2026-02-24T08:01:33.167747+0000","mapping_epoch":127,"log_start":"135'31776","ondisk_log_start":"135'31776","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260374528,"num_objects":3973,"num_object_clones":0,"num_object_copies":11919,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3973,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31784,"num_write_kb":254272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"134'31848","reported_seq":31872,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.860359+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:32.860359+0000","last_peered":"2026-02-24T08:01:32.860359+0000","last_clean":"2026-02-24T08:01:32.860359+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:32.860359+0000","last_undegraded":"2026-02-24T08:01:32.860359+0000","last_fullsized":"2026-02-24T08:01:32.860359+0000","mapping_epoch":127,"log_start":"134'31840","ondisk_log_start":"134'31840","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260898816,"num_objects":3981,"num_object_clones":0,"num_object_copies":11943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31848,"num_write_kb":254784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"135'33008","reported_seq":33026,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167566+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:33.167566+0000","last_peered":"2026-02-24T08:01:33.167566+0000","last_clean":"2026-02-24T08:01:33.167566+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:33.167566+0000","last_undegraded":"2026-02-24T08:01:33.167566+0000","last_fullsized":"2026-02-24T08:01:33.167566+0000","mapping_epoch":127,"log_start":"135'32999","ondisk_log_start":"135'32999","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"134'33008","reported_seq":33034,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011820+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:33.011820+0000","last_peered":"2026-02-24T08:01:33.011820+0000","last_clean":"2026-02-24T08:01:33.011820+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:33.011820+0000","last_undegraded":"2026-02-24T08:01:33.011820+0000","last_fullsized":"2026-02-24T08:01:33.011820+0000","mapping_epoch":127,"log_start":"134'32992","ondisk_log_start":"134'32992","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"135'31408","reported_seq":31422,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.171124+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:33.171124+0000","last_peered":"2026-02-24T08:01:33.171124+0000","last_clean":"2026-02-24T08:01:33.171124+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:33.171124+0000","last_undegraded":"2026-02-24T08:01:33.171124+0000","last_fullsized":"2026-02-24T08:01:33.171124+0000","mapping_epoch":127,"log_start":"135'31394","ondisk_log_start":"135'31394","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257294336,"num_objects":3926,"num_object_clones":0,"num_object_copies":11778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31408,"num_write_kb":251264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"135'32752","reported_seq":32778,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.139505+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:33.139505+0000","last_peered":"2026-02-24T08:01:33.139505+0000","last_clean":"2026-02-24T08:01:33.139505+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:33.139505+0000","last_undegraded":"2026-02-24T08:01:33.139505+0000","last_fullsized":"2026-02-24T08:01:33.139505+0000","mapping_epoch":127,"log_start":"135'32736","ondisk_log_start":"135'32736","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268304384,"num_objects":4094,"num_object_clones":0,"num_object_copies":12282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32752,"num_write_kb":262016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":500,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:31.003011+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:31.003011+0000","last_peered":"2026-02-24T08:01:31.003011+0000","last_clean":"2026-02-24T08:01:31.003011+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:31.003011+0000","last_undegraded":"2026-02-24T08:01:31.003011+0000","last_fullsized":"2026-02-24T08:01:31.003011+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":4208459776,"num_objects":64216,"num_object_clones":0,"num_object_copies":192648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513728,"num_write_kb":4109824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12621946880,"data_stored":12621946880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215284,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4376984,"kb_used_data":3345412,"kb_used_omap":13,"kb_used_meta":1031538,"kb_avail":729626216,"statfs":{"total":751619276800,"available":747137245184,"internally_reserved":0,"allocated":3425701888,"data_stored":3425055524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14247,"internal_metadata":1056295001},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444213,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4652008,"kb_used_data":2766860,"kb_used_omap":22,"kb_used_meta":1885097,"kb_avail":729351192,"statfs":{"total":751619276800,"available":746855620608,"internally_reserved":0,"allocated":2833264640,"data_stored":2832618276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23544,"internal_metadata":1930339336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,9,37],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5216244,"kb_used_data":3567520,"kb_used_omap":19,"kb_used_meta":1648684,"kb_avail":728786956,"statfs":{"total":751619276800,"available":746277842944,"internally_reserved":0,"allocated":3653140480,"data_stored":3652497668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20280,"internal_metadata":1688252616},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705850,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4099552,"kb_used_data":2543180,"kb_used_omap":14,"kb_used_meta":1556337,"kb_avail":729903648,"statfs":{"total":751619276800,"available":747421335552,"internally_reserved":0,"allocated":2604216320,"data_stored":2603569956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14813,"internal_metadata":1593689635},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2629541888,"data_stored":2629541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3687292928,"data_stored":3687292928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2876547072,"data_stored":2876547072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3428564992,"data_stored":3428564992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:38.889 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:01:38.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:38.889 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:01:38.889 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:39.038 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:39.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 61 128 565559 565431 72.4087 62.0625 0.00511853 0.0138081 2026-02-24T08:01:39.108 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:39 trial016 ceph-mon[39544]: pgmap v558: 17 pgs: 17 active+clean; 3.9 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.87k op/s 2026-02-24T08:01:39.109 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:39 trial016 ceph-mon[39544]: 9.a scrub starts 2026-02-24T08:01:39.175 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:39.173+0000 7fb46d925640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:39.176 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:39.173+0000 7fb46d925640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:39.329 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:39.330 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:39.381 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2026-02-24T08:01:37.863097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4209050144,"num_objects":64218,"num_object_clones":0,"num_object_copies":192654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64218,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":513863,"num_write_kb":4111974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18344788,"kb_used_data":12222972,"kb_used_omap":71,"kb_used_meta":6121656,"kb_avail":2917668012,"statfs":{"total":3006477107200,"available":2987692044288,"internally_reserved":0,"allocated":12516323328,"data_stored":12513741424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72884,"internal_metadata":6268576588},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,16,53],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":233308160,"num_objects":3560,"num_object_clones":0,"num_object_copies":10680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28480,"num_write_kb":227840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854366"},"pg_stats":[{"pgid":"9.f","version":"134'30864","reported_seq":30888,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889770+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:32.889770+0000","last_peered":"2026-02-24T08:01:32.889770+0000","last_clean":"2026-02-24T08:01:32.889770+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:32.889770+0000","last_undegraded":"2026-02-24T08:01:32.889770+0000","last_fullsized":"2026-02-24T08:01:32.889770+0000","mapping_epoch":127,"log_start":"134'30848","ondisk_log_start":"134'30848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252837888,"num_objects":3858,"num_object_clones":0,"num_object_copies":11574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":246912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"134'32536","reported_seq":32560,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.889165+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:32.889165+0000","last_peered":"2026-02-24T08:01:32.889165+0000","last_clean":"2026-02-24T08:01:32.889165+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:32.889165+0000","last_undegraded":"2026-02-24T08:01:32.889165+0000","last_fullsized":"2026-02-24T08:01:32.889165+0000","mapping_epoch":127,"log_start":"134'32520","ondisk_log_start":"134'32520","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266534912,"num_objects":4067,"num_object_clones":0,"num_object_copies":12201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32536,"num_write_kb":260288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"134'31400","reported_seq":31424,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.888926+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:32.888926+0000","last_peered":"2026-02-24T08:01:32.888926+0000","last_clean":"2026-02-24T08:01:32.888926+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:32.888926+0000","last_undegraded":"2026-02-24T08:01:32.888926+0000","last_fullsized":"2026-02-24T08:01:32.888926+0000","mapping_epoch":127,"log_start":"134'31392","ondisk_log_start":"134'31392","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257228800,"num_objects":3925,"num_object_clones":0,"num_object_copies":11775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31400,"num_write_kb":251200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"135'31936","reported_seq":31962,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.165644+0000","last_change":"2026-02-24T08:00:36.944974+0000","last_active":"2026-02-24T08:01:33.165644+0000","last_peered":"2026-02-24T08:01:33.165644+0000","last_clean":"2026-02-24T08:01:33.165644+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:33.165644+0000","last_undegraded":"2026-02-24T08:01:33.165644+0000","last_fullsized":"2026-02-24T08:01:33.165644+0000","mapping_epoch":127,"log_start":"135'31920","ondisk_log_start":"135'31920","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:42.218148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261619712,"num_objects":3992,"num_object_clones":0,"num_object_copies":11976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31936,"num_write_kb":255488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"135'32496","reported_seq":32522,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.017331+0000","last_change":"2026-02-24T08:00:36.942567+0000","last_active":"2026-02-24T08:01:33.017331+0000","last_peered":"2026-02-24T08:01:33.017331+0000","last_clean":"2026-02-24T08:01:33.017331+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:33.017331+0000","last_undegraded":"2026-02-24T08:01:33.017331+0000","last_fullsized":"2026-02-24T08:01:33.017331+0000","mapping_epoch":127,"log_start":"135'32493","ondisk_log_start":"135'32493","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266207232,"num_objects":4062,"num_object_clones":0,"num_object_copies":12186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4062,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32496,"num_write_kb":259968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"134'31352","reported_seq":31376,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.899986+0000","last_change":"2026-02-24T08:00:36.942391+0000","last_active":"2026-02-24T08:01:32.899986+0000","last_peered":"2026-02-24T08:01:32.899986+0000","last_clean":"2026-02-24T08:01:32.899986+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:32.899986+0000","last_undegraded":"2026-02-24T08:01:32.899986+0000","last_fullsized":"2026-02-24T08:01:32.899986+0000","mapping_epoch":127,"log_start":"134'31344","ondisk_log_start":"134'31344","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.141778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256835584,"num_objects":3919,"num_object_clones":0,"num_object_copies":11757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31352,"num_write_kb":250816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"134'32344","reported_seq":32370,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011766+0000","last_change":"2026-02-24T08:00:36.941964+0000","last_active":"2026-02-24T08:01:33.011766+0000","last_peered":"2026-02-24T08:01:33.011766+0000","last_clean":"2026-02-24T08:01:33.011766+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:33.011766+0000","last_undegraded":"2026-02-24T08:01:33.011766+0000","last_fullsized":"2026-02-24T08:01:33.011766+0000","mapping_epoch":127,"log_start":"134'32341","ondisk_log_start":"134'32341","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.175175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264962048,"num_objects":4043,"num_object_clones":0,"num_object_copies":12129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32344,"num_write_kb":258752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"134'32488","reported_seq":32512,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.890914+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:32.890914+0000","last_peered":"2026-02-24T08:01:32.890914+0000","last_clean":"2026-02-24T08:01:32.890914+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:32.890914+0000","last_undegraded":"2026-02-24T08:01:32.890914+0000","last_fullsized":"2026-02-24T08:01:32.890914+0000","mapping_epoch":127,"log_start":"134'32480","ondisk_log_start":"134'32480","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266141696,"num_objects":4061,"num_object_clones":0,"num_object_copies":12183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32488,"num_write_kb":259904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"134'31856","reported_seq":31880,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.904336+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:32.904336+0000","last_peered":"2026-02-24T08:01:32.904336+0000","last_clean":"2026-02-24T08:01:32.904336+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:32.904336+0000","last_undegraded":"2026-02-24T08:01:32.904336+0000","last_fullsized":"2026-02-24T08:01:32.904336+0000","mapping_epoch":127,"log_start":"134'31848","ondisk_log_start":"134'31848","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:39.958260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260964352,"num_objects":3982,"num_object_clones":0,"num_object_copies":11946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31856,"num_write_kb":254848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"134'32648","reported_seq":32674,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011837+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:33.011837+0000","last_peered":"2026-02-24T08:01:33.011837+0000","last_clean":"2026-02-24T08:01:33.011837+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:33.011837+0000","last_undegraded":"2026-02-24T08:01:33.011837+0000","last_fullsized":"2026-02-24T08:01:33.011837+0000","mapping_epoch":127,"log_start":"134'32645","ondisk_log_start":"134'32645","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267452416,"num_objects":4081,"num_object_clones":0,"num_object_copies":12243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32648,"num_write_kb":261184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"135'31784","reported_seq":31807,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167747+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:33.167747+0000","last_peered":"2026-02-24T08:01:33.167747+0000","last_clean":"2026-02-24T08:01:33.167747+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:33.167747+0000","last_undegraded":"2026-02-24T08:01:33.167747+0000","last_fullsized":"2026-02-24T08:01:33.167747+0000","mapping_epoch":127,"log_start":"135'31776","ondisk_log_start":"135'31776","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260374528,"num_objects":3973,"num_object_clones":0,"num_object_copies":11919,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3973,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31784,"num_write_kb":254272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"134'31848","reported_seq":31872,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:32.860359+0000","last_change":"2026-02-24T08:00:36.942471+0000","last_active":"2026-02-24T08:01:32.860359+0000","last_peered":"2026-02-24T08:01:32.860359+0000","last_clean":"2026-02-24T08:01:32.860359+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:32.860359+0000","last_undegraded":"2026-02-24T08:01:32.860359+0000","last_fullsized":"2026-02-24T08:01:32.860359+0000","mapping_epoch":127,"log_start":"134'31840","ondisk_log_start":"134'31840","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:38.348706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260898816,"num_objects":3981,"num_object_clones":0,"num_object_copies":11943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31848,"num_write_kb":254784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"135'33008","reported_seq":33026,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.167566+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:33.167566+0000","last_peered":"2026-02-24T08:01:33.167566+0000","last_clean":"2026-02-24T08:01:33.167566+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:33.167566+0000","last_undegraded":"2026-02-24T08:01:33.167566+0000","last_fullsized":"2026-02-24T08:01:33.167566+0000","mapping_epoch":127,"log_start":"135'32999","ondisk_log_start":"135'32999","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"134'33008","reported_seq":33034,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.011820+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:33.011820+0000","last_peered":"2026-02-24T08:01:33.011820+0000","last_clean":"2026-02-24T08:01:33.011820+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:33.011820+0000","last_undegraded":"2026-02-24T08:01:33.011820+0000","last_fullsized":"2026-02-24T08:01:33.011820+0000","mapping_epoch":127,"log_start":"134'32992","ondisk_log_start":"134'32992","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270401536,"num_objects":4126,"num_object_clones":0,"num_object_copies":12378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33008,"num_write_kb":264064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"135'31408","reported_seq":31422,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.171124+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:33.171124+0000","last_peered":"2026-02-24T08:01:33.171124+0000","last_clean":"2026-02-24T08:01:33.171124+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:33.171124+0000","last_undegraded":"2026-02-24T08:01:33.171124+0000","last_fullsized":"2026-02-24T08:01:33.171124+0000","mapping_epoch":127,"log_start":"135'31394","ondisk_log_start":"135'31394","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257294336,"num_objects":3926,"num_object_clones":0,"num_object_copies":11778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31408,"num_write_kb":251264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"135'32752","reported_seq":32778,"reported_epoch":135,"state":"active+clean","last_fresh":"2026-02-24T08:01:33.139505+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:33.139505+0000","last_peered":"2026-02-24T08:01:33.139505+0000","last_clean":"2026-02-24T08:01:33.139505+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:33.139505+0000","last_undegraded":"2026-02-24T08:01:33.139505+0000","last_fullsized":"2026-02-24T08:01:33.139505+0000","mapping_epoch":127,"log_start":"135'32736","ondisk_log_start":"135'32736","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268304384,"num_objects":4094,"num_object_clones":0,"num_object_copies":12282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32752,"num_write_kb":262016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":500,"reported_epoch":134,"state":"active+clean","last_fresh":"2026-02-24T08:01:31.003011+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:31.003011+0000","last_peered":"2026-02-24T08:01:31.003011+0000","last_clean":"2026-02-24T08:01:31.003011+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:31.003011+0000","last_undegraded":"2026-02-24T08:01:31.003011+0000","last_fullsized":"2026-02-24T08:01:31.003011+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":4208459776,"num_objects":64216,"num_object_clones":0,"num_object_copies":192648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513728,"num_write_kb":4109824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12621946880,"data_stored":12621946880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215284,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4376984,"kb_used_data":3345412,"kb_used_omap":13,"kb_used_meta":1031538,"kb_avail":729626216,"statfs":{"total":751619276800,"available":747137245184,"internally_reserved":0,"allocated":3425701888,"data_stored":3425055524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14247,"internal_metadata":1056295001},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,16],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444213,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4652008,"kb_used_data":2766860,"kb_used_omap":22,"kb_used_meta":1885097,"kb_avail":729351192,"statfs":{"total":751619276800,"available":746855620608,"internally_reserved":0,"allocated":2833264640,"data_stored":2832618276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23544,"internal_metadata":1930339336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,2,8,9,37],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5216244,"kb_used_data":3567520,"kb_used_omap":19,"kb_used_meta":1648684,"kb_avail":728786956,"statfs":{"total":751619276800,"available":746277842944,"internally_reserved":0,"allocated":3653140480,"data_stored":3652497668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20280,"internal_metadata":1688252616},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705850,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4099552,"kb_used_data":2543180,"kb_used_omap":14,"kb_used_meta":1556337,"kb_avail":729903648,"statfs":{"total":751619276800,"available":747421335552,"internally_reserved":0,"allocated":2604216320,"data_stored":2603569956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14813,"internal_metadata":1593689635},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2629541888,"data_stored":2629541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3687292928,"data_stored":3687292928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2876547072,"data_stored":2876547072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3428564992,"data_stored":3428564992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:39.382 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:01:39.382 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 311 2026-02-24T08:01:39.531 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:39.660 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:39.659+0000 7f39e40d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:39.661 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:39.659+0000 7f39e40d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:39.752 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:39.821 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:01:39.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:01:39.911 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:40.037 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:40.035+0000 7f957f52a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:40.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:40.036+0000 7f957f52a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:40.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 62 128 574727 574599 72.396 71.625 0.00465203 0.0138098 2026-02-24T08:01:40.055 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:40.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:40.072 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:40.072 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:40.088 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:40.088 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:40.103 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:40.103 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: from='client.15737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: 9.b scrub starts 2026-02-24T08:01:40.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: from='client.15739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:40.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: 9.3 scrub starts 2026-02-24T08:01:40.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: 9.a scrub ok 2026-02-24T08:01:40.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2141930524' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "311"} : dispatch 2026-02-24T08:01:40.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:40 trial016 ceph-mon[39544]: osdmap e139: 4 total, 4 up, 4 in 2026-02-24T08:01:41.051 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 63 128 584541 584413 72.4638 76.6719 0.00256129 0.0137967 2026-02-24T08:01:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:41 trial016 ceph-mon[39544]: 9.b scrub ok 2026-02-24T08:01:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:41 trial016 ceph-mon[39544]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:41 trial016 ceph-mon[39544]: pgmap v559: 17 pgs: 17 active+clean; 4.3 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s wr, 7.25k op/s 2026-02-24T08:01:41.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:41 trial016 ceph-mon[39544]: 9.3 scrub ok 2026-02-24T08:01:41.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:41 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/370648663' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:42.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 64 127 594766 594639 72.5797 79.8906 0.0150313 0.0137752 2026-02-24T08:01:42.177 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:42.333 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:42.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:42.457+0000 7f117fac2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:42.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:42.457+0000 7f117fac2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:42.475 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:42.475 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:42.488 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:42.488 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:42.504 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:42.504 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:42.518 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:42.519 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:43.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 65 127 604511 604384 72.6343 76.1328 0.00855234 0.0137643 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: 9.9 scrub starts 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: pgmap v561: 17 pgs: 17 active+clean; 4.3 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.25k op/s 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4266480977' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:43.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:43 trial016 ceph-mon[39544]: 9.c scrub starts 2026-02-24T08:01:44.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 66 127 613664 613537 72.6171 71.5078 0.0195045 0.0137686 2026-02-24T08:01:44.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:44 trial016 ceph-mon[39544]: 9.9 scrub ok 2026-02-24T08:01:44.570 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:44.728 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:44.861 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:44.857+0000 7fd8c40f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:44.861 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:44.858+0000 7fd8c40f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:44.870 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:44.870 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:44.870 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:01:44.870 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:01:44.875 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:44.876 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:44.898 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:44.898 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:44.917 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:44.917 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:44.931 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:44.931 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:45.026 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:45.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 67 128 623288 623160 72.6553 75.1797 0.0107675 0.013761 2026-02-24T08:01:45.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:45 trial016 ceph-mon[39544]: pgmap v562: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s wr, 11.29k op/s 2026-02-24T08:01:45.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:45 trial016 ceph-mon[39544]: 9.6 scrub starts 2026-02-24T08:01:45.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:45 trial016 ceph-mon[39544]: 9.c scrub ok 2026-02-24T08:01:45.099 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:45 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/485436674' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:45.100 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:44 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:44] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:45.154 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:45.150+0000 7fc24438b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:45.154 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:45.151+0000 7fc24438b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:45.305 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:01:45.306 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:01:45.354 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":562,"stamp":"2026-02-24T08:01:43.863952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4949352992,"num_objects":75516,"num_object_clones":0,"num_object_copies":226548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75516,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":604232,"num_write_kb":4834926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19896452,"kb_used_data":14336436,"kb_used_omap":71,"kb_used_meta":5559864,"kb_avail":2916116348,"statfs":{"total":3006477107200,"available":2986103140352,"internally_reserved":0,"allocated":14680510464,"data_stored":14677771148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73263,"internal_metadata":5693301201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,12,1,17,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":740302848,"num_objects":11298,"num_object_clones":0,"num_object_copies":33894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90369,"num_write_kb":722952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001134"},"pg_stats":[{"pgid":"9.f","version":"139'36408","reported_seq":36442,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.898244+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:42.898244+0000","last_peered":"2026-02-24T08:01:42.898244+0000","last_clean":"2026-02-24T08:01:42.898244+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:42.898244+0000","last_undegraded":"2026-02-24T08:01:42.898244+0000","last_fullsized":"2026-02-24T08:01:42.898244+0000","mapping_epoch":127,"log_start":"139'36392","ondisk_log_start":"139'36392","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298254336,"num_objects":4551,"num_object_clones":0,"num_object_copies":13653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36408,"num_write_kb":291264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"139'38256","reported_seq":38290,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.875645+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:42.875645+0000","last_peered":"2026-02-24T08:01:42.875645+0000","last_clean":"2026-02-24T08:01:42.875645+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:42.875645+0000","last_undegraded":"2026-02-24T08:01:42.875645+0000","last_fullsized":"2026-02-24T08:01:42.875645+0000","mapping_epoch":127,"log_start":"139'38232","ondisk_log_start":"139'38232","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313393152,"num_objects":4782,"num_object_clones":0,"num_object_copies":14346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38256,"num_write_kb":306048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"139'36872","reported_seq":36906,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.835109+0000","last_change":"2026-02-24T08:00:36.943740+0000","last_active":"2026-02-24T08:01:42.835109+0000","last_peered":"2026-02-24T08:01:42.835109+0000","last_clean":"2026-02-24T08:01:42.835109+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:42.835109+0000","last_undegraded":"2026-02-24T08:01:42.835109+0000","last_fullsized":"2026-02-24T08:01:42.835109+0000","mapping_epoch":127,"log_start":"139'36858","ondisk_log_start":"139'36858","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:46.200492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302055424,"num_objects":4609,"num_object_clones":0,"num_object_copies":13827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36872,"num_write_kb":294976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"139'37272","reported_seq":37308,"reported_epoch":139,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:01:43.178343+0000","last_change":"2026-02-24T08:01:42.637166+0000","last_active":"2026-02-24T08:01:43.178343+0000","last_peered":"2026-02-24T08:01:43.178343+0000","last_clean":"2026-02-24T08:01:43.178343+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:43.178343+0000","last_undegraded":"2026-02-24T08:01:43.178343+0000","last_fullsized":"2026-02-24T08:01:43.178343+0000","mapping_epoch":127,"log_start":"139'37256","ondisk_log_start":"139'37256","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":1349,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305332224,"num_objects":4659,"num_object_clones":0,"num_object_copies":13977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37272,"num_write_kb":298176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"139'38136","reported_seq":38222,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.015241+0000","last_change":"2026-02-24T08:01:39.059596+0000","last_active":"2026-02-24T08:01:43.015241+0000","last_peered":"2026-02-24T08:01:43.015241+0000","last_clean":"2026-02-24T08:01:43.015241+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:43.015241+0000","last_undegraded":"2026-02-24T08:01:43.015241+0000","last_fullsized":"2026-02-24T08:01:43.015241+0000","mapping_epoch":127,"log_start":"139'38132","ondisk_log_start":"139'38132","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'35776","last_scrub_stamp":"2026-02-24T08:01:39.059472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.059472+0000","objects_scrubbed":4458,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:42.118989+0000","scrub_duration":582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312410112,"num_objects":4767,"num_object_clones":0,"num_object_copies":14301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38136,"num_write_kb":305088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"139'37024","reported_seq":37110,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.898724+0000","last_change":"2026-02-24T08:01:39.247790+0000","last_active":"2026-02-24T08:01:42.898724+0000","last_peered":"2026-02-24T08:01:42.898724+0000","last_clean":"2026-02-24T08:01:42.898724+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:42.898724+0000","last_undegraded":"2026-02-24T08:01:42.898724+0000","last_fullsized":"2026-02-24T08:01:42.898724+0000","mapping_epoch":127,"log_start":"139'37016","ondisk_log_start":"139'37016","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'34791","last_scrub_stamp":"2026-02-24T08:01:39.247711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.247711+0000","objects_scrubbed":4309,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:48.485434+0000","scrub_duration":1073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303300608,"num_objects":4628,"num_object_clones":0,"num_object_copies":13884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37024,"num_write_kb":296192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"139'38352","reported_seq":38441,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.017901+0000","last_change":"2026-02-24T08:01:42.113021+0000","last_active":"2026-02-24T08:01:43.017901+0000","last_peered":"2026-02-24T08:01:43.017901+0000","last_clean":"2026-02-24T08:01:43.017901+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:43.017901+0000","last_undegraded":"2026-02-24T08:01:43.017901+0000","last_fullsized":"2026-02-24T08:01:43.017901+0000","mapping_epoch":127,"log_start":"139'38344","ondisk_log_start":"139'38344","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37788","last_scrub_stamp":"2026-02-24T08:01:42.112989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:42.112989+0000","objects_scrubbed":4703,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:52.936078+0000","scrub_duration":628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314179584,"num_objects":4794,"num_object_clones":0,"num_object_copies":14382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38352,"num_write_kb":306816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"139'37920","reported_seq":37954,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.898941+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:42.898941+0000","last_peered":"2026-02-24T08:01:42.898941+0000","last_clean":"2026-02-24T08:01:42.898941+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:42.898941+0000","last_undegraded":"2026-02-24T08:01:42.898941+0000","last_fullsized":"2026-02-24T08:01:42.898941+0000","mapping_epoch":127,"log_start":"139'37904","ondisk_log_start":"139'37904","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310640640,"num_objects":4740,"num_object_clones":0,"num_object_copies":14220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37920,"num_write_kb":303360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"139'37432","reported_seq":37466,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.897199+0000","last_change":"2026-02-24T08:00:36.942981+0000","last_active":"2026-02-24T08:01:42.897199+0000","last_peered":"2026-02-24T08:01:42.897199+0000","last_clean":"2026-02-24T08:01:42.897199+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:42.897199+0000","last_undegraded":"2026-02-24T08:01:42.897199+0000","last_fullsized":"2026-02-24T08:01:42.897199+0000","mapping_epoch":127,"log_start":"139'37424","ondisk_log_start":"139'37424","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306642944,"num_objects":4679,"num_object_clones":0,"num_object_copies":14037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37432,"num_write_kb":299456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"139'38089","reported_seq":38116,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.019431+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:43.019431+0000","last_peered":"2026-02-24T08:01:43.019431+0000","last_clean":"2026-02-24T08:01:43.019431+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:43.019431+0000","last_undegraded":"2026-02-24T08:01:43.019431+0000","last_fullsized":"2026-02-24T08:01:43.019431+0000","mapping_epoch":127,"log_start":"139'38080","ondisk_log_start":"139'38080","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:51.887807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312025088,"num_objects":4762,"num_object_clones":0,"num_object_copies":14286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38089,"num_write_kb":304712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"139'37536","reported_seq":37548,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.185746+0000","last_change":"2026-02-24T08:00:36.944844+0000","last_active":"2026-02-24T08:01:43.185746+0000","last_peered":"2026-02-24T08:01:43.185746+0000","last_clean":"2026-02-24T08:01:43.185746+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:43.185746+0000","last_undegraded":"2026-02-24T08:01:43.185746+0000","last_fullsized":"2026-02-24T08:01:43.185746+0000","mapping_epoch":127,"log_start":"139'37512","ondisk_log_start":"139'37512","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:53.331422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307494912,"num_objects":4692,"num_object_clones":0,"num_object_copies":14076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37536,"num_write_kb":300288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"139'37536","reported_seq":37624,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.876012+0000","last_change":"2026-02-24T08:01:39.998368+0000","last_active":"2026-02-24T08:01:42.876012+0000","last_peered":"2026-02-24T08:01:42.876012+0000","last_clean":"2026-02-24T08:01:42.876012+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:42.876012+0000","last_undegraded":"2026-02-24T08:01:42.876012+0000","last_fullsized":"2026-02-24T08:01:42.876012+0000","mapping_epoch":127,"log_start":"139'37523","ondisk_log_start":"139'37523","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'35746","last_scrub_stamp":"2026-02-24T08:01:39.998288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.998288+0000","objects_scrubbed":4424,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:08.609104+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307494912,"num_objects":4692,"num_object_clones":0,"num_object_copies":14076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37536,"num_write_kb":300288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"139'38624","reported_seq":38650,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.171419+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:43.171419+0000","last_peered":"2026-02-24T08:01:43.171419+0000","last_clean":"2026-02-24T08:01:43.171419+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:43.171419+0000","last_undegraded":"2026-02-24T08:01:43.171419+0000","last_fullsized":"2026-02-24T08:01:43.171419+0000","mapping_epoch":127,"log_start":"139'38608","ondisk_log_start":"139'38608","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316407808,"num_objects":4828,"num_object_clones":0,"num_object_copies":14484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38624,"num_write_kb":308992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"139'38815","reported_seq":38843,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:42.985005+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:42.985005+0000","last_peered":"2026-02-24T08:01:42.985005+0000","last_clean":"2026-02-24T08:01:42.985005+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:42.985005+0000","last_undegraded":"2026-02-24T08:01:42.985005+0000","last_fullsized":"2026-02-24T08:01:42.985005+0000","mapping_epoch":127,"log_start":"139'38808","ondisk_log_start":"139'38808","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317972480,"num_objects":4852,"num_object_clones":0,"num_object_copies":14556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38815,"num_write_kb":310520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"139'37145","reported_seq":37178,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.169730+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:43.169730+0000","last_peered":"2026-02-24T08:01:43.169730+0000","last_clean":"2026-02-24T08:01:43.169730+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:43.169730+0000","last_undegraded":"2026-02-24T08:01:43.169730+0000","last_fullsized":"2026-02-24T08:01:43.169730+0000","mapping_epoch":127,"log_start":"139'37142","ondisk_log_start":"139'37142","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304291840,"num_objects":4644,"num_object_clones":0,"num_object_copies":13932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37145,"num_write_kb":297160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"139'38680","reported_seq":38714,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:43.161101+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:43.161101+0000","last_peered":"2026-02-24T08:01:43.161101+0000","last_clean":"2026-02-24T08:01:43.161101+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:43.161101+0000","last_undegraded":"2026-02-24T08:01:43.161101+0000","last_fullsized":"2026-02-24T08:01:43.161101+0000","mapping_epoch":127,"log_start":"139'38664","ondisk_log_start":"139'38664","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:57.200278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316866560,"num_objects":4835,"num_object_clones":0,"num_object_copies":14505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4835,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38680,"num_write_kb":309440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":510,"reported_epoch":139,"state":"active+clean","last_fresh":"2026-02-24T08:01:39.905039+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:39.905039+0000","last_peered":"2026-02-24T08:01:39.905039+0000","last_clean":"2026-02-24T08:01:39.905039+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:39.905039+0000","last_undegraded":"2026-02-24T08:01:39.905039+0000","last_fullsized":"2026-02-24T08:01:39.905039+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":4948762624,"num_objects":75514,"num_object_clones":0,"num_object_copies":226542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604097,"num_write_kb":4832776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14844420096,"data_stored":14844420096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12680,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215286,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5071196,"kb_used_data":3877192,"kb_used_omap":17,"kb_used_meta":1193966,"kb_avail":728932004,"statfs":{"total":751619276800,"available":746426372096,"internally_reserved":0,"allocated":3970244608,"data_stored":3969558891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17509,"internal_metadata":1222622107},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,6,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444215,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4695484,"kb_used_data":3261608,"kb_used_omap":13,"kb_used_meta":1433842,"kb_avail":729307716,"statfs":{"total":751619276800,"available":746811101184,"internally_reserved":0,"allocated":3339886592,"data_stored":3339200875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14141,"internal_metadata":1468254403},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,6,0,16,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6062944,"kb_used_data":4197004,"kb_used_omap":22,"kb_used_meta":1865897,"kb_avail":727940256,"statfs":{"total":751619276800,"available":745410822144,"internally_reserved":0,"allocated":4297732096,"data_stored":4297049931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23540,"internal_metadata":1910678540},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705852,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4066828,"kb_used_data":3000632,"kb_used_omap":17,"kb_used_meta":1066158,"kb_avail":729936372,"statfs":{"total":751619276800,"available":747454844928,"internally_reserved":0,"allocated":3072647168,"data_stored":3071961451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18073,"internal_metadata":1091746151},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12680,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3097452544,"data_stored":3097452544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4333346816,"data_stored":4333346816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3381985280,"data_stored":3381985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4031635456,"data_stored":4031635456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:01:45.356 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:01:45.357 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 321 2026-02-24T08:01:45.547 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:45.682 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:45.679+0000 7f761211c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:45.682 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:45.679+0000 7f761211c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:45.824 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:01:45.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:01:46.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 68 128 632601 632473 72.6567 72.7578 0.00367708 0.0137606 2026-02-24T08:01:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:46 trial016 ceph-mon[39544]: 9.6 scrub ok 2026-02-24T08:01:46.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:46 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/926844955' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "321"} : dispatch 2026-02-24T08:01:46.986 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:47.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 69 128 642449 642321 72.7187 76.9375 0.00481052 0.0137494 2026-02-24T08:01:47.136 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:47.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:47 trial016 ceph-mon[39544]: from='client.15751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:01:47.318 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:47 trial016 ceph-mon[39544]: pgmap v563: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.18k op/s 2026-02-24T08:01:47.464 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:47.461+0000 7f9f06cf2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:47.464 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:47.461+0000 7f9f06cf2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:47.480 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:47.481 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:47.494 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:47.494 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:47.508 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:47.508 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:47.521 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:47.521 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:48.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 70 128 648678 648550 72.375 48.6641 0.00877374 0.0138088 2026-02-24T08:01:48.078 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:48 trial016 ceph-mon[39544]: 9.d scrub starts 2026-02-24T08:01:48.078 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:48 trial016 ceph-mon[39544]: osdmap e140: 4 total, 4 up, 4 in 2026-02-24T08:01:48.079 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:48 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3149966817' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:49.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 71 128 658034 657906 72.3848 73.0938 0.011578 0.0138129 2026-02-24T08:01:49.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:49 trial016 ceph-mon[39544]: pgmap v565: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.86k op/s 2026-02-24T08:01:50.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 72 127 668083 667956 72.4698 78.5156 0.00357772 0.0137961 2026-02-24T08:01:50.081 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:50.229 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:50 trial016 ceph-mon[39544]: 9.d scrub ok 2026-02-24T08:01:50.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:50 trial016 ceph-mon[39544]: osdmap e141: 4 total, 4 up, 4 in 2026-02-24T08:01:50.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:50.646+0000 7fd6fb3e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:50.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:50.646+0000 7fd6fb3e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:50.667 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:50.667 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:50.693 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:50.693 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:50.708 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:50.708 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:50.723 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:50.723 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:50.867 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:01:50.867 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:01:50.868 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:01:50.868 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:01:51.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 73 128 675482 675354 72.2688 57.7969 0.00560054 0.0138343 2026-02-24T08:01:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:51 trial016 ceph-mon[39544]: pgmap v566: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s wr, 9.18k op/s 2026-02-24T08:01:51.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:51 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4212586958' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:51.539 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:52.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 74 128 683195 683067 72.1064 60.2578 0.0127063 0.0138617 2026-02-24T08:01:52.060 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:52.044+0000 7fce53b93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:52.060 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:52.044+0000 7fce53b93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:52.082 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:52.083 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:52.083 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:52.083 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:52.083 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:52.807 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:52.808 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:52.808 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:01:52.957 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:53.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 75 128 690305 690177 71.8856 55.5469 0.0144081 0.0139073 2026-02-24T08:01:53.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:53 trial016 ceph-mon[39544]: pgmap v568: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 20 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.56k op/s 2026-02-24T08:01:53.469 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:53.481 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:53.403+0000 7f72d45cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:53.403+0000 7f72d45cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:53.482 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:53.687 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:54.048 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:54.049 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:54.049 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:01:54.052 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 76 128 696994 696866 71.6273 52.2578 0.0165536 0.0139578 2026-02-24T08:01:54.527 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:54.478+0000 7f720b072640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:54.527 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:54.478+0000 7f720b072640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:54.527 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:54.527 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:54.528 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:54.529 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:54.544 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:54.544 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:54.560 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:54.560 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:54.815 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:54.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:54.942+0000 7f8e86ac6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:54.945 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:54.942+0000 7f8e86ac6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:54.967 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:54.976 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:01:54 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:01:54] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:01:55.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:55.011 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:55.011 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:01:55.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 77 128 704665 704537 71.4753 59.9297 0.005875 0.0139882 2026-02-24T08:01:55.165 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:55.232 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:55 trial016 ceph-mon[39544]: pgmap v569: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s wr, 10.45k op/s 2026-02-24T08:01:55.232 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:55 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2563816817' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:55.301 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:55.297+0000 7f16dea44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:55.301 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:55.298+0000 7f16dea44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:55.322 INFO:teuthology.orchestra.run.trial016.stderr:no valid command found; 10 closest matches: 2026-02-24T08:01:55.322 INFO:teuthology.orchestra.run.trial016.stderr:0 2026-02-24T08:01:55.322 INFO:teuthology.orchestra.run.trial016.stderr:1 2026-02-24T08:01:55.322 INFO:teuthology.orchestra.run.trial016.stderr:2 2026-02-24T08:01:55.322 INFO:teuthology.orchestra.run.trial016.stderr:abort 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:assert 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:bench [] [] [] [] 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:bluefs files list 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:bluefs stats 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:bluestore allocator dump block 2026-02-24T08:01:55.323 INFO:teuthology.orchestra.run.trial016.stderr:Error EINVAL: invalid command 2026-02-24T08:01:55.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:01:55.364 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:01:56.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 78 128 714039 713911 71.4978 73.2344 0.00358223 0.0139838 2026-02-24T08:01:56.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:56 trial016 ceph-mon[39544]: 9.4 scrub starts 2026-02-24T08:01:56.753 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:01:56.907 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:57.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:57.035+0000 7f2d57f20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:57.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:57.036+0000 7f2d57f20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:57.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 79 127 723063 722936 71.4852 70.5078 0.0218439 0.0139856 2026-02-24T08:01:57.055 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:57.056 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:57.074 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:57.075 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:57.089 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:57.089 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:57.103 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:57.103 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:01:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:57 trial016 ceph-mon[39544]: pgmap v570: 17 pgs: 17 active+clean; 5.2 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s wr, 9.46k op/s 2026-02-24T08:01:57.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:57 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2768778861' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:01:58.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout:2026-02-24T08:01:58.052535+0000 min lat: 0.000594996 max lat: 0.105233 avg lat: 0.0139734 2026-02-24T08:01:58.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:01:58.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 80 128 732877 732749 71.5498 76.6641 0.0054532 0.0139734 2026-02-24T08:01:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:58 trial016 ceph-mon[39544]: 9.4 scrub ok 2026-02-24T08:01:58.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:58 trial016 ceph-mon[39544]: pgmap v571: 17 pgs: 17 active+clean; 5.5 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 94 MiB/s wr, 12.05k op/s 2026-02-24T08:01:59.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 81 128 743211 743083 71.6631 80.7344 0.0221715 0.0139515 2026-02-24T08:01:59.152 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:01:59.307 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:01:59.421 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:59 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:01:59.422 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:01:59 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:01:59.428 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:59.425+0000 7f257aad9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:59.428 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:01:59.426+0000 7f257aad9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:01:59.444 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:01:59.445 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:01:59.459 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:01:59.459 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:01:59.473 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:01:59.473 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:01:59.489 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:01:59.489 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:00.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 82 128 752642 752514 71.6877 73.6797 0.0147251 0.0139469 2026-02-24T08:02:00.365 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:02:00.366 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:02:00.366 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_7 2026-02-24T08:02:00.366 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:00.392 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:00 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3960323154' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:00.392 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:00 trial016 ceph-mon[39544]: 9.5 scrub starts 2026-02-24T08:02:00.392 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:00 trial016 ceph-mon[39544]: pgmap v572: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s wr, 8.14k op/s 2026-02-24T08:02:00.514 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:00.641 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:00.639+0000 7faa095c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:00.642 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:00.640+0000 7faa095c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:00.802 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:00.803 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:00.861 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2026-02-24T08:01:59.866257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5981209120,"num_objects":91260,"num_object_clones":0,"num_object_copies":273780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91260,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":730191,"num_write_kb":5842598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22636724,"kb_used_data":17451428,"kb_used_omap":66,"kb_used_meta":5185149,"kb_avail":2913376076,"statfs":{"total":3006477107200,"available":2983297101824,"internally_reserved":0,"allocated":17870262272,"data_stored":17867460060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68423,"internal_metadata":5309592761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,5,40,12,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":667410432,"num_objects":10183,"num_object_clones":0,"num_object_copies":30549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81471,"num_write_kb":651768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001486"},"pg_stats":[{"pgid":"9.f","version":"141'44368","reported_seq":44406,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.736038+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:01:57.736038+0000","last_peered":"2026-02-24T08:01:57.736038+0000","last_clean":"2026-02-24T08:01:57.736038+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:01:57.736038+0000","last_undegraded":"2026-02-24T08:01:57.736038+0000","last_fullsized":"2026-02-24T08:01:57.736038+0000","mapping_epoch":127,"log_start":"141'44360","ondisk_log_start":"141'44360","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.127842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363462656,"num_objects":5546,"num_object_clones":0,"num_object_copies":16638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44368,"num_write_kb":354944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"141'46207","reported_seq":46232,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.742047+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:01:57.742047+0000","last_peered":"2026-02-24T08:01:57.742047+0000","last_clean":"2026-02-24T08:01:57.742047+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:01:57.742047+0000","last_undegraded":"2026-02-24T08:01:57.742047+0000","last_fullsized":"2026-02-24T08:01:57.742047+0000","mapping_epoch":127,"log_start":"141'46192","ondisk_log_start":"141'46192","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.917657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378527744,"num_objects":5776,"num_object_clones":0,"num_object_copies":17328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46207,"num_write_kb":369656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"141'44720","reported_seq":44817,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.879161+0000","last_change":"2026-02-24T08:01:48.415898+0000","last_active":"2026-02-24T08:01:57.879161+0000","last_peered":"2026-02-24T08:01:57.879161+0000","last_clean":"2026-02-24T08:01:57.879161+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:01:57.879161+0000","last_undegraded":"2026-02-24T08:01:57.879161+0000","last_fullsized":"2026-02-24T08:01:57.879161+0000","mapping_epoch":127,"log_start":"141'44688","ondisk_log_start":"141'44688","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"140'40000","last_scrub_stamp":"2026-02-24T08:01:48.415849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:48.415849+0000","objects_scrubbed":4963,"log_size":32,"log_dups_size":3000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.149619+0000","scrub_duration":1467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":366346240,"num_objects":5590,"num_object_clones":0,"num_object_copies":16770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44720,"num_write_kb":357760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"141'44768","reported_seq":44863,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.764930+0000","last_change":"2026-02-24T08:01:44.506124+0000","last_active":"2026-02-24T08:01:57.764930+0000","last_peered":"2026-02-24T08:01:57.764930+0000","last_clean":"2026-02-24T08:01:57.764930+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:01:57.764930+0000","last_undegraded":"2026-02-24T08:01:57.764930+0000","last_fullsized":"2026-02-24T08:01:57.764930+0000","mapping_epoch":127,"log_start":"141'44752","ondisk_log_start":"141'44752","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38120","last_scrub_stamp":"2026-02-24T08:01:44.506075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:44.506075+0000","objects_scrubbed":4691,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:46.861330+0000","scrub_duration":1866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":366739456,"num_objects":5596,"num_object_clones":0,"num_object_copies":16788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44768,"num_write_kb":358144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"141'45456","reported_seq":45546,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.737868+0000","last_change":"2026-02-24T08:01:39.059596+0000","last_active":"2026-02-24T08:01:57.737868+0000","last_peered":"2026-02-24T08:01:57.737868+0000","last_clean":"2026-02-24T08:01:57.737868+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:01:57.737868+0000","last_undegraded":"2026-02-24T08:01:57.737868+0000","last_fullsized":"2026-02-24T08:01:57.737868+0000","mapping_epoch":127,"log_start":"141'45449","ondisk_log_start":"141'45449","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'35776","last_scrub_stamp":"2026-02-24T08:01:39.059472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.059472+0000","objects_scrubbed":4458,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:42.118989+0000","scrub_duration":582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372375552,"num_objects":5682,"num_object_clones":0,"num_object_copies":17046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45456,"num_write_kb":363648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"141'44920","reported_seq":45010,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.736333+0000","last_change":"2026-02-24T08:01:39.247790+0000","last_active":"2026-02-24T08:01:57.736333+0000","last_peered":"2026-02-24T08:01:57.736333+0000","last_clean":"2026-02-24T08:01:57.736333+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:01:57.736333+0000","last_undegraded":"2026-02-24T08:01:57.736333+0000","last_fullsized":"2026-02-24T08:01:57.736333+0000","mapping_epoch":127,"log_start":"141'44904","ondisk_log_start":"141'44904","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'34791","last_scrub_stamp":"2026-02-24T08:01:39.247711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.247711+0000","objects_scrubbed":4309,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:48.485434+0000","scrub_duration":1073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367984640,"num_objects":5615,"num_object_clones":0,"num_object_copies":16845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44920,"num_write_kb":359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"141'46520","reported_seq":46607,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.761554+0000","last_change":"2026-02-24T08:01:42.113021+0000","last_active":"2026-02-24T08:01:57.761554+0000","last_peered":"2026-02-24T08:01:57.761554+0000","last_clean":"2026-02-24T08:01:57.761554+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:01:57.761554+0000","last_undegraded":"2026-02-24T08:01:57.761554+0000","last_fullsized":"2026-02-24T08:01:57.761554+0000","mapping_epoch":127,"log_start":"141'46512","ondisk_log_start":"141'46512","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37788","last_scrub_stamp":"2026-02-24T08:01:42.112989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:42.112989+0000","objects_scrubbed":4703,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:52.936078+0000","scrub_duration":628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381091840,"num_objects":5815,"num_object_clones":0,"num_object_copies":17445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46520,"num_write_kb":372160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"141'45977","reported_seq":46014,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.737650+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:01:57.737650+0000","last_peered":"2026-02-24T08:01:57.737650+0000","last_clean":"2026-02-24T08:01:57.737650+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:01:57.737650+0000","last_undegraded":"2026-02-24T08:01:57.737650+0000","last_fullsized":"2026-02-24T08:01:57.737650+0000","mapping_epoch":127,"log_start":"141'45972","ondisk_log_start":"141'45972","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:59.860570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":376643584,"num_objects":5748,"num_object_clones":0,"num_object_copies":17244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45977,"num_write_kb":367816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"141'45208","reported_seq":45303,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.737462+0000","last_change":"2026-02-24T08:01:45.415222+0000","last_active":"2026-02-24T08:01:57.737462+0000","last_peered":"2026-02-24T08:01:57.737462+0000","last_clean":"2026-02-24T08:01:57.737462+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:01:57.737462+0000","last_undegraded":"2026-02-24T08:01:57.737462+0000","last_fullsized":"2026-02-24T08:01:57.737462+0000","mapping_epoch":127,"log_start":"141'45200","ondisk_log_start":"141'45200","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38928","last_scrub_stamp":"2026-02-24T08:01:45.415144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:45.415144+0000","objects_scrubbed":4828,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:47.249950+0000","scrub_duration":1241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370343936,"num_objects":5651,"num_object_clones":0,"num_object_copies":16953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45208,"num_write_kb":361664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"141'46200","reported_seq":46238,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.734428+0000","last_change":"2026-02-24T08:00:36.942234+0000","last_active":"2026-02-24T08:01:57.734428+0000","last_peered":"2026-02-24T08:01:57.734428+0000","last_clean":"2026-02-24T08:01:57.734428+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:01:57.734428+0000","last_undegraded":"2026-02-24T08:01:57.734428+0000","last_fullsized":"2026-02-24T08:01:57.734428+0000","mapping_epoch":127,"log_start":"141'46192","ondisk_log_start":"141'46192","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378470400,"num_objects":5775,"num_object_clones":0,"num_object_copies":17325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46200,"num_write_kb":369600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"141'45144","reported_seq":45247,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.759929+0000","last_change":"2026-02-24T08:01:57.301776+0000","last_active":"2026-02-24T08:01:57.759929+0000","last_peered":"2026-02-24T08:01:57.759929+0000","last_clean":"2026-02-24T08:01:57.759929+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:01:57.759929+0000","last_undegraded":"2026-02-24T08:01:57.759929+0000","last_fullsized":"2026-02-24T08:01:57.759929+0000","mapping_epoch":127,"log_start":"141'45136","ondisk_log_start":"141'45136","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'44866","last_scrub_stamp":"2026-02-24T08:01:57.301706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:57.301706+0000","objects_scrubbed":5546,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:17.626468+0000","scrub_duration":1635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369819648,"num_objects":5643,"num_object_clones":0,"num_object_copies":16929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45144,"num_write_kb":361152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"141'46056","reported_seq":46144,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.890325+0000","last_change":"2026-02-24T08:01:39.998368+0000","last_active":"2026-02-24T08:01:57.890325+0000","last_peered":"2026-02-24T08:01:57.890325+0000","last_clean":"2026-02-24T08:01:57.890325+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:01:57.890325+0000","last_undegraded":"2026-02-24T08:01:57.890325+0000","last_fullsized":"2026-02-24T08:01:57.890325+0000","mapping_epoch":127,"log_start":"141'46040","ondisk_log_start":"141'46040","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'35746","last_scrub_stamp":"2026-02-24T08:01:39.998288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.998288+0000","objects_scrubbed":4424,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:08.609104+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377290752,"num_objects":5757,"num_object_clones":0,"num_object_copies":17271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46056,"num_write_kb":368448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"141'46368","reported_seq":46406,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.753230+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:01:57.753230+0000","last_peered":"2026-02-24T08:01:57.753230+0000","last_clean":"2026-02-24T08:01:57.753230+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:01:57.753230+0000","last_undegraded":"2026-02-24T08:01:57.753230+0000","last_fullsized":"2026-02-24T08:01:57.753230+0000","mapping_epoch":127,"log_start":"141'46360","ondisk_log_start":"141'46360","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:02.505327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379846656,"num_objects":5796,"num_object_clones":0,"num_object_copies":17388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46368,"num_write_kb":370944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"141'46840","reported_seq":46878,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.758225+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:01:57.758225+0000","last_peered":"2026-02-24T08:01:57.758225+0000","last_clean":"2026-02-24T08:01:57.758225+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:01:57.758225+0000","last_undegraded":"2026-02-24T08:01:57.758225+0000","last_fullsized":"2026-02-24T08:01:57.758225+0000","mapping_epoch":127,"log_start":"141'46835","ondisk_log_start":"141'46835","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383713280,"num_objects":5855,"num_object_clones":0,"num_object_copies":17565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46840,"num_write_kb":374720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"141'44984","reported_seq":45014,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.765427+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:01:57.765427+0000","last_peered":"2026-02-24T08:01:57.765427+0000","last_clean":"2026-02-24T08:01:57.765427+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:01:57.765427+0000","last_undegraded":"2026-02-24T08:01:57.765427+0000","last_fullsized":"2026-02-24T08:01:57.765427+0000","mapping_epoch":127,"log_start":"141'44960","ondisk_log_start":"141'44960","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:00.837563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368508928,"num_objects":5623,"num_object_clones":0,"num_object_copies":16869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44984,"num_write_kb":359872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"141'46320","reported_seq":46356,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:57.762362+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:01:57.762362+0000","last_peered":"2026-02-24T08:01:57.762362+0000","last_clean":"2026-02-24T08:01:57.762362+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:01:57.762362+0000","last_undegraded":"2026-02-24T08:01:57.762362+0000","last_fullsized":"2026-02-24T08:01:57.762362+0000","mapping_epoch":127,"log_start":"141'46312","ondisk_log_start":"141'46312","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379453440,"num_objects":5790,"num_object_clones":0,"num_object_copies":17370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46320,"num_write_kb":370560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":515,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:49.906548+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:49.906548+0000","last_peered":"2026-02-24T08:01:49.906548+0000","last_clean":"2026-02-24T08:01:49.906548+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:49.906548+0000","last_undegraded":"2026-02-24T08:01:49.906548+0000","last_fullsized":"2026-02-24T08:01:49.906548+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":5980618752,"num_objects":91258,"num_object_clones":0,"num_object_copies":273774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730056,"num_write_kb":5840448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17946075136,"data_stored":17946075136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215289,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6171612,"kb_used_data":4724936,"kb_used_omap":18,"kb_used_meta":1446637,"kb_avail":727831588,"statfs":{"total":751619276800,"available":745299546112,"internally_reserved":0,"allocated":4838334464,"data_stored":4837633023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18812,"internal_metadata":1481356932},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,16],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444218,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5106692,"kb_used_data":3979120,"kb_used_omap":15,"kb_used_meta":1127536,"kb_avail":728896508,"statfs":{"total":751619276800,"available":746390024192,"internally_reserved":0,"allocated":4074618880,"data_stored":4073917439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16097,"internal_metadata":1154597151},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,24,12,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6425840,"kb_used_data":5097564,"kb_used_omap":13,"kb_used_meta":1328242,"kb_avail":727577360,"statfs":{"total":751619276800,"available":745039216640,"internally_reserved":0,"allocated":5219905536,"data_stored":5219207647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14137,"internal_metadata":1360120007},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4932580,"kb_used_data":3649808,"kb_used_omap":18,"kb_used_meta":1282733,"kb_avail":729070620,"statfs":{"total":751619276800,"available":746568314880,"internally_reserved":0,"allocated":3737403392,"data_stored":3736701951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19377,"internal_metadata":1313518671},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3743956992,"data_stored":3743956992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5219786752,"data_stored":5219786752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096966656,"data_stored":4096966656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4885364736,"data_stored":4885364736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:02:00.862 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_7 pgp_num 26 2026-02-24T08:02:01.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 83 127 762091 761964 71.7134 73.8281 0.0138471 0.0139418 2026-02-24T08:02:01.056 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:01.199 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:01.197+0000 7fb17c9f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:01.200 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:01.197+0000 7fb17c9f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:01.352 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:02:01.352 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: 9.5 scrub ok 2026-02-24T08:02:01.352 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:02:01.353 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='client.15773 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:02:01.353 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:02:01.353 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:02:01.353 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' 2026-02-24T08:02:01.353 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:01 trial016 ceph-mon[39544]: from='mgr.14291 10.20.193.16:0/528295867' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:02:01.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:01.536 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:02:01.690 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:01.815 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:01.813+0000 7ff8bda1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:01.816 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:01.813+0000 7ff8bda1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:01.831 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:01.831 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:01.863 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:01.863 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:01.878 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:01.879 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:01.895 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:01.895 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:02.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 84 128 771887 771759 71.7706 76.5234 0.00952272 0.0139315 2026-02-24T08:02:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3748569210' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T08:02:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:02 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4269039814' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:02.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:02 trial016 ceph-mon[39544]: pgmap v573: 17 pgs: 17 active+clean; 5.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.81k op/s 2026-02-24T08:02:03.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 85 128 782175 782047 71.8717 80.375 0.0148601 0.0139106 2026-02-24T08:02:03.946 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:02:04.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 86 127 791952 791825 71.9242 76.3906 0.010643 0.0139012 2026-02-24T08:02:04.097 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:04.122 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:03 trial016 ceph-mon[39544]: 9.8 scrub starts 2026-02-24T08:02:04.227 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:04.224+0000 7f7f748db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:04.227 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:04.225+0000 7f7f748db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:04.242 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:04.242 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:04.262 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:04.262 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:04.277 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:04.277 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:04.297 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:04.297 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:05.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 87 128 801567 801439 71.9607 75.1094 0.0101967 0.0138939 2026-02-24T08:02:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:04 trial016 ceph-mon[39544]: pgmap v574: 17 pgs: 17 active+clean; 5.9 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 10.90k op/s 2026-02-24T08:02:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:04 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3463673351' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:04 trial016 ceph-mon[39544]: 9.7 scrub starts 2026-02-24T08:02:05.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:04 trial016 ceph-mon[39544]: 9.0 scrub starts 2026-02-24T08:02:05.317 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:04 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:02:04] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:02:06.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 88 128 810572 810444 71.9424 70.3516 0.0026508 0.0138977 2026-02-24T08:02:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:05 trial016 ceph-mon[39544]: 9.8 scrub ok 2026-02-24T08:02:06.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:05 trial016 ceph-mon[39544]: 9.2 scrub starts 2026-02-24T08:02:06.346 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:02:06.396 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:02:06.397 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:02:06.397 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:02:06.397 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:06.494 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:06.551 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:06.631 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:06.629+0000 7fd64104b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:06.631 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:06.629+0000 7fd64104b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:06.648 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:06.648 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:06.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:06.673+0000 7fa738e1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:06.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:06.673+0000 7fa738e1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:06.680 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:06.680 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:06.696 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:06.697 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:06.710 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:06.710 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:06.828 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:06.828 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:06.877 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2026-02-24T08:02:05.867170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6385476128,"num_objects":97429,"num_object_clones":0,"num_object_copies":292287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97429,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":779540,"num_write_kb":6237390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23514028,"kb_used_data":18620756,"kb_used_omap":67,"kb_used_meta":4893116,"kb_avail":2912498772,"statfs":{"total":3006477107200,"available":2982398742528,"internally_reserved":0,"allocated":19067654144,"data_stored":19064851932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69075,"internal_metadata":5010551341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[34,14,8,27,29,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":751263744,"num_objects":11464,"num_object_clones":0,"num_object_copies":34392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91707,"num_write_kb":733656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001822"},"pg_stats":[{"pgid":"9.f","version":"141'47288","reported_seq":47326,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.742318+0000","last_change":"2026-02-24T08:00:36.942968+0000","last_active":"2026-02-24T08:02:02.742318+0000","last_peered":"2026-02-24T08:02:02.742318+0000","last_clean":"2026-02-24T08:02:02.742318+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:02:02.742318+0000","last_undegraded":"2026-02-24T08:02:02.742318+0000","last_fullsized":"2026-02-24T08:02:02.742318+0000","mapping_epoch":127,"log_start":"141'47263","ondisk_log_start":"141'47263","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":3000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387383296,"num_objects":5911,"num_object_clones":0,"num_object_copies":17733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47288,"num_write_kb":378304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"141'49360","reported_seq":49398,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.717430+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:02:02.717430+0000","last_peered":"2026-02-24T08:02:02.717430+0000","last_clean":"2026-02-24T08:02:02.717430+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:02:02.717430+0000","last_undegraded":"2026-02-24T08:02:02.717430+0000","last_fullsized":"2026-02-24T08:02:02.717430+0000","mapping_epoch":127,"log_start":"141'49337","ondisk_log_start":"141'49337","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404357120,"num_objects":6170,"num_object_clones":0,"num_object_copies":18510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49360,"num_write_kb":394880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"141'47808","reported_seq":47905,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.832459+0000","last_change":"2026-02-24T08:01:48.415898+0000","last_active":"2026-02-24T08:02:02.832459+0000","last_peered":"2026-02-24T08:02:02.832459+0000","last_clean":"2026-02-24T08:02:02.832459+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:02:02.832459+0000","last_undegraded":"2026-02-24T08:02:02.832459+0000","last_fullsized":"2026-02-24T08:02:02.832459+0000","mapping_epoch":127,"log_start":"141'47796","ondisk_log_start":"141'47796","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"140'40000","last_scrub_stamp":"2026-02-24T08:01:48.415849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:48.415849+0000","objects_scrubbed":4963,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.149619+0000","scrub_duration":1467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":391643136,"num_objects":5976,"num_object_clones":0,"num_object_copies":17928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47808,"num_write_kb":382464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"141'48000","reported_seq":48095,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.757682+0000","last_change":"2026-02-24T08:01:44.506124+0000","last_active":"2026-02-24T08:02:02.757682+0000","last_peered":"2026-02-24T08:02:02.757682+0000","last_clean":"2026-02-24T08:02:02.757682+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:02:02.757682+0000","last_undegraded":"2026-02-24T08:02:02.757682+0000","last_fullsized":"2026-02-24T08:02:02.757682+0000","mapping_epoch":127,"log_start":"141'47984","ondisk_log_start":"141'47984","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38120","last_scrub_stamp":"2026-02-24T08:01:44.506075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:44.506075+0000","objects_scrubbed":4691,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:46.861330+0000","scrub_duration":1866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216000,"num_objects":6000,"num_object_clones":0,"num_object_copies":18000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48000,"num_write_kb":384000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"141'48696","reported_seq":48786,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.736665+0000","last_change":"2026-02-24T08:01:39.059596+0000","last_active":"2026-02-24T08:02:02.736665+0000","last_peered":"2026-02-24T08:02:02.736665+0000","last_clean":"2026-02-24T08:02:02.736665+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:02:02.736665+0000","last_undegraded":"2026-02-24T08:02:02.736665+0000","last_fullsized":"2026-02-24T08:02:02.736665+0000","mapping_epoch":127,"log_start":"141'48689","ondisk_log_start":"141'48689","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'35776","last_scrub_stamp":"2026-02-24T08:01:39.059472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.059472+0000","objects_scrubbed":4458,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:42.118989+0000","scrub_duration":582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398917632,"num_objects":6087,"num_object_clones":0,"num_object_copies":18261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6087,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48696,"num_write_kb":389568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"141'47832","reported_seq":47922,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.720677+0000","last_change":"2026-02-24T08:01:39.247790+0000","last_active":"2026-02-24T08:02:02.720677+0000","last_peered":"2026-02-24T08:02:02.720677+0000","last_clean":"2026-02-24T08:02:02.720677+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:02:02.720677+0000","last_undegraded":"2026-02-24T08:02:02.720677+0000","last_fullsized":"2026-02-24T08:02:02.720677+0000","mapping_epoch":127,"log_start":"141'47816","ondisk_log_start":"141'47816","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'34791","last_scrub_stamp":"2026-02-24T08:01:39.247711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.247711+0000","objects_scrubbed":4309,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:48.485434+0000","scrub_duration":1073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":391839744,"num_objects":5979,"num_object_clones":0,"num_object_copies":17937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47832,"num_write_kb":382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"141'49422","reported_seq":49512,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.762064+0000","last_change":"2026-02-24T08:01:42.113021+0000","last_active":"2026-02-24T08:02:02.762064+0000","last_peered":"2026-02-24T08:02:02.762064+0000","last_clean":"2026-02-24T08:02:02.762064+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:02:02.762064+0000","last_undegraded":"2026-02-24T08:02:02.762064+0000","last_fullsized":"2026-02-24T08:02:02.762064+0000","mapping_epoch":127,"log_start":"141'49418","ondisk_log_start":"141'49418","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37788","last_scrub_stamp":"2026-02-24T08:01:42.112989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:42.112989+0000","objects_scrubbed":4703,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:52.936078+0000","scrub_duration":628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404865024,"num_objects":6178,"num_object_clones":0,"num_object_copies":18534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49422,"num_write_kb":395376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"141'48888","reported_seq":48911,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.740394+0000","last_change":"2026-02-24T08:00:36.942654+0000","last_active":"2026-02-24T08:02:02.740394+0000","last_peered":"2026-02-24T08:02:02.740394+0000","last_clean":"2026-02-24T08:02:02.740394+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:02:02.740394+0000","last_undegraded":"2026-02-24T08:02:02.740394+0000","last_fullsized":"2026-02-24T08:02:02.740394+0000","mapping_epoch":127,"log_start":"141'48872","ondisk_log_start":"141'48872","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400490496,"num_objects":6111,"num_object_clones":0,"num_object_copies":18333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48888,"num_write_kb":391104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"141'48561","reported_seq":48655,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.744561+0000","last_change":"2026-02-24T08:01:45.415222+0000","last_active":"2026-02-24T08:02:02.744561+0000","last_peered":"2026-02-24T08:02:02.744561+0000","last_clean":"2026-02-24T08:02:02.744561+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:02:02.744561+0000","last_undegraded":"2026-02-24T08:02:02.744561+0000","last_fullsized":"2026-02-24T08:02:02.744561+0000","mapping_epoch":127,"log_start":"141'48538","ondisk_log_start":"141'48538","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38928","last_scrub_stamp":"2026-02-24T08:01:45.415144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:45.415144+0000","objects_scrubbed":4828,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:47.249950+0000","scrub_duration":1241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397811712,"num_objects":6071,"num_object_clones":0,"num_object_copies":18213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48561,"num_write_kb":388488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"141'49280","reported_seq":49384,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.761752+0000","last_change":"2026-02-24T08:02:00.252896+0000","last_active":"2026-02-24T08:02:02.761752+0000","last_peered":"2026-02-24T08:02:02.761752+0000","last_clean":"2026-02-24T08:02:02.761752+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:02:02.761752+0000","last_undegraded":"2026-02-24T08:02:02.761752+0000","last_fullsized":"2026-02-24T08:02:02.761752+0000","mapping_epoch":127,"log_start":"141'49276","ondisk_log_start":"141'49276","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'47653","last_scrub_stamp":"2026-02-24T08:02:00.252804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:00.252804+0000","objects_scrubbed":5938,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:06.734855+0000","scrub_duration":654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403701760,"num_objects":6160,"num_object_clones":0,"num_object_copies":18480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49280,"num_write_kb":394240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"141'48144","reported_seq":48247,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.752648+0000","last_change":"2026-02-24T08:01:57.301776+0000","last_active":"2026-02-24T08:02:02.752648+0000","last_peered":"2026-02-24T08:02:02.752648+0000","last_clean":"2026-02-24T08:02:02.752648+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:02:02.752648+0000","last_undegraded":"2026-02-24T08:02:02.752648+0000","last_fullsized":"2026-02-24T08:02:02.752648+0000","mapping_epoch":127,"log_start":"141'48141","ondisk_log_start":"141'48141","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'44866","last_scrub_stamp":"2026-02-24T08:01:57.301706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:57.301706+0000","objects_scrubbed":5546,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:17.626468+0000","scrub_duration":1635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394395648,"num_objects":6018,"num_object_clones":0,"num_object_copies":18054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48144,"num_write_kb":385152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"141'49006","reported_seq":49078,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.886811+0000","last_change":"2026-02-24T08:01:39.998368+0000","last_active":"2026-02-24T08:02:02.886811+0000","last_peered":"2026-02-24T08:02:02.886811+0000","last_clean":"2026-02-24T08:02:02.886811+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:02:02.886811+0000","last_undegraded":"2026-02-24T08:02:02.886811+0000","last_fullsized":"2026-02-24T08:02:02.886811+0000","mapping_epoch":127,"log_start":"141'48982","ondisk_log_start":"141'48982","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'35746","last_scrub_stamp":"2026-02-24T08:01:39.998288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.998288+0000","objects_scrubbed":4424,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:08.609104+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401457152,"num_objects":6126,"num_object_clones":0,"num_object_copies":18378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49006,"num_write_kb":392048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"141'49632","reported_seq":49670,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.755336+0000","last_change":"2026-02-24T08:00:36.944700+0000","last_active":"2026-02-24T08:02:02.755336+0000","last_peered":"2026-02-24T08:02:02.755336+0000","last_clean":"2026-02-24T08:02:02.755336+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:02:02.755336+0000","last_undegraded":"2026-02-24T08:02:02.755336+0000","last_fullsized":"2026-02-24T08:02:02.755336+0000","mapping_epoch":127,"log_start":"141'49624","ondisk_log_start":"141'49624","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406585344,"num_objects":6204,"num_object_clones":0,"num_object_copies":18612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49632,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"141'50016","reported_seq":50054,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.742100+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:02:02.742100+0000","last_peered":"2026-02-24T08:02:02.742100+0000","last_clean":"2026-02-24T08:02:02.742100+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:02:02.742100+0000","last_undegraded":"2026-02-24T08:02:02.742100+0000","last_fullsized":"2026-02-24T08:02:02.742100+0000","mapping_epoch":127,"log_start":"141'50008","ondisk_log_start":"141'50008","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:03.967799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409731072,"num_objects":6252,"num_object_clones":0,"num_object_copies":18756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50016,"num_write_kb":400128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"141'48088","reported_seq":48126,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.758432+0000","last_change":"2026-02-24T08:00:36.943444+0000","last_active":"2026-02-24T08:02:02.758432+0000","last_peered":"2026-02-24T08:02:02.758432+0000","last_clean":"2026-02-24T08:02:02.758432+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:02:02.758432+0000","last_undegraded":"2026-02-24T08:02:02.758432+0000","last_fullsized":"2026-02-24T08:02:02.758432+0000","mapping_epoch":127,"log_start":"141'48048","ondisk_log_start":"141'48048","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393936896,"num_objects":6011,"num_object_clones":0,"num_object_copies":18033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48088,"num_write_kb":384704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"141'49384","reported_seq":49422,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:02.748694+0000","last_change":"2026-02-24T08:00:36.944640+0000","last_active":"2026-02-24T08:02:02.748694+0000","last_peered":"2026-02-24T08:02:02.748694+0000","last_clean":"2026-02-24T08:02:02.748694+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:02:02.748694+0000","last_undegraded":"2026-02-24T08:02:02.748694+0000","last_fullsized":"2026-02-24T08:02:02.748694+0000","mapping_epoch":127,"log_start":"141'49376","ondisk_log_start":"141'49376","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404553728,"num_objects":6173,"num_object_clones":0,"num_object_copies":18519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49384,"num_write_kb":395072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":515,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:49.906548+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:49.906548+0000","last_peered":"2026-02-24T08:01:49.906548+0000","last_clean":"2026-02-24T08:01:49.906548+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:49.906548+0000","last_undegraded":"2026-02-24T08:01:49.906548+0000","last_fullsized":"2026-02-24T08:01:49.906548+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":6384885760,"num_objects":97427,"num_object_clones":0,"num_object_copies":292281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779405,"num_write_kb":6235240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19161767936,"data_stored":19161767936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215290,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5979404,"kb_used_data":5041336,"kb_used_omap":18,"kb_used_meta":938029,"kb_avail":728023796,"statfs":{"total":751619276800,"available":745496367104,"internally_reserved":0,"allocated":5162328064,"data_stored":5161626623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18812,"internal_metadata":960542340},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,7,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444219,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5427460,"kb_used_data":4245744,"kb_used_omap":15,"kb_used_meta":1181680,"kb_avail":728575740,"statfs":{"total":751619276800,"available":746061557760,"internally_reserved":0,"allocated":4347641856,"data_stored":4346940415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16097,"internal_metadata":1210040607},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,0,0,4,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6858472,"kb_used_data":5439948,"kb_used_omap":13,"kb_used_meta":1418482,"kb_avail":727144728,"statfs":{"total":751619276800,"available":744596201472,"internally_reserved":0,"allocated":5570506752,"data_stored":5569808863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14137,"internal_metadata":1452525767},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,7,7,15,24,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5248692,"kb_used_data":3893728,"kb_used_omap":19,"kb_used_meta":1354924,"kb_avail":728754508,"statfs":{"total":751619276800,"available":746244616192,"internally_reserved":0,"allocated":3987177472,"data_stored":3986476031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20029,"internal_metadata":1387442627},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,8],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3996819456,"data_stored":3996819456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5576335360,"data_stored":5576335360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4375044096,"data_stored":4375044096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5213569024,"data_stored":5213569024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:02:06.877 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:02:06.878 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 331 2026-02-24T08:02:07.027 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:07.053 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 89 128 819001 818873 71.8739 65.8516 0.0192091 0.0139106 2026-02-24T08:02:07.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:06 trial016 ceph-mon[39544]: pgmap v575: 17 pgs: 17 active+clean; 5.9 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.64k op/s 2026-02-24T08:02:07.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:06 trial016 ceph-mon[39544]: 9.7 scrub ok 2026-02-24T08:02:07.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:06 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4075144417' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:07.145 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:06 trial016 ceph-mon[39544]: 9.0 scrub ok 2026-02-24T08:02:07.163 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:07.161+0000 7f717e99b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:07.163 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:07.161+0000 7f717e99b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:07.327 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:02:07.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:08.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout: 90 5 829063 829058 71.9593 79.5703 0.0115854 0.0138951 2026-02-24T08:02:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:07 trial016 ceph-mon[39544]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:02:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:07 trial016 ceph-mon[39544]: 9.f scrub starts 2026-02-24T08:02:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:07 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/295153416' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "331"} : dispatch 2026-02-24T08:02:08.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:07 trial016 ceph-mon[39544]: 9.2 scrub ok 2026-02-24T08:02:08.757 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:02:08.874 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:08.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:08.977+0000 7fb4180b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:08.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:08.978+0000 7fb4180b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:08.992 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:08.992 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:09.002 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:09.003 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:09.013 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:09.013 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:09.023 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:09.023 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:09.029 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:08 trial016 ceph-mon[39544]: pgmap v576: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.3 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 86 MiB/s wr, 11.07k op/s 2026-02-24T08:02:09.029 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:08 trial016 ceph-mon[39544]: 9.f scrub ok 2026-02-24T08:02:09.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total time run: 90.0105 2026-02-24T08:02:09.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Total writes made: 829063 2026-02-24T08:02:09.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Write size: 8192 2026-02-24T08:02:09.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Object size: 65536 2026-02-24T08:02:09.054 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Bandwidth (MB/sec): 71.9589 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Bandwidth: 9.30988 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max bandwidth (MB/sec): 84.8281 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min bandwidth (MB/sec): 47.0156 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average IOPS: 9210 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev IOPS: 1191.67 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max IOPS: 10858 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min IOPS: 6018 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Average Latency(s): 0.0138951 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Stddev Latency(s): 0.00847389 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Max latency(s): 0.105233 2026-02-24T08:02:09.055 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Min latency(s): 0.000594996 2026-02-24T08:02:09.056 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:02:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:09 trial016 ceph-mon[39544]: 9.1 scrub starts 2026-02-24T08:02:10.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:09 trial016 ceph-mon[39544]: 9.1 scrub ok 2026-02-24T08:02:10.317 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:09 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3748285975' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:11.059 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:02:11.208 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:11.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:10 trial016 ceph-mon[39544]: pgmap v577: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.3 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s wr, 8.46k op/s 2026-02-24T08:02:11.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:11.331+0000 7f9bcd8a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:11.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:11.332+0000 7f9bcd8a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:11.352 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:11.352 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:11.374 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:11.374 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:11.390 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:11.390 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:11.408 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:11.408 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:12.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:11 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2103003708' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:12.369 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:02:12.370 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:02:12.370 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:02:12.370 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:12.516 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:12.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:12.647+0000 7fb4b4954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:12.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:12.648+0000 7fb4b4954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:12.792 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:12.792 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:12.843 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":578,"stamp":"2026-02-24T08:02:11.868065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6768640544,"num_objects":103276,"num_object_clones":0,"num_object_copies":309828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103276,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":826313,"num_write_kb":6611574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24080740,"kb_used_data":19755220,"kb_used_omap":67,"kb_used_meta":4325372,"kb_avail":2911932060,"statfs":{"total":3006477107200,"available":2981818429440,"internally_reserved":0,"allocated":20229345280,"data_stored":20226543068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69075,"internal_metadata":4429181485},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,8,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":787431424,"num_objects":12016,"num_object_clones":0,"num_object_copies":36048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12016,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96122,"num_write_kb":768976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001807"},"pg_stats":[{"pgid":"9.f","version":"141'50245","reported_seq":50305,"reported_epoch":141,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:02:07.749830+0000","last_change":"2026-02-24T08:02:07.315571+0000","last_active":"2026-02-24T08:02:07.749830+0000","last_peered":"2026-02-24T08:02:07.749830+0000","last_clean":"2026-02-24T08:02:07.749830+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:02:07.749830+0000","last_undegraded":"2026-02-24T08:02:07.749830+0000","last_fullsized":"2026-02-24T08:02:07.749830+0000","mapping_epoch":127,"log_start":"141'50241","ondisk_log_start":"141'50241","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":2049,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411607040,"num_objects":6281,"num_object_clones":0,"num_object_copies":18843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50245,"num_write_kb":401960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"141'52368","reported_seq":52406,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.712379+0000","last_change":"2026-02-24T08:00:36.942780+0000","last_active":"2026-02-24T08:02:07.712379+0000","last_peered":"2026-02-24T08:02:07.712379+0000","last_clean":"2026-02-24T08:02:07.712379+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:02:07.712379+0000","last_undegraded":"2026-02-24T08:02:07.712379+0000","last_fullsized":"2026-02-24T08:02:07.712379+0000","mapping_epoch":127,"log_start":"141'52360","ondisk_log_start":"141'52360","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428998656,"num_objects":6546,"num_object_clones":0,"num_object_copies":19638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52368,"num_write_kb":418944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"141'50577","reported_seq":50670,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.883272+0000","last_change":"2026-02-24T08:01:48.415898+0000","last_active":"2026-02-24T08:02:07.883272+0000","last_peered":"2026-02-24T08:02:07.883272+0000","last_clean":"2026-02-24T08:02:07.883272+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:02:07.883272+0000","last_undegraded":"2026-02-24T08:02:07.883272+0000","last_fullsized":"2026-02-24T08:02:07.883272+0000","mapping_epoch":127,"log_start":"141'50562","ondisk_log_start":"141'50562","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"140'40000","last_scrub_stamp":"2026-02-24T08:01:48.415849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:48.415849+0000","objects_scrubbed":4963,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.149619+0000","scrub_duration":1467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414326784,"num_objects":6323,"num_object_clones":0,"num_object_copies":18969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50577,"num_write_kb":404616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"141'50840","reported_seq":50935,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.762280+0000","last_change":"2026-02-24T08:01:44.506124+0000","last_active":"2026-02-24T08:02:07.762280+0000","last_peered":"2026-02-24T08:02:07.762280+0000","last_clean":"2026-02-24T08:02:07.762280+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:02:07.762280+0000","last_undegraded":"2026-02-24T08:02:07.762280+0000","last_fullsized":"2026-02-24T08:02:07.762280+0000","mapping_epoch":127,"log_start":"141'50832","ondisk_log_start":"141'50832","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38120","last_scrub_stamp":"2026-02-24T08:01:44.506075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:44.506075+0000","objects_scrubbed":4691,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:46.861330+0000","scrub_duration":1866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416481280,"num_objects":6355,"num_object_clones":0,"num_object_copies":19065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50840,"num_write_kb":406720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"141'51640","reported_seq":51730,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.760309+0000","last_change":"2026-02-24T08:01:39.059596+0000","last_active":"2026-02-24T08:02:07.760309+0000","last_peered":"2026-02-24T08:02:07.760309+0000","last_clean":"2026-02-24T08:02:07.760309+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:02:07.760309+0000","last_undegraded":"2026-02-24T08:02:07.760309+0000","last_fullsized":"2026-02-24T08:02:07.760309+0000","mapping_epoch":127,"log_start":"141'51632","ondisk_log_start":"141'51632","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'35776","last_scrub_stamp":"2026-02-24T08:01:39.059472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.059472+0000","objects_scrubbed":4458,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:42.118989+0000","scrub_duration":582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423034880,"num_objects":6455,"num_object_clones":0,"num_object_copies":19365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51640,"num_write_kb":413120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"141'50344","reported_seq":50434,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.744053+0000","last_change":"2026-02-24T08:01:39.247790+0000","last_active":"2026-02-24T08:02:07.744053+0000","last_peered":"2026-02-24T08:02:07.744053+0000","last_clean":"2026-02-24T08:02:07.744053+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:02:07.744053+0000","last_undegraded":"2026-02-24T08:02:07.744053+0000","last_fullsized":"2026-02-24T08:02:07.744053+0000","mapping_epoch":127,"log_start":"141'50336","ondisk_log_start":"141'50336","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'34791","last_scrub_stamp":"2026-02-24T08:01:39.247711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.247711+0000","objects_scrubbed":4309,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:48.485434+0000","scrub_duration":1073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412418048,"num_objects":6293,"num_object_clones":0,"num_object_copies":18879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50344,"num_write_kb":402752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"141'52632","reported_seq":52722,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.763945+0000","last_change":"2026-02-24T08:01:42.113021+0000","last_active":"2026-02-24T08:02:07.763945+0000","last_peered":"2026-02-24T08:02:07.763945+0000","last_clean":"2026-02-24T08:02:07.763945+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:02:07.763945+0000","last_undegraded":"2026-02-24T08:02:07.763945+0000","last_fullsized":"2026-02-24T08:02:07.763945+0000","mapping_epoch":127,"log_start":"141'52625","ondisk_log_start":"141'52625","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37788","last_scrub_stamp":"2026-02-24T08:01:42.112989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:42.112989+0000","objects_scrubbed":4703,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:52.936078+0000","scrub_duration":628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431161344,"num_objects":6579,"num_object_clones":0,"num_object_copies":19737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52632,"num_write_kb":421056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"141'51592","reported_seq":51702,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.749940+0000","last_change":"2026-02-24T08:02:06.312739+0000","last_active":"2026-02-24T08:02:07.749940+0000","last_peered":"2026-02-24T08:02:07.749940+0000","last_clean":"2026-02-24T08:02:07.749940+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:02:07.749940+0000","last_undegraded":"2026-02-24T08:02:07.749940+0000","last_fullsized":"2026-02-24T08:02:07.749940+0000","mapping_epoch":127,"log_start":"141'51584","ondisk_log_start":"141'51584","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'50776","last_scrub_stamp":"2026-02-24T08:02:06.312674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:06.312674+0000","objects_scrubbed":6282,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:30.983526+0000","scrub_duration":2027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422641664,"num_objects":6449,"num_object_clones":0,"num_object_copies":19347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51592,"num_write_kb":412736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"141'51664","reported_seq":51759,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.748457+0000","last_change":"2026-02-24T08:01:45.415222+0000","last_active":"2026-02-24T08:02:07.748457+0000","last_peered":"2026-02-24T08:02:07.748457+0000","last_clean":"2026-02-24T08:02:07.748457+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:02:07.748457+0000","last_undegraded":"2026-02-24T08:02:07.748457+0000","last_fullsized":"2026-02-24T08:02:07.748457+0000","mapping_epoch":127,"log_start":"141'51656","ondisk_log_start":"141'51656","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38928","last_scrub_stamp":"2026-02-24T08:01:45.415144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:45.415144+0000","objects_scrubbed":4828,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:47.249950+0000","scrub_duration":1241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423231488,"num_objects":6458,"num_object_clones":0,"num_object_copies":19374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51664,"num_write_kb":413312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"141'51976","reported_seq":52081,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.754525+0000","last_change":"2026-02-24T08:02:00.252896+0000","last_active":"2026-02-24T08:02:07.754525+0000","last_peered":"2026-02-24T08:02:07.754525+0000","last_clean":"2026-02-24T08:02:07.754525+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:02:07.754525+0000","last_undegraded":"2026-02-24T08:02:07.754525+0000","last_fullsized":"2026-02-24T08:02:07.754525+0000","mapping_epoch":127,"log_start":"141'51962","ondisk_log_start":"141'51962","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'47653","last_scrub_stamp":"2026-02-24T08:02:00.252804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:00.252804+0000","objects_scrubbed":5938,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:06.734855+0000","scrub_duration":654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425787392,"num_objects":6497,"num_object_clones":0,"num_object_copies":19491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51976,"num_write_kb":415808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"141'51360","reported_seq":51463,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.756971+0000","last_change":"2026-02-24T08:01:57.301776+0000","last_active":"2026-02-24T08:02:07.756971+0000","last_peered":"2026-02-24T08:02:07.756971+0000","last_clean":"2026-02-24T08:02:07.756971+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:02:07.756971+0000","last_undegraded":"2026-02-24T08:02:07.756971+0000","last_fullsized":"2026-02-24T08:02:07.756971+0000","mapping_epoch":127,"log_start":"141'51352","ondisk_log_start":"141'51352","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'44866","last_scrub_stamp":"2026-02-24T08:01:57.301706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:57.301706+0000","objects_scrubbed":5546,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:17.626468+0000","scrub_duration":1635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420741120,"num_objects":6420,"num_object_clones":0,"num_object_copies":19260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51360,"num_write_kb":410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"141'51892","reported_seq":51970,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.889706+0000","last_change":"2026-02-24T08:01:39.998368+0000","last_active":"2026-02-24T08:02:07.889706+0000","last_peered":"2026-02-24T08:02:07.889706+0000","last_clean":"2026-02-24T08:02:07.889706+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:02:07.889706+0000","last_undegraded":"2026-02-24T08:02:07.889706+0000","last_fullsized":"2026-02-24T08:02:07.889706+0000","mapping_epoch":127,"log_start":"141'51876","ondisk_log_start":"141'51876","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'35746","last_scrub_stamp":"2026-02-24T08:01:39.998288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.998288+0000","objects_scrubbed":4424,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:08.609104+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425099264,"num_objects":6487,"num_object_clones":0,"num_object_copies":19461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51892,"num_write_kb":415136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"141'52720","reported_seq":52831,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.763417+0000","last_change":"2026-02-24T08:02:07.690153+0000","last_active":"2026-02-24T08:02:07.763417+0000","last_peered":"2026-02-24T08:02:07.763417+0000","last_clean":"2026-02-24T08:02:07.763417+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:02:07.763417+0000","last_undegraded":"2026-02-24T08:02:07.763417+0000","last_fullsized":"2026-02-24T08:02:07.763417+0000","mapping_epoch":127,"log_start":"141'52696","ondisk_log_start":"141'52696","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'52650","last_scrub_stamp":"2026-02-24T08:02:07.690112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:07.690112+0000","objects_scrubbed":6517,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:23.040072+0000","scrub_duration":1970,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431882240,"num_objects":6590,"num_object_clones":0,"num_object_copies":19770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52720,"num_write_kb":421760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"141'52880","reported_seq":52918,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.755966+0000","last_change":"2026-02-24T08:00:36.942441+0000","last_active":"2026-02-24T08:02:07.755966+0000","last_peered":"2026-02-24T08:02:07.755966+0000","last_clean":"2026-02-24T08:02:07.755966+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:02:07.755966+0000","last_undegraded":"2026-02-24T08:02:07.755966+0000","last_fullsized":"2026-02-24T08:02:07.755966+0000","mapping_epoch":127,"log_start":"141'52873","ondisk_log_start":"141'52873","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:00:35.932156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":3000,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433192960,"num_objects":6610,"num_object_clones":0,"num_object_copies":19830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52880,"num_write_kb":423040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"141'51000","reported_seq":51109,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.754126+0000","last_change":"2026-02-24T08:02:06.776618+0000","last_active":"2026-02-24T08:02:07.754126+0000","last_peered":"2026-02-24T08:02:07.754126+0000","last_clean":"2026-02-24T08:02:07.754126+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:02:07.754126+0000","last_undegraded":"2026-02-24T08:02:07.754126+0000","last_fullsized":"2026-02-24T08:02:07.754126+0000","mapping_epoch":127,"log_start":"141'50992","ondisk_log_start":"141'50992","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'50440","last_scrub_stamp":"2026-02-24T08:02:06.776539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:06.776539+0000","objects_scrubbed":6237,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:11.439896+0000","scrub_duration":2066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417792000,"num_objects":6375,"num_object_clones":0,"num_object_copies":19125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51000,"num_write_kb":408000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"141'52448","reported_seq":52559,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:07.756957+0000","last_change":"2026-02-24T08:02:05.556717+0000","last_active":"2026-02-24T08:02:07.756957+0000","last_peered":"2026-02-24T08:02:07.756957+0000","last_clean":"2026-02-24T08:02:07.756957+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:02:07.756957+0000","last_undegraded":"2026-02-24T08:02:07.756957+0000","last_fullsized":"2026-02-24T08:02:07.756957+0000","mapping_epoch":127,"log_start":"141'52440","ondisk_log_start":"141'52440","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'51136","last_scrub_stamp":"2026-02-24T08:02:05.556625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:05.556625+0000","objects_scrubbed":6329,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.057542+0000","scrub_duration":1885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429654016,"num_objects":6556,"num_object_clones":0,"num_object_copies":19668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52448,"num_write_kb":419584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":515,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:49.906548+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:49.906548+0000","last_peered":"2026-02-24T08:01:49.906548+0000","last_clean":"2026-02-24T08:01:49.906548+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:49.906548+0000","last_undegraded":"2026-02-24T08:01:49.906548+0000","last_fullsized":"2026-02-24T08:01:49.906548+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":6768050176,"num_objects":103274,"num_object_clones":0,"num_object_copies":309822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826178,"num_write_kb":6609424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20310007808,"data_stored":20310007808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215291,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6375948,"kb_used_data":5347640,"kb_used_omap":18,"kb_used_meta":1028269,"kb_avail":727627252,"statfs":{"total":751619276800,"available":745090306048,"internally_reserved":0,"allocated":5475983360,"data_stored":5475281919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18812,"internal_metadata":1052948100},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,8],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444220,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5758836,"kb_used_data":4504928,"kb_used_omap":15,"kb_used_meta":1253872,"kb_avail":728244364,"statfs":{"total":751619276800,"available":745722228736,"internally_reserved":0,"allocated":4613046272,"data_stored":4612344831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16097,"internal_metadata":1283965215},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6348640,"kb_used_data":5768588,"kb_used_omap":13,"kb_used_meta":580018,"kb_avail":727654560,"statfs":{"total":751619276800,"available":745118269440,"internally_reserved":0,"allocated":5907034112,"data_stored":5906336223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14137,"internal_metadata":593938631},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5597316,"kb_used_data":4134064,"kb_used_omap":19,"kb_used_meta":1463212,"kb_avail":728405884,"statfs":{"total":751619276800,"available":745887625216,"internally_reserved":0,"allocated":4233281536,"data_stored":4232580095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20029,"internal_metadata":1498329539},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4240572416,"data_stored":4240572416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5910241280,"data_stored":5910241280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4635140096,"data_stored":4635140096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5524054016,"data_stored":5524054016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:02:12.844 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:02:12.844 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pg_num 341 2026-02-24T08:02:12.993 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:13.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:13.116+0000 7fb8af7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:13.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:13.116+0000 7fb8af7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:13.264 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:02:13.264 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:12 trial016 ceph-mon[39544]: pgmap v578: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.3 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.01k op/s 2026-02-24T08:02:13.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:13.455 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:02:13.606 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:13.744 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:13.742+0000 7f04e90d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:13.744 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:13.742+0000 7f04e90d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:13.760 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:13.760 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:13.779 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:13.779 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:13.799 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:13.799 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:13.813 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:13.813 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:13 trial016 ceph-mon[39544]: from='client.15791 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:02:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1407111169' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "341"} : dispatch 2026-02-24T08:02:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:13 trial016 ceph-mon[39544]: 9.e scrub starts 2026-02-24T08:02:14.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:13 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2752275891' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:15.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:14 trial016 ceph-mon[39544]: pgmap v579: 17 pgs: 17 active+clean; 4.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 64 MiB/s wr, 11.32k op/s 2026-02-24T08:02:15.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:14 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:02:14] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:02:15.865 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:02:16.014 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:16.149 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:15 trial016 ceph-mon[39544]: 9.e scrub ok 2026-02-24T08:02:16.498 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:16.425+0000 7f814faad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:16.498 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:16.425+0000 7f814faad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:16.499 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:16.505 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:16.505 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:17.046 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:16 trial016 ceph-mon[39544]: pgmap v580: 17 pgs: 17 active+clean; 4.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 32 MiB/s wr, 7.21k op/s 2026-02-24T08:02:17.046 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:16 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1204714205' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:18.311 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:02:18.311 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:02:18.311 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_7 2026-02-24T08:02:18.311 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:18.473 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:18.879 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:18.861+0000 7ff816113640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:18.879 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:18.861+0000 7ff816113640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:19.011 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:19.012 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:19.071 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:02:19.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:18 trial016 ceph-mon[39544]: pgmap v581: 17 pgs: 17 active+clean; 1.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 32 MiB/s wr, 10.67k op/s 2026-02-24T08:02:19.546 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:19.692 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":581,"stamp":"2026-02-24T08:02:17.868980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1651892792,"num_objects":25200,"num_object_clones":0,"num_object_copies":75600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25200,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":907635,"num_write_kb":6634655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11582848,"kb_used_data":6878512,"kb_used_omap":67,"kb_used_meta":4703932,"kb_avail":2924429952,"statfs":{"total":3006477107200,"available":2994616270848,"internally_reserved":0,"allocated":7043596288,"data_stored":7040781860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69075,"internal_metadata":4816826925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,5,6,18],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4733583336,"num_objects":-72229,"num_object_clones":0,"num_object_copies":-216687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-72229,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":128095,"num_write_kb":397265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001809"},"pg_stats":[{"pgid":"9.f","version":"141'55489","reported_seq":55591,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.752669+0000","last_change":"2026-02-24T08:02:08.188404+0000","last_active":"2026-02-24T08:02:17.752669+0000","last_peered":"2026-02-24T08:02:17.752669+0000","last_clean":"2026-02-24T08:02:17.752669+0000","last_became_active":"2026-02-24T08:00:36.942743+0000","last_became_peered":"2026-02-24T08:00:36.942743+0000","last_unstale":"2026-02-24T08:02:17.752669+0000","last_undegraded":"2026-02-24T08:02:17.752669+0000","last_fullsized":"2026-02-24T08:02:17.752669+0000","mapping_epoch":127,"log_start":"141'55478","ondisk_log_start":"141'55478","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'50408","last_scrub_stamp":"2026-02-24T08:02:08.188356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:08.188356+0000","objects_scrubbed":6286,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:24.961287+0000","scrub_duration":873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79953920,"num_objects":1220,"num_object_clones":0,"num_object_copies":3660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55489,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"141'57933","reported_seq":58014,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.750869+0000","last_change":"2026-02-24T08:02:14.896181+0000","last_active":"2026-02-24T08:02:17.750869+0000","last_peered":"2026-02-24T08:02:17.750869+0000","last_clean":"2026-02-24T08:02:17.750869+0000","last_became_active":"2026-02-24T08:00:36.942254+0000","last_became_peered":"2026-02-24T08:00:36.942254+0000","last_unstale":"2026-02-24T08:02:17.750869+0000","last_undegraded":"2026-02-24T08:02:17.750869+0000","last_fullsized":"2026-02-24T08:02:17.750869+0000","mapping_epoch":127,"log_start":"141'57925","ondisk_log_start":"141'57925","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'56281","last_scrub_stamp":"2026-02-24T08:02:14.896011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:14.896011+0000","objects_scrubbed":3348,"log_size":8,"log_dups_size":3000,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:39.867637+0000","scrub_duration":1524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82575360,"num_objects":1260,"num_object_clones":0,"num_object_copies":3780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57933,"num_write_kb":420928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"141'53040","reported_seq":53137,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:12.877337+0000","last_change":"2026-02-24T08:01:48.415898+0000","last_active":"2026-02-24T08:02:12.877337+0000","last_peered":"2026-02-24T08:02:12.877337+0000","last_clean":"2026-02-24T08:02:12.877337+0000","last_became_active":"2026-02-24T08:00:36.943551+0000","last_became_peered":"2026-02-24T08:00:36.943551+0000","last_unstale":"2026-02-24T08:02:12.877337+0000","last_undegraded":"2026-02-24T08:02:12.877337+0000","last_fullsized":"2026-02-24T08:02:12.877337+0000","mapping_epoch":127,"log_start":"141'53035","ondisk_log_start":"141'53035","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"140'40000","last_scrub_stamp":"2026-02-24T08:01:48.415849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:48.415849+0000","objects_scrubbed":4963,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.149619+0000","scrub_duration":1467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260571160,"num_objects":3977,"num_object_clones":0,"num_object_copies":11931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3977,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":53040,"num_write_kb":405441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"141'56166","reported_seq":56255,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.768739+0000","last_change":"2026-02-24T08:01:44.506124+0000","last_active":"2026-02-24T08:02:17.768739+0000","last_peered":"2026-02-24T08:02:17.768739+0000","last_clean":"2026-02-24T08:02:17.768739+0000","last_became_active":"2026-02-24T08:00:36.944777+0000","last_became_peered":"2026-02-24T08:00:36.944777+0000","last_unstale":"2026-02-24T08:02:17.768739+0000","last_undegraded":"2026-02-24T08:02:17.768739+0000","last_fullsized":"2026-02-24T08:02:17.768739+0000","mapping_epoch":127,"log_start":"141'56154","ondisk_log_start":"141'56154","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38120","last_scrub_stamp":"2026-02-24T08:01:44.506075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:44.506075+0000","objects_scrubbed":4691,"log_size":12,"log_dups_size":3000,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:46.861330+0000","scrub_duration":1866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78053376,"num_objects":1191,"num_object_clones":0,"num_object_copies":3573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56166,"num_write_kb":407872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"141'57080","reported_seq":57170,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.761007+0000","last_change":"2026-02-24T08:01:39.059596+0000","last_active":"2026-02-24T08:02:17.761007+0000","last_peered":"2026-02-24T08:02:17.761007+0000","last_clean":"2026-02-24T08:02:17.761007+0000","last_became_active":"2026-02-24T08:00:36.942446+0000","last_became_peered":"2026-02-24T08:00:36.942446+0000","last_unstale":"2026-02-24T08:02:17.761007+0000","last_undegraded":"2026-02-24T08:02:17.761007+0000","last_fullsized":"2026-02-24T08:02:17.761007+0000","mapping_epoch":127,"log_start":"141'57077","ondisk_log_start":"141'57077","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'35776","last_scrub_stamp":"2026-02-24T08:01:39.059472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.059472+0000","objects_scrubbed":4458,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:42.118989+0000","scrub_duration":582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78315520,"num_objects":1195,"num_object_clones":0,"num_object_copies":3585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57080,"num_write_kb":414400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"141'55767","reported_seq":55851,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.751441+0000","last_change":"2026-02-24T08:01:39.247790+0000","last_active":"2026-02-24T08:02:17.751441+0000","last_peered":"2026-02-24T08:02:17.751441+0000","last_clean":"2026-02-24T08:02:17.751441+0000","last_became_active":"2026-02-24T08:00:36.941814+0000","last_became_peered":"2026-02-24T08:00:36.941814+0000","last_unstale":"2026-02-24T08:02:17.751441+0000","last_undegraded":"2026-02-24T08:02:17.751441+0000","last_fullsized":"2026-02-24T08:02:17.751441+0000","mapping_epoch":127,"log_start":"141'55757","ondisk_log_start":"141'55757","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'34791","last_scrub_stamp":"2026-02-24T08:01:39.247711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.247711+0000","objects_scrubbed":4309,"log_size":10,"log_dups_size":3000,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:48.485434+0000","scrub_duration":1073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75890688,"num_objects":1158,"num_object_clones":0,"num_object_copies":3474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55767,"num_write_kb":404800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"141'58212","reported_seq":58305,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.764837+0000","last_change":"2026-02-24T08:01:42.113021+0000","last_active":"2026-02-24T08:02:17.764837+0000","last_peered":"2026-02-24T08:02:17.764837+0000","last_clean":"2026-02-24T08:02:17.764837+0000","last_became_active":"2026-02-24T08:00:36.941663+0000","last_became_peered":"2026-02-24T08:00:36.941663+0000","last_unstale":"2026-02-24T08:02:17.764837+0000","last_undegraded":"2026-02-24T08:02:17.764837+0000","last_fullsized":"2026-02-24T08:02:17.764837+0000","mapping_epoch":127,"log_start":"141'58208","ondisk_log_start":"141'58208","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37788","last_scrub_stamp":"2026-02-24T08:01:42.112989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:42.112989+0000","objects_scrubbed":4703,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:52.936078+0000","scrub_duration":628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80216064,"num_objects":1224,"num_object_clones":0,"num_object_copies":3672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58212,"num_write_kb":422656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"141'57104","reported_seq":57209,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.752047+0000","last_change":"2026-02-24T08:02:06.312739+0000","last_active":"2026-02-24T08:02:17.752047+0000","last_peered":"2026-02-24T08:02:17.752047+0000","last_clean":"2026-02-24T08:02:17.752047+0000","last_became_active":"2026-02-24T08:00:36.941910+0000","last_became_peered":"2026-02-24T08:00:36.941910+0000","last_unstale":"2026-02-24T08:02:17.752047+0000","last_undegraded":"2026-02-24T08:02:17.752047+0000","last_fullsized":"2026-02-24T08:02:17.752047+0000","mapping_epoch":127,"log_start":"141'57095","ondisk_log_start":"141'57095","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'50776","last_scrub_stamp":"2026-02-24T08:02:06.312674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:06.312674+0000","objects_scrubbed":6282,"log_size":9,"log_dups_size":3000,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:30.983526+0000","scrub_duration":2027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79101952,"num_objects":1207,"num_object_clones":0,"num_object_copies":3621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57104,"num_write_kb":414656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"141'57022","reported_seq":57103,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.752507+0000","last_change":"2026-02-24T08:01:45.415222+0000","last_active":"2026-02-24T08:02:17.752507+0000","last_peered":"2026-02-24T08:02:17.752507+0000","last_clean":"2026-02-24T08:02:17.752507+0000","last_became_active":"2026-02-24T08:00:36.942424+0000","last_became_peered":"2026-02-24T08:00:36.942424+0000","last_unstale":"2026-02-24T08:02:17.752507+0000","last_undegraded":"2026-02-24T08:02:17.752507+0000","last_fullsized":"2026-02-24T08:02:17.752507+0000","mapping_epoch":127,"log_start":"141'57005","ondisk_log_start":"141'57005","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38928","last_scrub_stamp":"2026-02-24T08:01:45.415144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:45.415144+0000","objects_scrubbed":4828,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:47.249950+0000","scrub_duration":1241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83296256,"num_objects":1271,"num_object_clones":0,"num_object_copies":3813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1271,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57022,"num_write_kb":414528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"141'57586","reported_seq":57691,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.764610+0000","last_change":"2026-02-24T08:02:00.252896+0000","last_active":"2026-02-24T08:02:17.764610+0000","last_peered":"2026-02-24T08:02:17.764610+0000","last_clean":"2026-02-24T08:02:17.764610+0000","last_became_active":"2026-02-24T08:00:36.942008+0000","last_became_peered":"2026-02-24T08:00:36.942008+0000","last_unstale":"2026-02-24T08:02:17.764610+0000","last_undegraded":"2026-02-24T08:02:17.764610+0000","last_fullsized":"2026-02-24T08:02:17.764610+0000","mapping_epoch":127,"log_start":"141'57582","ondisk_log_start":"141'57582","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'47653","last_scrub_stamp":"2026-02-24T08:02:00.252804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:00.252804+0000","objects_scrubbed":5938,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:06.734855+0000","scrub_duration":654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57586,"num_write_kb":418048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"141'56784","reported_seq":56887,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.762761+0000","last_change":"2026-02-24T08:01:57.301776+0000","last_active":"2026-02-24T08:02:17.762761+0000","last_peered":"2026-02-24T08:02:17.762761+0000","last_clean":"2026-02-24T08:02:17.762761+0000","last_became_active":"2026-02-24T08:00:36.944707+0000","last_became_peered":"2026-02-24T08:00:36.944707+0000","last_unstale":"2026-02-24T08:02:17.762761+0000","last_undegraded":"2026-02-24T08:02:17.762761+0000","last_fullsized":"2026-02-24T08:02:17.762761+0000","mapping_epoch":127,"log_start":"141'56781","ondisk_log_start":"141'56781","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'44866","last_scrub_stamp":"2026-02-24T08:01:57.301706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:57.301706+0000","objects_scrubbed":5546,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:17.626468+0000","scrub_duration":1635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82305024,"num_objects":1256,"num_object_clones":0,"num_object_copies":3768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56784,"num_write_kb":412728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"141'54358","reported_seq":54450,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:12.876745+0000","last_change":"2026-02-24T08:01:39.998368+0000","last_active":"2026-02-24T08:02:12.876745+0000","last_peered":"2026-02-24T08:02:12.876745+0000","last_clean":"2026-02-24T08:02:12.876745+0000","last_became_active":"2026-02-24T08:00:36.941986+0000","last_became_peered":"2026-02-24T08:00:36.941986+0000","last_unstale":"2026-02-24T08:02:12.876745+0000","last_undegraded":"2026-02-24T08:02:12.876745+0000","last_fullsized":"2026-02-24T08:02:12.876745+0000","mapping_epoch":127,"log_start":"141'54342","ondisk_log_start":"141'54342","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'35746","last_scrub_stamp":"2026-02-24T08:01:39.998288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:01:39.998288+0000","objects_scrubbed":4424,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:08.609104+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269090816,"num_objects":4106,"num_object_clones":0,"num_object_copies":12318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54358,"num_write_kb":415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"141'58250","reported_seq":58352,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.769464+0000","last_change":"2026-02-24T08:02:07.690153+0000","last_active":"2026-02-24T08:02:17.769464+0000","last_peered":"2026-02-24T08:02:17.769464+0000","last_clean":"2026-02-24T08:02:17.769464+0000","last_became_active":"2026-02-24T08:00:36.944502+0000","last_became_peered":"2026-02-24T08:00:36.944502+0000","last_unstale":"2026-02-24T08:02:17.769464+0000","last_undegraded":"2026-02-24T08:02:17.769464+0000","last_fullsized":"2026-02-24T08:02:17.769464+0000","mapping_epoch":127,"log_start":"141'58239","ondisk_log_start":"141'58239","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'52650","last_scrub_stamp":"2026-02-24T08:02:07.690112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:07.690112+0000","objects_scrubbed":6517,"log_size":11,"log_dups_size":3000,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:23.040072+0000","scrub_duration":1970,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82444288,"num_objects":1258,"num_object_clones":0,"num_object_copies":3774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58250,"num_write_kb":423168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"141'58420","reported_seq":58532,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.764689+0000","last_change":"2026-02-24T08:02:08.966269+0000","last_active":"2026-02-24T08:02:17.764689+0000","last_peered":"2026-02-24T08:02:17.764689+0000","last_clean":"2026-02-24T08:02:17.764689+0000","last_became_active":"2026-02-24T08:00:36.942210+0000","last_became_peered":"2026-02-24T08:00:36.942210+0000","last_unstale":"2026-02-24T08:02:17.764689+0000","last_undegraded":"2026-02-24T08:02:17.764689+0000","last_fullsized":"2026-02-24T08:02:17.764689+0000","mapping_epoch":127,"log_start":"141'58416","ondisk_log_start":"141'58416","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'53008","last_scrub_stamp":"2026-02-24T08:02:08.966222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:08.966222+0000","objects_scrubbed":6626,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:32.999999+0000","scrub_duration":312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79560704,"num_objects":1214,"num_object_clones":0,"num_object_copies":3642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58420,"num_write_kb":424064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"141'56286","reported_seq":56391,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.768241+0000","last_change":"2026-02-24T08:02:06.776618+0000","last_active":"2026-02-24T08:02:17.768241+0000","last_peered":"2026-02-24T08:02:17.768241+0000","last_clean":"2026-02-24T08:02:17.768241+0000","last_became_active":"2026-02-24T08:00:36.943340+0000","last_became_peered":"2026-02-24T08:00:36.943340+0000","last_unstale":"2026-02-24T08:02:17.768241+0000","last_undegraded":"2026-02-24T08:02:17.768241+0000","last_fullsized":"2026-02-24T08:02:17.768241+0000","mapping_epoch":127,"log_start":"141'56273","ondisk_log_start":"141'56273","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'50440","last_scrub_stamp":"2026-02-24T08:02:06.776539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:06.776539+0000","objects_scrubbed":6237,"log_size":13,"log_dups_size":3000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:11.439896+0000","scrub_duration":2066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79626240,"num_objects":1215,"num_object_clones":0,"num_object_copies":3645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56286,"num_write_kb":408896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"141'58003","reported_seq":58113,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:02:17.763243+0000","last_change":"2026-02-24T08:02:05.556717+0000","last_active":"2026-02-24T08:02:17.763243+0000","last_peered":"2026-02-24T08:02:17.763243+0000","last_clean":"2026-02-24T08:02:17.763243+0000","last_became_active":"2026-02-24T08:00:36.944454+0000","last_became_peered":"2026-02-24T08:00:36.944454+0000","last_unstale":"2026-02-24T08:02:17.763243+0000","last_undegraded":"2026-02-24T08:02:17.763243+0000","last_fullsized":"2026-02-24T08:02:17.763243+0000","mapping_epoch":127,"log_start":"141'58000","ondisk_log_start":"141'58000","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'51136","last_scrub_stamp":"2026-02-24T08:02:05.556625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:00:35.932156+0000","last_clean_scrub_stamp":"2026-02-24T08:02:05.556625+0000","objects_scrubbed":6329,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:09.057542+0000","scrub_duration":1885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81526784,"num_objects":1244,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58003,"num_write_kb":421312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":515,"reported_epoch":141,"state":"active+clean","last_fresh":"2026-02-24T08:01:49.906548+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:01:49.906548+0000","last_peered":"2026-02-24T08:01:49.906548+0000","last_clean":"2026-02-24T08:01:49.906548+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:01:49.906548+0000","last_undegraded":"2026-02-24T08:01:49.906548+0000","last_fullsized":"2026-02-24T08:01:49.906548+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1651302424,"num_objects":25198,"num_object_clones":0,"num_object_copies":75594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25198,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":907500,"num_write_kb":6632505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6299570176,"data_stored":6299557960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215292,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4923328,"kb_used_data":3822764,"kb_used_omap":18,"kb_used_meta":1100461,"kb_avail":729079872,"statfs":{"total":751619276800,"available":746577788928,"internally_reserved":0,"allocated":3914510336,"data_stored":3913804823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18812,"internal_metadata":1126872708},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444222,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2412744,"kb_used_data":1068532,"kb_used_omap":15,"kb_used_meta":1344112,"kb_avail":731590456,"statfs":{"total":751619276800,"available":749148626944,"internally_reserved":0,"allocated":1094176768,"data_stored":1093471255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16097,"internal_metadata":1376370975},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1819196,"kb_used_data":1112744,"kb_used_omap":13,"kb_used_meta":706354,"kb_avail":732184004,"statfs":{"total":751619276800,"available":749756420096,"internally_reserved":0,"allocated":1139449856,"data_stored":1138747895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14137,"internal_metadata":723306695},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,4,14],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2427580,"kb_used_data":874472,"kb_used_omap":19,"kb_used_meta":1553004,"kb_avail":731575620,"statfs":{"total":751619276800,"available":749133434880,"internally_reserved":0,"allocated":895459328,"data_stored":894757887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20029,"internal_metadata":1590276547},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12805,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":802676736,"data_stored":802676736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1117384704,"data_stored":1117380632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":883757056,"data_stored":883752984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3495751680,"data_stored":3495747608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:02:19.694 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set unique_pool_7 pgp_num 26 2026-02-24T08:02:19.913 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:20.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:20.085+0000 7f7a8745b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:20.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:20.085+0000 7f7a8745b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:20.113 INFO:teuthology.orchestra.run.trial016.stdout:osd.0: {} 2026-02-24T08:02:20.113 INFO:teuthology.orchestra.run.trial016.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:02:20.131 INFO:teuthology.orchestra.run.trial016.stdout:osd.1: {} 2026-02-24T08:02:20.131 INFO:teuthology.orchestra.run.trial016.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:02:20.145 INFO:teuthology.orchestra.run.trial016.stdout:osd.2: {} 2026-02-24T08:02:20.145 INFO:teuthology.orchestra.run.trial016.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:02:20.156 INFO:teuthology.orchestra.run.trial016.stdout:osd.3: {} 2026-02-24T08:02:20.156 INFO:teuthology.orchestra.run.trial016.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:02:20.210 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Removed 103633 objects 2026-02-24T08:02:20.210 INFO:tasks.radosbench.radosbench.0.trial016.stdout:Clean up completed and total clean up time :11.1539 2026-02-24T08:02:20.224 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:19 trial016 ceph-mon[39544]: from='client.15799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:02:20.610 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:20.518+0000 7fd521e54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:20.610 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:20.519+0000 7fd521e54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:20.632 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:02:21.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:20 trial016 ceph-mon[39544]: pgmap v582: 17 pgs: 17 active+clean; 1.2 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 5.6 MiB/s wr, 7.74k op/s 2026-02-24T08:02:21.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1585093971' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:02:21.251 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:20 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3408072738' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T08:02:21.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:21.781 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_7 2026-02-24T08:02:21.782 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2026-02-24T08:02:21.900 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:22.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:22.377+0000 7f9915317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:22.459 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:22.377+0000 7f9915317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:22.932 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_7' removed 2026-02-24T08:02:23.250 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:22 trial016 ceph-mon[39544]: pgmap v583: 17 pgs: 17 active+clean; 1.2 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 1.9 MiB/s wr, 7.26k op/s 2026-02-24T08:02:23.250 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:22 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3728018158' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:02:23.547 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-24T08:02:23.559 INFO:tasks.thrashosds:joining thrashosds 2026-02-24T08:02:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:23 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3728018158' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:02:24.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:23 trial016 ceph-mon[39544]: osdmap e142: 4 total, 4 up, 4 in 2026-02-24T08:02:25.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:24 trial016 ceph-mon[39544]: pgmap v585: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:25.316 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:24 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:02:24] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:02:26.782 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:02:26.783 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 341 2026-02-24T08:02:26.901 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:27.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.007+0000 7f875c279640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.008+0000 7f875c279640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.066 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:26 trial016 ceph-mon[39544]: pgmap v586: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:27.121 INFO:teuthology.orchestra.run.trial016.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:02:27.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:27.153 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2026-02-24T08:02:27.269 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:27.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.363+0000 7ff1447ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.366 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.363+0000 7ff1447ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.372 INFO:teuthology.orchestra.run.trial016.stdout:{} 2026-02-24T08:02:27.372 INFO:teuthology.orchestra.run.trial016.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-24T08:02:27.406 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:02:27.522 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:27.624 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.621+0000 7f7e75773640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.624 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:27.622+0000 7f7e75773640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:27.942 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:02:27.981 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd primary-affinity 0 1 2026-02-24T08:02:28.096 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:28.196 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:28.194+0000 7f7f94282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:28.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2476083892' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "341"} : dispatch 2026-02-24T08:02:28.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2180529593' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T08:02:28.196 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:27 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3810295829' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:02:28.197 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:28.194+0000 7f7f94282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:28.943 INFO:teuthology.orchestra.run.trial016.stderr:set osd.0 primary-affinity to 1 (8655362) 2026-02-24T08:02:28.982 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:02:29.098 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:29.201 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:29.198+0000 7f0437e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:29.201 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:29.199+0000 7f0437e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:29.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:28 trial016 ceph-mon[39544]: pgmap v587: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:29.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3810295829' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:02:29.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:28 trial016 ceph-mon[39544]: osdmap e143: 4 total, 4 up, 4 in 2026-02-24T08:02:29.202 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:28 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1374351420' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:02:29.947 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:02:29.986 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd primary-affinity 1 1 2026-02-24T08:02:30.100 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:30.198 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:30.196+0000 7faea6e43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:30.198 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1374351420' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:02:30.198 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:29 trial016 ceph-mon[39544]: osdmap e144: 4 total, 4 up, 4 in 2026-02-24T08:02:30.198 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:29 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3885801396' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:02:30.198 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:30.197+0000 7faea6e43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:30.948 INFO:teuthology.orchestra.run.trial016.stderr:set osd.1 primary-affinity to 1 (8655362) 2026-02-24T08:02:30.993 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:02:31.110 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:31.209 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:31.206+0000 7fd68fc94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:31.209 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:30 trial016 ceph-mon[39544]: pgmap v590: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:31.210 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3885801396' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:02:31.210 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:30 trial016 ceph-mon[39544]: osdmap e145: 4 total, 4 up, 4 in 2026-02-24T08:02:31.210 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:30 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2350671456' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:02:31.210 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:31.207+0000 7fd68fc94640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:31.955 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:02:31.993 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd primary-affinity 2 1 2026-02-24T08:02:32.108 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:32.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:32.213+0000 7f21f63e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:32.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:32.213+0000 7f21f63e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:32.215 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2350671456' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:02:32.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:31 trial016 ceph-mon[39544]: osdmap e146: 4 total, 4 up, 4 in 2026-02-24T08:02:32.216 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:31 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2393663189' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:02:32.956 INFO:teuthology.orchestra.run.trial016.stderr:set osd.2 primary-affinity to 1 (8655362) 2026-02-24T08:02:32.998 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:02:33.113 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:33.223 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:33.221+0000 7fbfe9440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: pgmap v593: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2393663189' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: osdmap e147: 4 total, 4 up, 4 in 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:02:33.223 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:32 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2708994215' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:02:33.224 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:33.221+0000 7fbfe9440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:33.962 INFO:teuthology.orchestra.run.trial016.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:02:34.000 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd primary-affinity 3 1 2026-02-24T08:02:34.114 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:34.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:34.217+0000 7fac4c5d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:34.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2708994215' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:02:34.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:33 trial016 ceph-mon[39544]: osdmap e148: 4 total, 4 up, 4 in 2026-02-24T08:02:34.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:33 trial016 ceph-mon[39544]: purged_snaps scrub starts 2026-02-24T08:02:34.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:33 trial016 ceph-mon[39544]: purged_snaps scrub ok 2026-02-24T08:02:34.219 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:33 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1765977909' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:02:34.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:34.217+0000 7fac4c5d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:34.963 INFO:teuthology.orchestra.run.trial016.stderr:set osd.3 primary-affinity to 1 (8655362) 2026-02-24T08:02:35.006 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-24T08:02:35.007 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T08:02:35.007 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:02:35.123 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.171 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:34 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: ::ffff:10.20.193.43 - - [24/Feb/2026:08:02:34] "GET /metrics HTTP/1.1" 503 735 "" "Prometheus/3.6.0" 2026-02-24T08:02:35.172 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:34 trial016 ceph-mon[39544]: pgmap v596: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:35.172 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1765977909' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:02:35.172 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:34 trial016 ceph-mon[39544]: osdmap e149: 4 total, 4 up, 4 in 2026-02-24T08:02:35.172 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:34 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4207250109' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:02:35.217 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.215+0000 7fb106b1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.215+0000 7fb106b1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.330 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:35.330 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":150,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","created":"2026-02-24T07:45:33.912476+0000","modified":"2026-02-24T08:02:34.961352+0000","last_up_change":"2026-02-24T07:46:43.054636+0000","last_in_change":"2026-02-24T07:46:33.899592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:46:35.731149+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22020e1a-4666-4547-975e-a1c54d782ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6803","nonce":535869433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6805","nonce":535869433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6809","nonce":535869433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6807","nonce":535869433}]},"public_addr":"10.20.193.16:6803/535869433","cluster_addr":"10.20.193.16:6805/535869433","heartbeat_back_addr":"10.20.193.16:6809/535869433","heartbeat_front_addr":"10.20.193.16:6807/535869433","state":["exists","up"]},{"osd":1,"uuid":"121f0fef-9a82-4630-97c6-fdecadf14a25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6811","nonce":157128715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6813","nonce":157128715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6817","nonce":157128715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6815","nonce":157128715}]},"public_addr":"10.20.193.16:6811/157128715","cluster_addr":"10.20.193.16:6813/157128715","heartbeat_back_addr":"10.20.193.16:6817/157128715","heartbeat_front_addr":"10.20.193.16:6815/157128715","state":["exists","up"]},{"osd":2,"uuid":"c8029751-589f-4aba-90a4-a0cbecaac822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6800","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6801","nonce":3201731778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6802","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6803","nonce":3201731778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6806","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6807","nonce":3201731778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6804","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6805","nonce":3201731778}]},"public_addr":"10.20.193.43:6801/3201731778","cluster_addr":"10.20.193.43:6803/3201731778","heartbeat_back_addr":"10.20.193.43:6807/3201731778","heartbeat_front_addr":"10.20.193.43:6805/3201731778","state":["exists","up"]},{"osd":3,"uuid":"89f56ad0-46e8-4029-a5b4-a47768c64a7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6808","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6809","nonce":563824018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6810","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6811","nonce":563824018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6814","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6815","nonce":563824018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6812","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6813","nonce":563824018}]},"public_addr":"10.20.193.43:6809/563824018","cluster_addr":"10.20.193.43:6811/563824018","heartbeat_back_addr":"10.20.193.43:6815/563824018","heartbeat_front_addr":"10.20.193.43:6813/563824018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:00:46.063752+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:01:07.650635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:00:27.588590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:01:16.781352+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.16:6801/540268995":"2026-02-25T07:46:51.735974+0000","10.20.193.16:6800/540268995":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/1699817835":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/3890433861":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/2716152770":"2026-02-25T07:46:51.735974+0000","10.20.193.16:6801/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/1863982042":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/823394954":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3946948853":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6801/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3304616791":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6800/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6800/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/1404893956":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/2594083080":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/3708454832":"2026-02-25T07:46:51.735974+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:02:35.367 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T08:02:35.367 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:02:35.483 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.587 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.586+0000 7fe85db64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.588 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.586+0000 7fe85db64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.699 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:35.699 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":150,"fsid":"c4ff2ae8-1154-11f1-bd55-d404e6e7d460","created":"2026-02-24T07:45:33.912476+0000","modified":"2026-02-24T08:02:34.961352+0000","last_up_change":"2026-02-24T07:46:43.054636+0000","last_in_change":"2026-02-24T07:46:33.899592+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:46:35.731149+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22020e1a-4666-4547-975e-a1c54d782ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6803","nonce":535869433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6805","nonce":535869433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6809","nonce":535869433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":535869433},{"type":"v1","addr":"10.20.193.16:6807","nonce":535869433}]},"public_addr":"10.20.193.16:6803/535869433","cluster_addr":"10.20.193.16:6805/535869433","heartbeat_back_addr":"10.20.193.16:6809/535869433","heartbeat_front_addr":"10.20.193.16:6807/535869433","state":["exists","up"]},{"osd":1,"uuid":"121f0fef-9a82-4630-97c6-fdecadf14a25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6811","nonce":157128715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6813","nonce":157128715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6817","nonce":157128715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":157128715},{"type":"v1","addr":"10.20.193.16:6815","nonce":157128715}]},"public_addr":"10.20.193.16:6811/157128715","cluster_addr":"10.20.193.16:6813/157128715","heartbeat_back_addr":"10.20.193.16:6817/157128715","heartbeat_front_addr":"10.20.193.16:6815/157128715","state":["exists","up"]},{"osd":2,"uuid":"c8029751-589f-4aba-90a4-a0cbecaac822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6800","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6801","nonce":3201731778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6802","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6803","nonce":3201731778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6806","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6807","nonce":3201731778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6804","nonce":3201731778},{"type":"v1","addr":"10.20.193.43:6805","nonce":3201731778}]},"public_addr":"10.20.193.43:6801/3201731778","cluster_addr":"10.20.193.43:6803/3201731778","heartbeat_back_addr":"10.20.193.43:6807/3201731778","heartbeat_front_addr":"10.20.193.43:6805/3201731778","state":["exists","up"]},{"osd":3,"uuid":"89f56ad0-46e8-4029-a5b4-a47768c64a7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6808","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6809","nonce":563824018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6810","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6811","nonce":563824018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6814","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6815","nonce":563824018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.43:6812","nonce":563824018},{"type":"v1","addr":"10.20.193.43:6813","nonce":563824018}]},"public_addr":"10.20.193.43:6809/563824018","cluster_addr":"10.20.193.43:6811/563824018","heartbeat_back_addr":"10.20.193.43:6815/563824018","heartbeat_front_addr":"10.20.193.43:6813/563824018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:00:46.063752+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:01:07.650635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:00:27.588590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:01:16.781352+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.16:6801/540268995":"2026-02-25T07:46:51.735974+0000","10.20.193.16:6800/540268995":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/1699817835":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/3890433861":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/2716152770":"2026-02-25T07:46:51.735974+0000","10.20.193.16:6801/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/1863982042":"2026-02-25T07:45:43.999704+0000","10.20.193.16:0/823394954":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3946948853":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6801/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/3304616791":"2026-02-25T07:45:53.520777+0000","10.20.193.16:6800/1119481031":"2026-02-25T07:45:43.999704+0000","10.20.193.16:6800/305334144":"2026-02-25T07:45:53.520777+0000","10.20.193.16:0/1404893956":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/2594083080":"2026-02-25T07:46:51.735974+0000","10.20.193.16:0/3708454832":"2026-02-25T07:46:51.735974+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:02:35.737 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T08:02:35.737 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T08:02:35.737 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T08:02:35.738 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T08:02:35.855 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.855 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.856 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.858 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:35.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.962+0000 7f238b5d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.962+0000 7f238b5d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.968 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.965+0000 7f6115e1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.969 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.966+0000 7fbef9c08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.969 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.966+0000 7fbef9c08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.969 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.966+0000 7f6115e1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.970 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.968+0000 7fa227cf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:35.970 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:35.968+0000 7fa227cf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4207250109' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:02:36.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:35 trial016 ceph-mon[39544]: osdmap e150: 4 total, 4 up, 4 in 2026-02-24T08:02:36.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/927763474' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:02:36.011 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:35 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/2451594331' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:02:36.028 INFO:teuthology.orchestra.run.trial016.stdout:55834575044 2026-02-24T08:02:36.028 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:02:36.032 INFO:teuthology.orchestra.run.trial016.stdout:38654705863 2026-02-24T08:02:36.032 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:02:36.040 INFO:teuthology.orchestra.run.trial016.stdout:73014444226 2026-02-24T08:02:36.041 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:02:36.048 INFO:teuthology.orchestra.run.trial016.stdout:103079215297 2026-02-24T08:02:36.048 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:02:36.148 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:36.162 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:36.210 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:36.215 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:36.255 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.254+0000 7f3fd95e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.254+0000 7f6a35ce9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.254+0000 7f6a35ce9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.254+0000 7f3fd95e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.313+0000 7f8d0fe37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.316 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.313+0000 7f838835f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.316 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.313+0000 7f8d0fe37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.316 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:36.313+0000 7f838835f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:36.371 INFO:teuthology.orchestra.run.trial016.stdout:55834575043 2026-02-24T08:02:36.375 INFO:teuthology.orchestra.run.trial016.stdout:38654705862 2026-02-24T08:02:36.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575044 got 55834575043 for osd.1 2026-02-24T08:02:36.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705863 got 38654705862 for osd.0 2026-02-24T08:02:36.434 INFO:teuthology.orchestra.run.trial016.stdout:73014444225 2026-02-24T08:02:36.434 INFO:teuthology.orchestra.run.trial016.stdout:103079215296 2026-02-24T08:02:36.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444226 got 73014444225 for osd.2 2026-02-24T08:02:36.479 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215297 got 103079215296 for osd.3 2026-02-24T08:02:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:36 trial016 ceph-mon[39544]: pgmap v599: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3355344824' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:02:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3046912602' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:02:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3076702072' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:02:37.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:36 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3700166434' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:02:37.413 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:02:37.416 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:02:37.478 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:02:37.480 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:02:37.529 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:37.574 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:37.619 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:37.621 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:37.647 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.644+0000 7fccd9a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.647 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.645+0000 7fccd9a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.687 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.685+0000 7f37f79f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.686+0000 7f37f79f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.719 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.718+0000 7fb034f7c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.720 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.718+0000 7fea1cc9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.721 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.718+0000 7fb034f7c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.721 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:37.718+0000 7fea1cc9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:37.763 INFO:teuthology.orchestra.run.trial016.stdout:55834575043 2026-02-24T08:02:37.800 INFO:teuthology.orchestra.run.trial016.stdout:38654705862 2026-02-24T08:02:37.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575044 got 55834575043 for osd.1 2026-02-24T08:02:37.837 INFO:teuthology.orchestra.run.trial016.stdout:103079215296 2026-02-24T08:02:37.841 INFO:teuthology.orchestra.run.trial016.stdout:73014444225 2026-02-24T08:02:37.863 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705863 got 38654705862 for osd.0 2026-02-24T08:02:37.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215297 got 103079215296 for osd.3 2026-02-24T08:02:37.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444226 got 73014444225 for osd.2 2026-02-24T08:02:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/298823145' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:02:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3971298407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:02:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4025646134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:02:38.316 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:37 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3984152759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:02:38.805 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:02:38.864 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:02:38.880 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:02:38.887 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:02:38.925 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:38.984 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:39.026 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:39.027 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:39.041 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.040+0000 7f94cf322640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.042 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.040+0000 7f94cf322640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.081 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:38 trial016 ceph-mon[39544]: pgmap v600: 1 pgs: 1 active+clean; 577 KiB data, 4.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:02:39.089 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.087+0000 7f8fb5329640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.088+0000 7f8fb5329640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.131+0000 7f7e2ac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.133 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.131+0000 7f7e2ac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.134 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.132+0000 7f126a5e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.134 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.132+0000 7f126a5e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.159 INFO:teuthology.orchestra.run.trial016.stdout:55834575045 2026-02-24T08:02:39.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575044 got 55834575045 for osd.1 2026-02-24T08:02:39.200 DEBUG:teuthology.parallel:result is None 2026-02-24T08:02:39.206 INFO:teuthology.orchestra.run.trial016.stdout:38654705864 2026-02-24T08:02:39.243 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705863 got 38654705864 for osd.0 2026-02-24T08:02:39.243 DEBUG:teuthology.parallel:result is None 2026-02-24T08:02:39.250 INFO:teuthology.orchestra.run.trial016.stdout:73014444227 2026-02-24T08:02:39.254 INFO:teuthology.orchestra.run.trial016.stdout:103079215297 2026-02-24T08:02:39.291 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444226 got 73014444227 for osd.2 2026-02-24T08:02:39.291 DEBUG:teuthology.parallel:result is None 2026-02-24T08:02:39.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215297 got 103079215297 for osd.3 2026-02-24T08:02:39.295 DEBUG:teuthology.parallel:result is None 2026-02-24T08:02:39.295 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:02:39.296 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:39.450 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:39.552 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.550+0000 7f6b00ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.552 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.550+0000 7f6b00ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.661 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:39.662 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:39.697 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":600,"stamp":"2026-02-24T08:02:37.871809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":4853036,"kb_used_data":4572,"kb_used_omap":91,"kb_used_meta":4848292,"kb_avail":2931159764,"statfs":{"total":3006477107200,"available":3001507598336,"internally_reserved":0,"allocated":4681728,"data_stored":2830574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93897,"internal_metadata":4964651319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917347"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":531,"reported_epoch":150,"state":"active+clean","last_fresh":"2026-02-24T08:02:34.961536+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:02:34.961536+0000","last_peered":"2026-02-24T08:02:34.961536+0000","last_clean":"2026-02-24T08:02:34.961536+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:02:34.961536+0000","last_undegraded":"2026-02-24T08:02:34.961536+0000","last_fullsized":"2026-02-24T08:02:34.961536+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13085,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1192032,"kb_used_data":1292,"kb_used_omap":24,"kb_used_meta":1190695,"kb_avail":732811168,"statfs":{"total":751619276800,"available":750398636032,"internally_reserved":0,"allocated":1323008,"data_stored":857264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25378,"internal_metadata":1219271902},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444227,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1363472,"kb_used_data":1276,"kb_used_omap":21,"kb_used_meta":1362154,"kb_avail":732639728,"statfs":{"total":751619276800,"available":750223081472,"internally_reserved":0,"allocated":1306624,"data_stored":849150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21965,"internal_metadata":1394846259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":725148,"kb_used_data":712,"kb_used_omap":20,"kb_used_meta":724395,"kb_avail":733278052,"statfs":{"total":751619276800,"available":750876725248,"internally_reserved":0,"allocated":729088,"data_stored":266896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20657,"internal_metadata":741781327},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1572384,"kb_used_data":1292,"kb_used_omap":25,"kb_used_meta":1571046,"kb_avail":732430816,"statfs":{"total":751619276800,"available":750009155584,"internally_reserved":0,"allocated":1323008,"data_stored":857264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25897,"internal_metadata":1608751831},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13085,"internal_metadata":0}]}} 2026-02-24T08:02:39.698 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:02:39.813 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:39.913 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.911+0000 7fb000743640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:39.913 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:39.911+0000 7fb000743640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:40.022 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-24T08:02:40.022 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-24T08:02:40.059 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":601,"stamp":"2026-02-24T08:02:39.872088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":4853036,"kb_used_data":4572,"kb_used_omap":91,"kb_used_meta":4848292,"kb_avail":2931159764,"statfs":{"total":3006477107200,"available":3001507598336,"internally_reserved":0,"allocated":4681728,"data_stored":2830574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93897,"internal_metadata":4964651319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.916936"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":531,"reported_epoch":150,"state":"active+clean","last_fresh":"2026-02-24T08:02:34.961536+0000","last_change":"2026-02-24T08:01:26.853024+0000","last_active":"2026-02-24T08:02:34.961536+0000","last_peered":"2026-02-24T08:02:34.961536+0000","last_clean":"2026-02-24T08:02:34.961536+0000","last_became_active":"2026-02-24T07:47:45.791720+0000","last_became_peered":"2026-02-24T07:47:45.791720+0000","last_unstale":"2026-02-24T08:02:34.961536+0000","last_undegraded":"2026-02-24T08:02:34.961536+0000","last_fullsized":"2026-02-24T08:02:34.961536+0000","mapping_epoch":27,"log_start":"26'96","ondisk_log_start":"26'96","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:01:26.852990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:46:36.462890+0000","last_clean_scrub_stamp":"2026-02-24T08:01:26.852990+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:41.389677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13085,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1192032,"kb_used_data":1292,"kb_used_omap":24,"kb_used_meta":1190695,"kb_avail":732811168,"statfs":{"total":751619276800,"available":750398636032,"internally_reserved":0,"allocated":1323008,"data_stored":857264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25378,"internal_metadata":1219271902},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444227,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1363472,"kb_used_data":1276,"kb_used_omap":21,"kb_used_meta":1362154,"kb_avail":732639728,"statfs":{"total":751619276800,"available":750223081472,"internally_reserved":0,"allocated":1306624,"data_stored":849150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21965,"internal_metadata":1394846259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":725148,"kb_used_data":712,"kb_used_omap":20,"kb_used_meta":724395,"kb_avail":733278052,"statfs":{"total":751619276800,"available":750876725248,"internally_reserved":0,"allocated":729088,"data_stored":266896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20657,"internal_metadata":741781327},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1572384,"kb_used_data":1292,"kb_used_omap":25,"kb_used_meta":1571046,"kb_avail":732430816,"statfs":{"total":751619276800,"available":750009155584,"internally_reserved":0,"allocated":1323008,"data_stored":857264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25897,"internal_metadata":1608751831},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13085,"internal_metadata":0}]}} 2026-02-24T08:02:40.060 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:02:40.060 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2026-02-24T08:02:40.176 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:40.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3910401538' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:02:40.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/4031765917' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:02:40.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/3204511357' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:02:40.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:39 trial016 ceph-mon[39544]: from='client.? 10.20.193.16:0/1923216656' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:02:40.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:40.282+0000 7f0a62462640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:40.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-24T08:02:40.283+0000 7f0a62462640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:02:40.436 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T08:02:40.450 INFO:tasks.cephadm:Teardown begin 2026-02-24T08:02:40.451 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:02:40.477 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:02:40.593 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T08:02:40.593 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-24T08:02:40.710 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/mon.a/config 2026-02-24T08:02:40.728 INFO:teuthology.orchestra.run.trial016.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-24T08:02:40.728 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:40 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:08:02:40] ENGINE Bus STOPPING 2026-02-24T08:02:40.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-24T08:02:40.744 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-24T08:02:40.744 DEBUG:teuthology.orchestra.run.trial016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T08:02:40.760 DEBUG:teuthology.orchestra.run.trial043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T08:02:40.776 INFO:tasks.cephadm:Stopping all daemons... 2026-02-24T08:02:40.777 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-24T08:02:40.777 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a 2026-02-24T08:02:41.020 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:40 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:08:02:40] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T08:02:41.021 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:40 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: [24/Feb/2026:08:02:40] ENGINE Bus STOPPED 2026-02-24T08:02:41.021 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:40 trial016 systemd[1]: Stopping Ceph mon.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:41.021 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:40 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: 2026-02-24T08:02:40.907+0000 7fe28b74d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T08:02:41.021 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 24 08:02:40 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mon-a[39540]: 2026-02-24T08:02:40.907+0000 7fe28b74d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T08:02:41.094 DEBUG:teuthology.orchestra.run.trial016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mon.a.service' 2026-02-24T08:02:41.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:02:41.133 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-24T08:02:41.133 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-24T08:02:41.134 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x 2026-02-24T08:02:41.300 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:41 trial016 systemd[1]: Stopping Ceph mgr.x for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:41.300 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T08:02:41.267+0000 7f3f2e727640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T08:02:41.300 INFO:journalctl@ceph.mgr.x.trial016.stdout:Feb 24 08:02:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-mgr-x[39879]: 2026-02-24T08:02:41.267+0000 7f3f2e727640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-24T08:02:41.427 DEBUG:teuthology.orchestra.run.trial016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@mgr.x.service' 2026-02-24T08:02:41.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:02:41.465 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-24T08:02:41.465 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-24T08:02:41.465 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.0 2026-02-24T08:02:41.566 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:41 trial016 systemd[1]: Stopping Ceph osd.0 for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:42.066 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0[55646]: 2026-02-24T08:02:41.595+0000 7ff9f9d93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:02:42.066 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0[55646]: 2026-02-24T08:02:41.595+0000 7ff9f9d93640 -1 osd.0 150 *** Got signal Terminated *** 2026-02-24T08:02:42.066 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:41 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0[55646]: 2026-02-24T08:02:41.595+0000 7ff9f9d93640 -1 osd.0 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162808]: 2026-02-24 08:02:47.029395807 +0000 UTC m=+5.445930849 container stop b8ed11e689adfa71050952933bca7d58ee8f985604554c0214b7d9d37f71d7eb (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162808]: 2026-02-24 08:02:47.055531601 +0000 UTC m=+5.472066694 container died b8ed11e689adfa71050952933bca7d58ee8f985604554c0214b7d9d37f71d7eb (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default) 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162808]: 2026-02-24 08:02:47.065971366 +0000 UTC m=+5.482506398 container remove b8ed11e689adfa71050952933bca7d58ee8f985604554c0214b7d9d37f71d7eb (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 bash[162808]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162943]: 2026-02-24 08:02:47.198814067 +0000 UTC m=+0.014264451 container create 17a590596ae7be7921bc7524ec15ebb1676c68daeadb124df6499420c1e261aa (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.build-date=20260223) 2026-02-24T08:02:47.294 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162943]: 2026-02-24 08:02:47.241950685 +0000 UTC m=+0.057401069 container init 17a590596ae7be7921bc7524ec15ebb1676c68daeadb124df6499420c1e261aa (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T08:02:47.295 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162943]: 2026-02-24 08:02:47.244440871 +0000 UTC m=+0.059891265 container start 17a590596ae7be7921bc7524ec15ebb1676c68daeadb124df6499420c1e261aa (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True) 2026-02-24T08:02:47.295 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162943]: 2026-02-24 08:02:47.244977358 +0000 UTC m=+0.060427752 container attach 17a590596ae7be7921bc7524ec15ebb1676c68daeadb124df6499420c1e261aa (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260223, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS) 2026-02-24T08:02:47.295 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 24 08:02:47 trial016 podman[162943]: 2026-02-24 08:02:47.192710919 +0000 UTC m=+0.008161303 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:02:47.433 DEBUG:teuthology.orchestra.run.trial016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.0.service' 2026-02-24T08:02:47.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:02:47.471 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-24T08:02:47.471 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-24T08:02:47.471 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.1 2026-02-24T08:02:47.816 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:47 trial016 systemd[1]: Stopping Ceph osd.1 for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:47.816 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:47 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T08:02:47.603+0000 7fa110721640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:02:47.816 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:47 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T08:02:47.603+0000 7fa110721640 -1 osd.1 150 *** Got signal Terminated *** 2026-02-24T08:02:47.816 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:47 trial016 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1[63856]: 2026-02-24T08:02:47.603+0000 7fa110721640 -1 osd.1 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:02:53.301 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163079]: 2026-02-24 08:02:53.047689272 +0000 UTC m=+5.454782373 container died 421d705c232bfb87f986310a67d87b6ef0f9402e6c384a28fbc9229dfe937416 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-02-24T08:02:53.301 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163079]: 2026-02-24 08:02:53.060131477 +0000 UTC m=+5.467224578 container remove 421d705c232bfb87f986310a67d87b6ef0f9402e6c384a28fbc9229dfe937416 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-24T08:02:53.301 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 bash[163079]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1 2026-02-24T08:02:53.301 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163223]: 2026-02-24 08:02:53.206252746 +0000 UTC m=+0.015229824 container create c405ee012ee78663835ea4057d7cb61f601bdee279823fd5f867e296de862d4d (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T08:02:53.302 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163223]: 2026-02-24 08:02:53.23309903 +0000 UTC m=+0.042076118 container init c405ee012ee78663835ea4057d7cb61f601bdee279823fd5f867e296de862d4d (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-02-24T08:02:53.302 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163223]: 2026-02-24 08:02:53.235563839 +0000 UTC m=+0.044540927 container start c405ee012ee78663835ea4057d7cb61f601bdee279823fd5f867e296de862d4d (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T08:02:53.302 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163223]: 2026-02-24 08:02:53.236074488 +0000 UTC m=+0.045051586 container attach c405ee012ee78663835ea4057d7cb61f601bdee279823fd5f867e296de862d4d (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2026-02-24T08:02:53.302 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 24 08:02:53 trial016 podman[163223]: 2026-02-24 08:02:53.199943465 +0000 UTC m=+0.008920543 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:02:53.406 DEBUG:teuthology.orchestra.run.trial016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.1.service' 2026-02-24T08:02:53.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:02:53.443 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-24T08:02:53.443 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-24T08:02:53.443 DEBUG:teuthology.orchestra.run.trial043:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.2 2026-02-24T08:02:53.746 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:53 trial043 systemd[1]: Stopping Ceph osd.2 for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:53.746 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:53 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T08:02:53.539+0000 7fdf1071f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:02:53.746 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:53 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T08:02:53.539+0000 7fdf1071f640 -1 osd.2 150 *** Got signal Terminated *** 2026-02-24T08:02:53.746 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:53 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2[47284]: 2026-02-24T08:02:53.539+0000 7fdf1071f640 -1 osd.2 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:02:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:02:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:02:56.691Z level=ERROR source=refresh.go:90 msg="Unable to refresh target groups" component="discovery manager scrape" discovery=http config=node-exporter err="Get \"http://10.20.193.16:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 10.20.193.16:8765: connect: connection refused" 2026-02-24T08:02:56.996 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:02:56 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:02:56.691Z level=ERROR source=refresh.go:90 msg="Unable to refresh target groups" component="discovery manager scrape" discovery=http config=ceph err="Get \"http://10.20.193.16:8765/sd/prometheus/sd-config?service=ceph\": dial tcp 10.20.193.16:8765: connect: connection refused" 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:58 trial043 podman[68449]: 2026-02-24 08:02:58.883473561 +0000 UTC m=+5.356394224 container died 04c6bbfc61f72a836650b4133c0e61ec6f7a748703292f32c5da9edcf61e5a75 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, ceph=True, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests) 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:58 trial043 podman[68449]: 2026-02-24 08:02:58.897625944 +0000 UTC m=+5.370546597 container remove 04c6bbfc61f72a836650b4133c0e61ec6f7a748703292f32c5da9edcf61e5a75 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223) 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:58 trial043 bash[68449]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.028532341 +0000 UTC m=+0.017287010 container create 89ae468b61fe988cfc96e4f50756699316af21c295a5873e6f411a386bc19f74 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.061886721 +0000 UTC m=+0.050641390 container init 89ae468b61fe988cfc96e4f50756699316af21c295a5873e6f411a386bc19f74 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, ceph=True, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T08:02:59.200 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.064983597 +0000 UTC m=+0.053738276 container start 89ae468b61fe988cfc96e4f50756699316af21c295a5873e6f411a386bc19f74 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, ceph=True) 2026-02-24T08:02:59.201 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.065375616 +0000 UTC m=+0.054130295 container attach 89ae468b61fe988cfc96e4f50756699316af21c295a5873e6f411a386bc19f74 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2-deactivate, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T08:02:59.201 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.021432435 +0000 UTC m=+0.010187114 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:02:59.201 INFO:journalctl@ceph.osd.2.trial043.stdout:Feb 24 08:02:59 trial043 podman[68589]: 2026-02-24 08:02:59.197600853 +0000 UTC m=+0.186355532 container died 89ae468b61fe988cfc96e4f50756699316af21c295a5873e6f411a386bc19f74 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T08:02:59.227 DEBUG:teuthology.orchestra.run.trial043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.2.service' 2026-02-24T08:02:59.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:02:59.266 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-24T08:02:59.266 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-24T08:02:59.266 DEBUG:teuthology.orchestra.run.trial043:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.3 2026-02-24T08:02:59.496 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:02:59 trial043 systemd[1]: Stopping Ceph osd.3 for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:02:59.496 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:02:59 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T08:02:59.399+0000 7f108ce07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:02:59.496 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:02:59 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T08:02:59.399+0000 7f108ce07640 -1 osd.3 150 *** Got signal Terminated *** 2026-02-24T08:02:59.496 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:02:59 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3[54985]: 2026-02-24T08:02:59.399+0000 7f108ce07640 -1 osd.3 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:03:05.246 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:04 trial043 podman[68726]: 2026-02-24 08:03:04.985525592 +0000 UTC m=+5.596468218 container died 0904cc9d8a41772b9efd7d1c194c4f00def79a7bc68528b4e403ee6284df60dd (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:04 trial043 podman[68726]: 2026-02-24 08:03:04.997198026 +0000 UTC m=+5.608140662 container remove 0904cc9d8a41772b9efd7d1c194c4f00def79a7bc68528b4e403ee6284df60dd (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:04 trial043 bash[68726]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:05 trial043 podman[68856]: 2026-02-24 08:03:05.121417334 +0000 UTC m=+0.016854316 container create e6574295a48a11f96c1e21648416ee7ed38e6a65cd1842185405277ebc1f073c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:05 trial043 podman[68856]: 2026-02-24 08:03:05.15484437 +0000 UTC m=+0.050281352 container init e6574295a48a11f96c1e21648416ee7ed38e6a65cd1842185405277ebc1f073c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:05 trial043 podman[68856]: 2026-02-24 08:03:05.157222119 +0000 UTC m=+0.052659101 container start e6574295a48a11f96c1e21648416ee7ed38e6a65cd1842185405277ebc1f073c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:05 trial043 podman[68856]: 2026-02-24 08:03:05.157668879 +0000 UTC m=+0.053105861 container attach e6574295a48a11f96c1e21648416ee7ed38e6a65cd1842185405277ebc1f073c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T08:03:05.247 INFO:journalctl@ceph.osd.3.trial043.stdout:Feb 24 08:03:05 trial043 podman[68856]: 2026-02-24 08:03:05.115543026 +0000 UTC m=+0.010980018 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:03:05.327 DEBUG:teuthology.orchestra.run.trial043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@osd.3.service' 2026-02-24T08:03:05.364 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:03:05.365 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-24T08:03:05.365 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2026-02-24T08:03:05.365 DEBUG:teuthology.orchestra.run.trial043:> sudo systemctl stop ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@prometheus.a 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 systemd[1]: Stopping Ceph prometheus.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.494Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T08:03:05.568 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a[65781]: time=2026-02-24T08:03:05.496Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T08:03:05.569 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 podman[68986]: 2026-02-24 08:03:05.504946604 +0000 UTC m=+0.022901295 container died 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T08:03:05.569 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 podman[68986]: 2026-02-24 08:03:05.514529023 +0000 UTC m=+0.032483714 container remove 15d3de41d159ed201ccecbafb9e30aad1a2f274e489ab7f178526f8bc837c3c3 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T08:03:05.569 INFO:journalctl@ceph.prometheus.a.trial043.stdout:Feb 24 08:03:05 trial043 bash[68986]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-prometheus-a 2026-02-24T08:03:05.590 DEBUG:teuthology.orchestra.run.trial043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@prometheus.a.service' 2026-02-24T08:03:05.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:03:05.625 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2026-02-24T08:03:05.625 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 --force --keep-logs 2026-02-24T08:03:05.745 INFO:teuthology.orchestra.run.trial016.stdout:Deleting cluster with fsid: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T08:03:06.481 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 systemd[1]: Stopping Ceph node-exporter.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:03:06.481 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 podman[163560]: 2026-02-24 08:03:06.418723617 +0000 UTC m=+0.021687751 container died 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T08:03:06.481 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 podman[163560]: 2026-02-24 08:03:06.428314906 +0000 UTC m=+0.031279040 container remove 85f4f7f04e88d3b7c36fa5741ec02db42866be14bcd1c6b8b255ab45541ccb36 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T08:03:06.481 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 bash[163560]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-a 2026-02-24T08:03:06.481 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2026-02-24T08:03:06.754 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.a.service: Failed with result 'exit-code'. 2026-02-24T08:03:06.754 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 systemd[1]: Stopped Ceph node-exporter.a for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T08:03:06.754 INFO:journalctl@ceph.node-exporter.a.trial016.stdout:Feb 24 08:03:06 trial016 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.a.service: Consumed 3.314s CPU time. 2026-02-24T08:03:07.021 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 --force --keep-logs 2026-02-24T08:03:07.139 INFO:teuthology.orchestra.run.trial043.stdout:Deleting cluster with fsid: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T08:03:07.976 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 systemd[1]: Stopping Ceph node-exporter.b for c4ff2ae8-1154-11f1-bd55-d404e6e7d460... 2026-02-24T08:03:07.976 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 podman[69302]: 2026-02-24 08:03:07.665950194 +0000 UTC m=+0.023190542 container died 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 podman[69302]: 2026-02-24 08:03:07.674158069 +0000 UTC m=+0.031398407 container remove 7dd2b5fc82e773586a5a00c3b29ae0eecd92822e904ac7e5511f8167634422b5 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 bash[69302]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460-node-exporter-b 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.b.service: Failed with result 'exit-code'. 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 systemd[1]: Stopped Ceph node-exporter.b for c4ff2ae8-1154-11f1-bd55-d404e6e7d460. 2026-02-24T08:03:07.977 INFO:journalctl@ceph.node-exporter.b.trial043.stdout:Feb 24 08:03:07 trial043 systemd[1]: ceph-c4ff2ae8-1154-11f1-bd55-d404e6e7d460@node-exporter.b.service: Consumed 2.851s CPU time. 2026-02-24T08:03:08.246 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:03:08.274 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:03:08.302 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T08:03:08.307 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial016/crash 2026-02-24T08:03:08.309 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash -- . 2026-02-24T08:03:08.339 INFO:teuthology.orchestra.run.trial016.stderr:tar: /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T08:03:08.339 INFO:teuthology.orchestra.run.trial016.stderr:tar: Error is not recoverable: exiting now 2026-02-24T08:03:08.341 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial043/crash 2026-02-24T08:03:08.343 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash -- . 2026-02-24T08:03:08.368 INFO:teuthology.orchestra.run.trial043.stderr:tar: /var/lib/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T08:03:08.368 INFO:teuthology.orchestra.run.trial043.stderr:tar: Error is not recoverable: exiting now 2026-02-24T08:03:08.369 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T08:03:08.369 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-24T08:03:08.406 INFO:tasks.cephadm:Compressing logs... 2026-02-24T08:03:08.406 DEBUG:teuthology.orchestra.run.trial016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:03:08.447 DEBUG:teuthology.orchestra.run.trial043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:03:08.471 INFO:teuthology.orchestra.run.trial016.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T08:03:08.471 INFO:teuthology.orchestra.run.trial016.stderr:: No such file or directory 2026-02-24T08:03:08.471 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mon.a.log 2026-02-24T08:03:08.471 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.0.log 2026-02-24T08:03:08.471 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.cephadm.log 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.audit.log 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr: 82.1% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.1.log 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mgr.x.log 2026-02-24T08:03:08.472 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.log 2026-02-24T08:03:08.473 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.log: 89.5% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.audit.log.gz 2026-02-24T08:03:08.473 INFO:teuthology.orchestra.run.trial016.stderr: 86.2% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph.log.gz 2026-02-24T08:03:08.474 INFO:teuthology.orchestra.run.trial016.stderr: 94.5% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log.gz 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.2.log 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.3.log 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log 2026-02-24T08:03:08.475 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.2.log: /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log: 83.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T08:03:08.476 INFO:teuthology.orchestra.run.trial043.stderr: 94.2% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-volume.log.gz 2026-02-24T08:03:08.477 INFO:teuthology.orchestra.run.trial016.stderr: 95.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T08:03:08.557 INFO:teuthology.orchestra.run.trial016.stderr: 90.5% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-24T08:03:08.788 INFO:teuthology.orchestra.run.trial016.stderr: 89.7% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-mon.a.log.gz 2026-02-24T08:19:26.869 INFO:teuthology.orchestra.run.trial043.stderr: 94.4% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.3.log.gz 2026-02-24T08:20:21.099 INFO:teuthology.orchestra.run.trial016.stderr: 94.3% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.0.log.gz 2026-02-24T08:20:29.604 INFO:teuthology.orchestra.run.trial043.stderr: 94.3% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.2.log.gz 2026-02-24T08:20:29.606 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-24T08:20:29.607 INFO:teuthology.orchestra.run.trial043.stderr:real 17m21.143s 2026-02-24T08:20:29.607 INFO:teuthology.orchestra.run.trial043.stderr:user 30m59.844s 2026-02-24T08:20:29.607 INFO:teuthology.orchestra.run.trial043.stderr:sys 2m26.383s 2026-02-24T08:22:28.707 INFO:teuthology.orchestra.run.trial016.stderr: 94.1% -- replaced with /var/log/ceph/c4ff2ae8-1154-11f1-bd55-d404e6e7d460/ceph-osd.1.log.gz 2026-02-24T08:22:28.709 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-24T08:22:28.709 INFO:teuthology.orchestra.run.trial016.stderr:real 19m20.248s 2026-02-24T08:22:28.709 INFO:teuthology.orchestra.run.trial016.stderr:user 33m35.428s 2026-02-24T08:22:28.709 INFO:teuthology.orchestra.run.trial016.stderr:sys 2m43.810s 2026-02-24T08:22:28.709 INFO:tasks.cephadm:Archiving logs... 2026-02-24T08:22:28.709 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial016/log 2026-02-24T08:22:28.713 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T08:24:54.273 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial043/log 2026-02-24T08:24:54.274 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T08:27:07.560 INFO:tasks.cephadm:Removing cluster... 2026-02-24T08:27:07.561 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 --force 2026-02-24T08:27:07.691 INFO:teuthology.orchestra.run.trial016.stdout:Deleting cluster with fsid: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T08:27:10.235 DEBUG:teuthology.orchestra.run.trial043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c4ff2ae8-1154-11f1-bd55-d404e6e7d460 --force 2026-02-24T08:27:10.406 INFO:teuthology.orchestra.run.trial043.stdout:Deleting cluster with fsid: c4ff2ae8-1154-11f1-bd55-d404e6e7d460 2026-02-24T08:27:12.746 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T08:27:12.747 DEBUG:teuthology.orchestra.run.trial016:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T08:27:12.765 DEBUG:teuthology.orchestra.run.trial043:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T08:27:12.783 INFO:tasks.cephadm:Teardown complete 2026-02-24T08:27:12.783 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T08:27:12.799 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T08:27:12.799 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T08:27:12.808 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T08:27:13.008 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T08:27:13.018 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T08:27:13.019 DEBUG:teuthology.orchestra.run.trial016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:27:13.021 DEBUG:teuthology.orchestra.run.trial043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:27:13.035 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:27:13.037 INFO:teuthology.orchestra.run.trial043.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:=============================================================================== 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:^+ 50.218.103.254 2 8 377 201 +1284us[+1507us] +/- 36ms 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:^- ntp6.kernfusion.at 2 7 377 80 -237us[ -165us] +/- 46ms 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:^* rn-02.koehn.com 2 7 377 11 -202us[ -125us] +/- 14ms 2026-02-24T08:27:13.068 INFO:teuthology.orchestra.run.trial043.stdout:^- 69-10-208-170.rainiercon> 2 6 377 14 -566us[ -490us] +/- 70ms 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:^- 170-187-142-180.ip.linod> 2 8 377 69 -9637us[-9637us] +/- 81ms 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:^- ntp6.kernfusion.at 2 7 377 76 +350us[ +372us] +/- 46ms 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:^* rn-02.koehn.com 2 8 377 75 +66us[ +89us] +/- 13ms 2026-02-24T08:27:13.069 INFO:teuthology.orchestra.run.trial016.stdout:^- 69-10-208-170.rainiercon> 2 6 377 75 -101us[ -101us] +/- 70ms 2026-02-24T08:27:13.069 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T08:27:13.080 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T08:27:13.081 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T08:27:13.095 DEBUG:teuthology.orchestra.run.trial016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T08:27:13.185 DEBUG:teuthology.orchestra.run.trial043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T08:27:13.244 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:27:13.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:13.272 DEBUG:teuthology.orchestra.run.trial043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:27:13.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:13.299 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T08:27:13.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T08:27:13.330 INFO:teuthology.task.internal:Duration was 3494.468632 seconds 2026-02-24T08:27:13.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T08:27:13.347 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T08:27:13.347 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T08:27:13.350 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T08:27:13.387 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:27:13.387 INFO:teuthology.orchestra.run.trial043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:27:13.528 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T08:27:13.529 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial016.front.sepia.ceph.com 2026-02-24T08:27:13.529 DEBUG:teuthology.orchestra.run.trial016:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T08:27:13.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial043.front.sepia.ceph.com 2026-02-24T08:27:13.549 DEBUG:teuthology.orchestra.run.trial043:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T08:27:13.586 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T08:27:13.586 DEBUG:teuthology.orchestra.run.trial016:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:27:13.591 DEBUG:teuthology.orchestra.run.trial043:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:27:13.968 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T08:27:13.969 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:27:13.972 DEBUG:teuthology.orchestra.run.trial043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:27:13.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:27:13.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:27:13.993 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T08:27:13.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:27:13.994 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T08:27:13.997 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:27:13.998 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:27:13.998 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T08:27:13.998 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:27:13.998 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T08:27:14.013 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 85.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T08:27:14.101 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T08:27:14.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T08:27:14.114 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T08:27:14.115 DEBUG:teuthology.orchestra.run.trial016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T08:27:14.167 DEBUG:teuthology.orchestra.run.trial043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T08:27:14.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T08:27:14.212 DEBUG:teuthology.orchestra.run.trial016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:27:14.215 DEBUG:teuthology.orchestra.run.trial043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:27:14.237 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = core 2026-02-24T08:27:14.259 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern = core 2026-02-24T08:27:14.274 DEBUG:teuthology.orchestra.run.trial016:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:27:14.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:14.308 DEBUG:teuthology.orchestra.run.trial043:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:27:14.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:14.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T08:27:14.339 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T08:27:14.340 DEBUG:teuthology.misc:Transferring archived files from trial016:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial016 2026-02-24T08:27:14.340 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T08:27:14.398 DEBUG:teuthology.misc:Transferring archived files from trial043:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67577/remote/trial043 2026-02-24T08:27:14.398 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T08:27:14.433 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T08:27:14.433 DEBUG:teuthology.orchestra.run.trial016:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T08:27:14.436 DEBUG:teuthology.orchestra.run.trial043:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T08:27:14.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T08:27:14.499 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T08:27:14.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T08:27:14.517 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T08:27:14.517 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T08:27:14.520 DEBUG:teuthology.orchestra.run.trial043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T08:27:14.535 INFO:teuthology.orchestra.run.trial016.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 08:27 /home/ubuntu/cephtest 2026-02-24T08:27:14.536 INFO:teuthology.orchestra.run.trial043.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 08:27 /home/ubuntu/cephtest 2026-02-24T08:27:14.537 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T08:27:14.548 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T08:27:14.581 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} duration: 3494.4686324596405 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-24T08:27:14.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T08:27:14.684 INFO:teuthology.run:pass